Active learning inspired method in generative models

Guipeng Lan

doi:10.1016/j.eswa.2024.123582

Active learning inspired method in generative models

2024-09-01

9

PRE

AI

DOI：10.1016/j.eswa.2024.123582

Original

Original request for help

Save

Abstract

En 中文

In the decade, researchers have proposed many remarkable algorithms in structural design, training modes, etc., in the field of Generative AI. However, with the explosive growth of demand for data and annotation in generative models and the emphasis on data-centric algorithms, improving model performance by improving data-efficiency has become another way for the future development of generative models. In this paper, we propose a new strategy to improve the performance of the generative models inspired by active learning. Through the cognitive feature extractor of generative models (similar oracle in active learning) to complete the annotation of data informativeness. By guiding the generative models to focus on samples in low-feature density region, i.e., with high informativeness, the models can gradually achieve full-cognitionof the data. We conduct extensive experiments to verify the effectiveness of our strategy and demonstrate its widespread application in generative models and downstream data-driven tasks.

Keywords:

Sample informativeness

Generative models

Active learning

Data-centric algorithm

Data efficiency

Active learning inspired method in generative models

Abstract

Journal

Organization