arrow
Return

Do generative models learn rare generative factors?

delete2025-11-19
delete0
delete
OA
AI
F
Fasih Haider *
Y
Yuyang Xue
S
Sotirios A. Tsaftaris
DOI:10.3389/frai.2025.1697139delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Generative models are becoming a promising tool in AI alongside discriminative learning. Several models have been proposed to learn in an unsupervised fashion the corresponding generative factors; namely the latent variables critical for capturing the full spectrum of data variability. Diffusion Models (DMs); Generative Adversarial Networks (GANs) and Variational Autoencoders (VAEs) are of particular interest due to their impressive ability to generate highly realistic data. Through a systematic empirical study; this paper delves into the intricate challenge of how DMs; GANs and VAEs internalize and replicate rare generative factors. Our findings reveal a pronounced tendency toward memorization of these factors. We study the reasons for this memorization and demonstrate that strategies such as spectral decoupling can mitigate this issue to a certain extent.1
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

F
Frontiers in Artificial Intelligence
IF:
4.7
Papers:
2.3K
Citations:
4.4K

Organization

No organization information available