arrow
Return

Diffusion Models and Representation Learning: A Survey

delete2026-01-29
delete0
PRE
AI
M
Michael Fuest
P
Pingchuan Ma
M
Ming Gui
J
Johannes Schusterbauer
T
Tao Hu
B
Björn Ommer
DOI:10.1109/TPAMI.2026.3658965delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Diffusion Models are popular generative modeling methods in various vision tasks, attracting significant attention. They can be considered a unique instance of self-supervised learning methods due to their independence from label annotation. This survey explores the interplay between diffusion models and representation learning. It provides an overview of diffusion models’ essential aspects, including mathematical foundations, popular denoising network architectures, and guidance methods. Various approaches related to diffusion models and representation learning are detailed. These include frameworks that leverage representations learned from pre-trained diffusion models for subsequent recognition tasks and methods that utilize advancements in representation and self-supervised learning to enhance diffusion models. This survey aims to offer a comprehensive overview of the taxonomy between diffusion models and representation learning, identifying key areas of existing concerns and potential exploration.
Keywords:
Deep generative modeling
diffusion models
denoising diffusion models
score-based models
image generation
representation learning

Journal

IEEE Transactions on Pattern Analysis and Machine Intelligence cover
IEEE Transactions on Pattern Analysis and Machine Intelligence
IF:
18.6
Papers:
831
Citations:
9.8W

Organization

T
technical university of munich
Scholars:
7.0K
Papers: 2.8K
Citations: 1
L
ludwig maximilian university of munich
Scholars:
87
Papers: 48
Citations: 0