Loss Functions in Diffusion Models: A Comparative Study

doi:10.1007/978-3-032-05981-9_12

Loss Functions in Diffusion Models: A Comparative Study

2026-01-01

0

PRE

AI

DOI：10.1007/978-3-032-05981-9_12

Original

Original request for help

Save

Abstract

En 中文

Diffusion models have emerged as powerful generative models, inspiring extensive research into their underlying mechanisms. One of the key questions in this area is the loss functions these models shall train with. Multiple formulations have been introduced in the literature over the past several years [4, 7,11,13] with some links and some critical differences stemming from various initial considerations. In this paper, we explore the different target objectives and corresponding loss functions in detail. We present a systematic overview of their relationships, unifying them under the framework of the variational lower bound objective. We complement this theoretical analysis with an empirical study providing insights into the conditions under which these objectives diverge in performance and the underlying factors contributing to such deviations. Additionally, we evaluate how the choice of objective impacts the model's ability to achieve specific goals, such as generating high-quality samples or accurately estimating likelihoods. This study offers a unified understanding of loss functions in diffusion models, contributing to more efficient and goal-oriented model designs in future research.

Keywords:

Diffusion Model

Loss Functions

Generative Modeling

Loss Functions in Diffusion Models: A Comparative Study

Abstract

Journal

Organization

Cited Papers