arrow
Return

Lightweight diffusion models: a survey

delete2024-05-31
delete1
delete
OA
AI
S
Song, Wei *
M
Ma, Wen
Z
Zhang, Ming
Y
Yanghao Zhang
X
Xiaobing Zhao
DOI:10.1007/s10462-024-10800-8delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Diffusion models (DMs) are a type of potential generative models, which have achieved better effects in many fields than traditional methods. DMs consist of two main processes: one is the forward process of gradually adding noise to the original data until pure Gaussian noise; the other is the reverse process of gradually removing noise to generate samples conforming to the target distribution. DMs optimize the application results through the iterative noise processing process. However, this greatly increases the computational and storage costs in the training and inference stages, limiting the wide application of DMs. Therefore, how to effectively reduce the resource consumption of using DMs while giving full play to their good performance has become a valuable and necessary research problem. At present, some research has been devoted to lightweight DMs to solve this problem, but there has been no survey in this area. This paper focuses on lightweight DMs methods in the field of image processing, classifies them according to their processing ideas. Finally, the development prospect of future work is analyzed and discussed. It is hoped that this paper can provide other researchers with strategic ideas to reduce the resource consumption of DMs, thereby promoting the further development of this research direction and providing available models for wider applications.
Keywords:
Diffusion models
Lightweight
Image processing
Generative models

Journal

Artificial Intelligence Review cover
Artificial Intelligence Review
IF:
13.9
Papers:
6.1K
Citations:
1.9W

Organization

M
Minzu University of China
Scholars:
3.3K
Papers: 1.9K
Citations: 6.7K
Cited Papers

Cited Papers

SRDiff: Single image super-resolution with diffusion probabilistic models
err2022-03-01
err330
errOAAI
errLi, Haoying; Yang, Yifan; Chang, Meng; Chen, Shiqi; Feng, Huajun; Xu, Zhihai; Li, Qi; Chen, Yueting
errShare
errSave
Customer service communication with customers with disability
err2019-01-14
err0
PREAI
errSusan Elizabeth Taylor; Susan Balandin; Erin Wilson; Kevin Murfitt
errShare
errSave
errShare
errSave
A role for anion transport in the regulation of release from chromaffin granules and exocytosis from cells
err2004-02-19
err0
PREAI
errHarvey B. Pollard; Christopher J. Pazoles; Carl E. Creutz; Avner Ramu; Charles A. Strott; Probhati Ray; Edward M. Brown; G. D. Aurbach; Karen M. Tack‐Goldman; N. Raphael Shulman
errShare
errSave
An accessible Brno city centre for people with impaired mobility
err2018-10-21
err0
errOAAI
errJana Stehlíková; Tomáš Řezník
errShare
errSave
Forgetting the Madeleine
err2013-01-01
err0
PREAI
errPatrick M. Bray
errShare
errSave
researcher View more