arrow
返回

Rethinking Noise Sampling in Class-Imbalanced Diffusion Models

delete2024-01-01
delete0
PRE
AI
C
Chenghao Xu
J
Jiexi Yan
M
Muli Yang
邓
邓程 (Cheng Deng) *
DOI:10.1109/TIP.2024.3485484delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In the practical application of image generation, dealing with long-tailed data distributions is a common challenge for diffusion-based generative models. To tackle this issue, we investigate the head-class accumulation effect in diffusion models' latent space, particularly focusing on its correlation to the noise sampling strategy. Our experimental analysis indicates that employing a consistent sampling distribution for the noise prior across all classes leads to a significant bias towards head classes in the noise sampling distribution, which results in poor quality and diversity of the generated images. Motivated by this observation, we propose a novel sampling strategy named Bias-aware Prior Adjusting (BPA) to debias diffusion models in the class-imbalanced scenario. With BPA, each class is automatically assigned an adaptive noise sampling distribution prior during training, effectively mitigating the influence of class imbalance on the generation process. Extensive experiments on several benchmarks demonstrate that images generated using our proposed BPA showcase elevated diversity and superior quality.
Keyword:
Noise
Diffusion models
Head
Training
Tail
Data models
Training data
Process control
Noise measurement
Interpolation
Long-tailed learning
diffusion model
image generation

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

X
Xidian University
学者数:
2.4W
论文数: 1.9W
被引数: 9.7K
A
agency for science technology & research (a*star)
学者数:
2.2W
论文数: 1.9W
被引数: 57
引用论文

引用论文

Bioinformatics Analysis of Key Genes and Pathways for Obesity Associated Type 2 Diabetes Mellitus as a Therapeutic Target
err
IF0
err2020-12-27
err0
errOAAI
errBasavaraj Vastrad; Anandkumar Tengli; Chanabasayya Vastrad; Iranna Kotturshetti
err分享
err收藏
Effect of recrystallization on plasticity, fracture toughness and stress corrosion cracking of a high-alloying Al-Zn-Mg-Cu alloy
err2020-09-01
err0
PREAI
errMingyang Yu; Yong'an Zhang; Xiwu Li; Kai Wen; Baiqing Xiong; Zhihui Li; Lizhen Yan; Hongwei Yan; Hongwei Liu; Ya'nan Li
err分享
err收藏
Introduction
err2005-08-25
err0
PREAI
errMary Coleman; Catalina Betancur
err分享
err收藏
The Formation of Porous Oxides on Metals
err1959-01-01
err0
PREAI
errD. W. Aylmore; S. J. Gregg; W. B. Jepson
err分享
err收藏
err分享
err收藏
学者 查看更多内容