arrow
返回

DDFA: a displacement and diffusion-based feature augmentation method for imbalanced image recognition

delete2024-10-23
delete0
PRE
AI
H
Huangyuan Wu
李彬 封面图
李彬 (Bin Li)
L
Lianfang Tian *
C
Chao Dong
DOI:10.1007/s00371-024-03673-zdelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Data-driven computer vision methods have achieved great success in multiple fields, but how to learn a balanced classifier on imbalanced distribution remains a great challenge for the data-driven method. The key issue behind long-tailed distribution is the information insufficiency of tail classes. Recent works adopted information augmentation (IA) to generate new tail class samples for mitigating this issue. However, the existing IA methods usually ignore feature drift, which hurt the decision boundary. Additionally, these methods only leverage limited information to generate samples, which cannot guarantee the quality of sample generation. To address these issues, we propose a displacement and diffusion-based feature augmentation (DDFA) method for learning a balanced model on imbalanced training distribution. Firstly, the feature reverse displacement module performs feature displacement on original tail features. It can mitigate the feature drift between the head class and the tail class. Subsequently, a long-tailed diffusion model is proposed to generate high-quality tail class samples with diversity and fidelity, which can mitigate the information insufficiency issue of tail class. Finally, the original samples and generated samples are combined in the feature space to promote balanced classifier learning. Experimental results on four challenging datasets demonstrate the effectiveness of the proposed DDFA method. The code is available at: https://github.com/wzh-why/DDFA.
Keyword:
Feature augmentation
Diffusion model
Long-tailed learning
Computer vision

期刊

Visual Computer 封面图
Visual Computer
IF:
2.9
论文数:
4.6K
被引数:
6.5K

机构

S
south china university of technology
学者数:
6.8W
论文数: 5.1W
被引数: 85
引用论文

引用论文

err分享
err收藏
A deep learning system for detecting diabetic retinopathy across the disease spectrum用于检测整个疾病谱中糖尿病视网膜病变的深度学习系统
err2021-05-28
err221
errOAAI
errDai, Ling; Wu, Liang; Li, Huating; Cai, Chun; Wu, Qiang; Kong, Hongyu; Liu, Ruhan; Wang, Xiangning; Hou, Xuhong; Liu, Yuexing; Long, Xiaoxue; Wen, Yang; Lu, Lina; Shen, Yaxin; Chen, Yan; Shen, Dinggang; Yang, Xiaokang; Zou, Haidong; Sheng, Bin; Jia, Weiping
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
Prevalence and determinants of malaria among children in Zambézia Province, Mozambique赞比西亚省莫桑比克儿童中疟疾的患病率及其影响因素
err2017-03-09
err0
errOAAI
errJames G. Carlucci; Meridith Blevins Peratikos; Charlotte B. Cherry; Melanie L. Lopez; Ann F. Green; Lazaro González-Calvo; Troy D. Moon
err分享
err收藏
ImageNet Large Scale Visual Recognition ChallengeImageNet大规模视觉识别挑战
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
err分享
err收藏
err分享
err收藏
学者 查看更多内容