arrow
返回

Long-tailed video recognition via majority-guided diffusion model

delete2025-01-06
delete0
PRE
AI
胡雨凡 封面图
胡雨凡 (Yufan Hu)
Y
Yi Zhang
Z
Zhang, Lixin *
DOI:10.1007/s00530-024-01624-1delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Long-tailed video recognition presents a significant challenge due to the imbalanced distribution of samples across different classes, where majority classes contain abundant samples, and minority classes are severely underrepresented. Existing methods primarily focus on resampling, reweighting, and architectural modifications, which do not fully leverage the rich information contained within majority class samples. Motivated by this, we propose a novel majority-guided diffusion model for addressing the long-tailed distribution problem in video recognition. Specifically, we introduce an attention-based feature mix module (AFM) to blend majority and minority class information, followed by a minority-class data generator (MDG) that synthesizes diverse minority class samples using a latent diffusion model. By leveraging the rich information from majority class samples, our method generates realistic minority class samples that improve the overall model performance on underrepresented categories. Extensive experimental results on long-tailed video recognition benchmarks validate the effectiveness of the proposed framework.
Keyword:
Long-tailed distribution
Diffusion model
Video classification
Imbalanced learning

期刊

Multimedia Systems 封面图
Multimedia Systems
IF:
3.1
论文数:
2.8K
被引数:
2.7K

机构

暂无机构信息
引用论文

引用论文

Reduced Uterine Tissue Damage during Chlamydia muridarum Infection in TREM-1,3-Deficient Mice
err2021-09-16
err0
errOAAI
errBryan E. McQueen; Avinash Kollipara; Clare E. Gyorke; Charles W. Andrews; Ashley Ezzell; Toni Darville; Uma M. Nagarajan
err分享
err收藏
err分享
err收藏
The mental health of staff working in intensive care during COVID-19
err
IF0
err2020-11-04
err0
errOAAI
errNeil Greenberg; Dale Weston; Charlotte Hall; Tristan Caulfield; Victoria Williamson; Kevin Fong
err分享
err收藏
err分享
err收藏
Arsenic removal from aqueous solutions by adsorption using novel MIL-53(Fe) as a highly efficient adsorbent使用新型MIL-53(Fe) 作为高效吸附剂通过吸附从水溶液中去除砷
err2015-01-01
err0
PREAI
errTuan. A. Vu; Giang. H. Le; Canh. D. Dao; Lan. Q. Dang; Kien. T. Nguyen; Quang. K. Nguyen; Phuong. T. Dang; Hoa. T. K. Tran; Quang. T. Duong; Tuyen. V. Nguyen; Gun. D. Lee
err分享
err收藏
学者 查看更多内容