arrow
返回

Learning Multi-Expert Distribution Calibration for Long-Tailed Video Classification

delete2024-01-01
delete3
PRE
AI
胡雨凡 封面图
胡雨凡 (Yufan Hu)
J
Junyu Gao
徐
徐常胜 (Changsheng Xu) *
DOI:10.1109/TMM.2023.3267887delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Most existing state-of-the-art video classification methods assume that the training data obey a uniform distribution. However, video data in the real world typically exhibit an imbalanced long-tailed class distribution, resulting in a model bias towards head class and relatively low performance on tail class. While the current long-tailed classification methods usually focus on image classification, adapting them to video data is not a trivial extension. We propose an end-to-end multi-expert distribution calibration method to address these challenges based on two-level distribution information. The method jointly considers the distribution of samples in each class (intra-class distribution) and the overall distribution of diverse data (inter-class distribution) to solve the issue of imbalanced data under long-tailed distribution. By modeling the two-level distribution information, the model can jointly consider the head classes and the tail classes and significantly transfer the knowledge from the head classes to improve the performance of the tail classes. Extensive experiments verify that our method achieves state-of-the-art performance on the long-tailed video classification task.
Keyword:
Long-tailed distribution
video classification
multi-expert calibration

期刊

IEEE Transactions on Multimedia 封面图
IEEE Transactions on Multimedia
IF:
9.7
论文数:
4.5K
被引数:
2.4W

机构

C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

Combustor Miniaturization with Liquid-Fuel Filming
err2003-11-11
err0
PREAI
errSimone Stanchi; Derek Dunn-Rankin; William Sirignano
err分享
err收藏
The mental health of staff working in intensive care during COVID-19
err
IF0
err2020-11-04
err0
errOAAI
errNeil Greenberg; Dale Weston; Charlotte Hall; Tristan Caulfield; Victoria Williamson; Kevin Fong
err分享
err收藏
Climate policy: Steps to China's carbon peak气候政策: 迈向中国碳峰值的步骤
err2015-06-17
err0
errOAAI
errZhu Liu; Dabo Guan; Scott Moore; Henry Lee; Jun Su; Qiang Zhang
err分享
err收藏
err分享
err收藏
Medial Canthal Support Structures
err2015-04-01
err0
PREAI
errHyera Kang; Yasuhiro Takahashi; Takashi Nakano; Ken Asamoto; Hiroshi Ikeda; Hirohiko Kakizaki
err分享
err收藏
Recovery of brachial plexus injury after shoulder dislocation
err2009-12-01
err0
PREAI
errArkaphat Kosiyatrakul; Surasak Jitprapaikulsarn; Sebastein Durand; Christophe Oberlin
err分享
err收藏
学者 查看更多内容