arrow
返回

Long-tailed recognition via key attribute learning

delete2025-04-01
delete0
PRE
AI
Y
Yu Fu
韩军功 (Jungong Han) *
X
Xiang Chang
C
Changrui Chen
C
Changjing Shang
Q
Qiang Shen
DOI:10.1016/j.neucom.2025.129586delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Deep learning models often struggle with datasets exhibiting long-tailed distributions, where the majority of data is concentrated in a few categories, leaving many with very few samples. This imbalance results in models favouring well-represented categories, leading to poorer performance for those with fewer instances. Existing methodologies focus on addressing class-wise imbalance but disregard the attribute-wise disparities. By assigning equal weight to each instance within a class, these approaches overlook the long-tailed distribution of attributes, thus underrepresenting information from infrequent attributes. The reduction in feature diversity consequently diminishes model performance. To address this challenge, we introduce an innovative methodology, namely Key Attribute Learning (KAL). It emphasises the importance of less common attributes by utilising the Instance Diversity Index (IDI) to assess and prioritise attribute diversity for each instance. KAL effectively expands feature margins among categories and addresses the overfitting problem. Our results demonstrate that KAL is non-invasive in both single-model and Mixture of Experts (MoE) settings. Implementing our method on BalPoE, we attained state-of-the-art (SOTA) performance on CIFAR-100-im100, ImageNet-LT, and iNaturalist datasets, showcasing its broad applicability and significant improvements across both balanced and diverse test distributions.
Keyword:
Long-tail
Visual recognition
Attribute imbalance

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

U
University of Sheffield
学者数:
3.0W
论文数: 2.9W
被引数: 3.9W
A
Aberystwyth University
学者数:
2.5K
论文数: 2.5K
被引数: 4.3K
U
University of Warwick
学者数:
2.2W
论文数: 2.2W
被引数: 85
学者 查看更多机构
引用论文

引用论文

Introduction
err2005-08-25
err0
PREAI
errMary Coleman; Catalina Betancur
err分享
err收藏
Stability of adaptive behaviors in middle-school children with autism spectrum disorders
err2007-10-01
err0
PREAI
errRobin L. Gabriels; Bonnie Jean Ivers; Dina E. Hill; John A. Agnew; John McNeill
err分享
err收藏
err分享
err收藏
Balanced knowledge distillation for long-tailed learning长尾学习的均衡知识蒸馏
err2023-03-01
err29
errOAAI
errZhang, Shaoyu; Chen, Chen; Hu, Xiyuan; Peng, Silong
err分享
err收藏
err分享
err收藏
学者 查看更多内容