.png){kind=icon}
返回
Balanced complement loss for long-tailed image classification
.png){kind=icon}
PRE
AI
DOI：10.1007/s11042-023-17583-0.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Long-tailed image classification is a significant research direction in the computer vision community, since many real-world image datasets exhibit an obvious long-tailed distribution. For a long-tailed dataset, head classes have most training samples, while tail classes occupy few training samples. In this scenario, samples of the head classes are treated as complement samples (all samples except the ground-truth class samples) of the tail classes, which generate overwhelmingly discouraging gradients on the tail classes. Consequently, the samples of tail classes are easily misclassified as the head classes. In view of this issue, we present a balanced complement (BACL) loss by introducing an adaptive weight for complement classes in the softmax cross-entropy loss. The adaptive weight helps to mitigate the overwhelming suppression of gradients from the complement samples for the tail classes, thereby balancing the gradient ratios between complement classes and ground-truth class. After that, we further propose a joint training framework by combining our method with normalized complement entropy (NCE) via a novel double-angle sine decay strategy. The proposed decay strategy is applied to adjust the contribution between the BACL and NCE losses at the different training stages. With our joint training framework, the model first learns useful information from the complement samples and then gradually turns its attention to the classification task. Experiments on long-tailed versions of CIFAR-10/100, SVHN and ImageNet-2012 datasets are conducted to reveal the significant effectiveness of the proposed methods.
Keyword:
Long-tailed distribution
Class imbalance
Complement classes learning
Image classificationIntroduction
期刊
IF:
3
论文数:
2.0W
被引数:
3.2W
机构
引用论文
分享收藏A systematic study of the class imbalance problem in convolutional neural networks卷积神经网络中类不平衡问题的系统研究.png)
NEURAL NETWORKS
OAAI
NEURAL NETWORKSIF6.3
OAAI分享收藏Dynamically Weighted Balanced Loss: Class Imbalanced Learning and Confidence Calibration of Deep Neural Networks动态加权平衡损失: 深度神经网络的类不平衡学习和置信度校准
PREAI
分享收藏分享收藏
查看更多内容