.png){kind=icon}
返回
Curricular-balanced long-tailed learning
.png){kind=icon}
PRE
AI
DOI：10.1016/j.neucom.2023.127121.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The real-world data distribution is essentially long-tailed, which poses a significant challenge to the deep model. Classification models minimizing cross-entropy loss struggle to classify the tail classes, although cross-entropy training is successful on balanced data. We reveal that minimizing cross-entropy loss under long-tailed distribution leads to the Tail Collapse phenomenon, which fundamentally limits the performance of neural networks. To correct the optimization behavior of cross-entropy training, we propose a new Curricular Balanced Loss (CurB Loss) to alleviate the imbalance. The CurB loss has two factors: the re-weighting factor and the curriculum learning factor. We design the re-weighting factor based on the margin-based training that can theoretically reach the optimums of networks. Then, we incorporate the idea of Curriculum Learning into the re-weighting loss in an adaptive manner. We design the curriculum learning factor to make the model gradually emphasize the hard classes. The empirical results demonstrate the complementary of the two factors. Our method outperforms previous state-of-the-art methods by 0.9%, 2.7%, 1.2% on CIFAR10-LT, CIFAR-100-LT and ImageNet-LT, demonstrating the effectiveness of CurB Loss for long-tailed visual recognition.
Keyword:
Long-tailed learning
Re-weighting loss
Curriculum learning
期刊
IF:
6.5
论文数:
2.5W
被引数:
6.5W
机构
引用论文
分享收藏分享收藏A GEOGRAPHIC WEIGHTED REGRESSION FOR RURAL HIGHWAYS CRASHES MODELLING USING THE GAUSSIAN AND TRICUBE KERNELS: A CASE STUDY OF USA RURAL HIGHWAYS.png)
The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
OAAI
The International Archives of the Photogrammetry, Remote Sensing and Spatial Information SciencesIF0
OAAI分享收藏
查看更多内容