Dynamic Auxiliary Soft Labels for decoupled learning

Yan Wang

doi:10.1016/j.neunet.2022.03.027

Dynamic Auxiliary Soft Labels for decoupled learning

2022-07-01

3

PRE

AI

DOI：10.1016/j.neunet.2022.03.027

原文链接

原文求助

摘要

En 中文

The long-tailed distribution in the dataset is one of the major challenges of deep learning. Convolutional Neural Networks have poor performance in identifying classes with only a few samples. For this problem, it has been proved that separating the feature learning stage and the classifier learning stage improves the performance of models effectively, which is called decoupled learning. We use soft labels to improve the performance of the decoupled learning framework by proposing a Dynamic Auxiliary Soft Labels (DaSL) method. Specifically, we design a dedicated auxiliary network to generate auxiliary soft labels for the two different training stages. In the feature learning stage, it helps to learn features with smaller variance within the class, and in the classifier learning stage it helps to alleviate the overconfidence of the model prediction. We also introduce a feature-level distillation method for the feature learning, and improve the learning of general features through multi-scale feature fusion. We conduct extensive experiments on three long-tailed recognition benchmark datasets to demonstrate the effectiveness of our DaSL.(C) 2022 Elsevier Ltd. All rights reserved.

Keyword:

Neural network

Decoupled learning

Long-tailed

Dynamic Auxiliary Soft Labels for decoupled learning

摘要

期刊

机构

引用论文