arrow
Return

Robust learning from noisy web data for fine-Grained recognition

delete2023-02-01
delete9
PRE
AI
Z
Zhenhuang Cai
G
Guo-Sen Xie
黄兴国 (Xingguo Huang)
D
Dan Huang
Y
Yazhou Yao *
Z
Zhenmin Tang
DOI:10.1016/j.patcog.2022.109063delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Due to DNNs' memorization effect, label noise lessens the performance of the web-supervised fine-grained visual categorization task. Previous literature primarily relies on small-loss instances for sub-sequent training. The current state-of-the-art approach JoCoR additionally employs explicit consistency constraints to make clean samples more confident. However, a joint loss designed for both sample selec-tion criteria and parameter updating is not competent for training a robust model in the presence of web noise. Especially, false positives are assigned with larger weights, causing the model to pay more attention to misclassified noisy images. Besides, leveraging weight decay to forget discarded noisy instances is too slow and implicit to take effect. Therefore, we propose a simple yet effective approach named MS-DeJOR (Multi-Scale training with Decoupled Joint Optimization and Refurbishment). In contrast to JoCoR, we decouple sample selection from training procedure to handle the above problems. Specifically, a negative entropy term is applied to prevent false positives from being overemphasized. The model can explicitly forget those samples identified as noise by imposing such a regularization term on all training data. Fur-thermore, we use accumulated predictions to refurbish the noisy labels and re-weight training images to boost the model performance. A multi-scale feature enhancement module is adopted to extract discrimi-native and subtle feature representations. Extensive experiments show that MS-DeJOR yields state-of-the-art performances on three web-supervised fine-grained datasets, demonstrating the effectiveness of our approach. The data and source code have been available at https://github.com/msdejor/MS-DeJOR .(c) 2022 Elsevier Ltd. All rights reserved.
Keywords:
Fine-grained
Web-supervised
Noisy web data
Robust learning

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

B
beijing institute of technology
Scholars:
5.4W
Papers: 4.0W
Citations: 63
J
Jilin University
Scholars:
8.6W
Papers: 5.5W
Citations: 8.9K