arrow
Return

Collaborative learning with corrupted labels

delete2020-05-01
delete3
PRE
AI
Y
Yulin Wang
R
Rui Huang
G
Gao Huang *
宋
宋士吉 (Shiji Song)
吴
吴澄 (Cheng Wu)
DOI:10.1016/j.neunet.2020.02.010delete
deleteOriginal
deleteShare
deleteSave
Abstract

Abstract

En 中文
Deep neural networks (DNNs) have been very successful for supervised learning. However, their high generalization performance often comes with the high cost of annotating data manually. Collecting low-quality labeled dataset is relatively cheap, e.g., using web search engines, while DNNs tend to overfit to corrupted labels easily. In this paper, we propose a collaborative learning (co-learning) approach to improve the robustness and generalization performance of DNNs on datasets with corrupted labels. This is achieved by designing a deep network with two separate branches, coupled with a relabeling mechanism. Co-learning could safely recover the true labels of most mislabeled samples, not only preventing the model from overfitting the noise, but also exploiting useful information from all the samples. Although being very simple, the proposed algorithm is able to achieve high generalization performance even a large portion of the labels are corrupted. Experiments show that co-learning consistently outperforms existing state-of-the-art methods on three widely used benchmark datasets. (c) 2020 Elsevier Ltd. All rights reserved.
Keywords:
Deep neural networks
Corrupted labels
Robustness

Journal

Neural Networks cover
Neural Networks
IF:
6.3
Papers:
8.3K
Citations:
3.0W

Organization

T
Tsinghua University
Scholars:
8.7K
Papers: 3.0K
Citations: 0
Cited Papers

Cited Papers

Deep learning in neural networks: An overview
err2015-01-01
err1.3W
errOAAI
errSchmidhuber, Juergen
errShare
errSave
Active learning for noisy oracle via density power divergence
err2013-10-01
err5
PREAI
errSogawa, Yasuhiro; Ueno, Tsuyoshi; Kawahara, Yoshinobu; Washio, Takashi
errShare
errSave
errShare
errSave
The use of facial motion and facial form during the processing of identity
err2003-08-01
err0
PREAI
errBarbara Knappmeyer; Ian M Thornton; Heinrich H Bülthoff
errShare
errSave
Use of sodium aurothiomalate during lactation.
err2012-07-26
err0
errOAAI
errPN Bennett; SJ Humphries; JP Osborne; AK Clarke; A Taylor
errShare
errSave
ICT for informal workers in Sub-Saharan Africa: Systematic review and analysis
err2017-09-01
err0
PREAI
errNasibu Mramba; Joel Rumanyika; Mikko Apiola; Jarkko Suhonen
errShare
errSave
researcher View more