arrow
Return

COMIRE: A Consistence-Based Mislabeled Instances Removal Method

delete2023-06-01
delete2
PRE
AI
X
Xiaokun Pu
李春光 (Chunguang Li) *
沈会良 (Hui‐Liang Shen)
DOI:10.1109/TNNLS.2021.3111871delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Training neural network classifiers (NNCs) usually requires all instances to be correctly labeled, which is difficult and/or expensive to satisfy in some practical applications. When label noise is present, mislabeled data will severely mislead the training of NNCs, resulting in poor generalization performance. In this work, we address the label noise issue by removing mislabeled instances from the training data. A COnsistence-based Mislabeled Instances REmoval (COMIRE) method is proposed. The main idea is based on the observation that during the training of the NNC, the training loss and the model's prediction uncertainty of correctly labeled instances show similar trends, while those of mislabeled instances have quite different trends. Thus, the consistency between the two trends can be used to distinguish correctly labeled instances from mislabeled ones. On this basis, an iteration scheme is introduced to further increase the separability between the two types of data. Experimental results show that COMIRE can effectively identify the mislabeled instances. Moreover, the classification performance is significantly improved after removing the identified instances from the noisy training data.
Keywords:
Training
Artificial neural networks
Market research
Uncertainty
Noise measurement
Data models
Training data
Consistence
label noise
neural network classifier (NNC)
noise identification

Journal

IEEE Transactions on Neural Networks and Learning Systems cover
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
Papers:
7.5K
Citations:
7.2W

Organization

Z
zhejiang university
Scholars:
17.5W
Papers: 12.0W
Citations: 152