.png){kind=icon}
Return
An instance-dependent simulation framework for learning with label noise
.png){kind=icon}
OA
AI
DOI：10.1007/s10994-022-06207-7.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
We propose a simulation framework for generating instance-dependent noisy labels via a pseudo-labeling paradigm. We show that the distribution of the synthetic noisy labels generated with our framework is closer to human labels compared to independent and class-conditional random flipping. Equipped with controllable label noise, we study the negative impact of noisy labels across a few practical settings to understand when label noise is more problematic. We also benchmark several existing algorithms for learning with noisy labels and compare their behavior on our synthetic datasets and on the datasets with independent random label noise. Additionally, with the availability of annotator information from our simulation framework, we propose a new technique, Label Quality Model (LQM), that leverages annotator features to predict and correct against noisy labels. We show that by adding LQM as a label correction step before applying existing noisy label techniques, we can further improve the models' performance. The synthetic datasets that we generated in this work are released at https://github.com/deepmind/deepmind-research/tree/master/noisy_label.
Keywords:
Noisy labels
Simulation
Datasets
Rater features
Journal
IF:
2.9
Papers:
2.7K
Citations:
3.4W
Organization
Cited Papers
ShareSaveShareSaveExperimental Background to the Study of the Distribution and Abundance of Insects: II. The Relation Between Innate Capacity for Increase in Numbers and the Abundance of Three Grain Beetles in Experimental Populations.png)
Ecology
EcologyIF0
PREAI
ShareSaveShareSave
View more