arrow
返回

Deep Learning From Multiple Noisy Annotators as A Union

delete2023-12-01
delete12
PRE
AI
H
Hongxin Wei
R
Renchunzi Xie
L
Lei Feng *
B
Bo Han
B
Bo An
DOI:10.1109/TNNLS.2022.3168696delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Crowdsourcing is a popular solution for large-scale data annotations. So far, various end-to-end deep learning methods have been proposed to improve the practical performance of learning from crowds. Despite their practical effectiveness, most of them have two major limitations--they do not hold learning consistency and suffer from computational inefficiency. In this article, we propose a novel method named UnionNet, which is not only theoretically consistent but also experimentally effective and efficient. Specifically, unlike existing methods that either fit a given label from each annotator independently or fuse all the labels into a reliable one, we concatenate the one-hot encoded vectors of crowdsourced labels provided by all the annotators, which takes all the labeling information as a union and coordinates multiple annotators. In this way, we can directly train an end-to-end deep neural network by maximizing the likelihood of this union with only a parametric transition matrix. We theoretically prove the learning consistency and experimentally show the effectiveness and efficiency of our proposed method.
Keyword:
Training
Deep learning
Labeling
Noise measurement
Neural networks
Standards
Learning systems
Annotators
crowdsourcing
noisy labels
transition matrix

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.6K
被引数:
7.2W

机构

C
Chongqing University
学者数:
5.1W
论文数: 4.1W
被引数: 6.0W
H
Hong Kong Baptist University
学者数:
6.3K
论文数: 7.5K
被引数: 1.3W
N
Nanyang Technological University
学者数:
4.9W
论文数: 4.8W
被引数: 8.1W
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
Learning from multiple annotators: Distinguishing good from random labelers
err2013-09-01
err86
errOAAI
errRodrigues, Filipe; Pereira, Francisco; Ribeiro, Bernardete
err分享
err收藏
err分享
err收藏
Effect of Moisture Stress on the Resistance of HfO2/TaOx-Based 8-Layer 3D Vertical Resistive Random Access Memory
err2020-01-01
err0
PREAI
errRui Gao; Dengyun Lei; Zhiyuan He; Yiqiang Chen; Yun Huang; Yunfei En; Xiaoxin Xu; Feng Zhang
err分享
err收藏
Quantitative assessment of Gd-DTPA contrast agent from signal enhancement: an in-vitro study
err2003-07-01
err0
PREAI
errJ. Mørkenborg; M. Pedersen; F.T. Jensen; H. Stødkilde-Jørgensen; J.C. Djurhuus; J. Frøkiær
err分享
err收藏
Deep-LIFT: Deep Label-Specific Feature Learning for Image AnnotationDeep-LIFT: 用于图像标注的深度标签特定特征学习
err2022-08-01
err35
PREAI
errLi, Junbing; Zhang, Changqing; Zhou, Joey Tianyi; Fu, Huazhu; Xia, Shuyin; Hu, Qinghua
err分享
err收藏
学者 查看更多内容