arrow
返回

Machine Learning From Crowds Using Candidate Set-Based Labeling

delete2022-11-01
delete0
delete
OA
AI
I
Iker Beñaran-Muñoz *
J
Jerónimo Hernández-González
A
Aritz Pérez
DOI:10.1109/MIS.2022.3205053delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Crowdsourcing is a popular and cheap alternative in machine learning for gathering information from a set of annotators. Learning from crowd-labeled data involves dealing with its inherent uncertainty and inconsistencies. In the classical framework, each annotator provides a single label per example, which fails to capture the complete knowledge of annotators. We propose candidate labeling, that is, to allow annotators to provide a set of candidate labels for each example and thus express their doubts. We propose an appropriate model for the annotators, and present two novel learning methods that deal with the two basic steps (label aggregation and model learning) sequentially or jointly. Our empirical study shows the advantage of candidate labeling and the proposed methods with respect to the classical framework.
Keyword:
Labeling
Reliability
Uncertainty
Intelligent systems
Task analysis
Computational modeling
Aggregates

期刊

IEEE Intelligent Systems 封面图
IEEE Intelligent Systems
IF:
6.1
论文数:
1.6K
被引数:
4.5K

机构

U
university of barcelona
学者数:
6.1W
论文数: 4.5W
被引数: 74
引用论文

引用论文

Quantitative assessment of Gd-DTPA contrast agent from signal enhancement: an in-vitro study
err2003-07-01
err0
PREAI
errJ. Mørkenborg; M. Pedersen; F.T. Jensen; H. Stødkilde-Jørgensen; J.C. Djurhuus; J. Frøkiær
err分享
err收藏
Early Detection for Li-Ion Batteries Thermal Runaway Based on Gas Sensing
err2019-05-01
err0
PREAI
errTing Cai; Anna G Stefanopoulou; Jason B Siegel
err分享
err收藏
err分享
err收藏
2D Hemiporphyrazine: A new nanoporous material
err2023-06-01
err0
errOAAI
errR.M. Tromer; M.L. Pereira; L.A. Ribeiro; D.S. Galvão
err分享
err收藏
学者 查看更多内容