arrow
返回

Learning from crowdsourced labeled data: a survey

delete2016-07-02
delete173
PRE
AI
张静 封面图
张静 (Jing Zhang) *
W
Wu, Xindong
S
Sheng, Victor S.
DOI:10.1007/s10462-016-9491-9delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
With the rapid growing of crowdsourcing systems, quite a few applications based on a supervised learning paradigm can easily obtain massive labeled data at a relatively low cost. However, due to the variable uncertainty of crowdsourced labelers, learning procedures face great challenges. Thus, improving the qualities of labels and learning models plays a key role in learning from the crowdsourced labeled data. In this survey, we first introduce the basic concepts of the qualities of labels and learning models. Then, by reviewing recently proposed models and algorithms on ground truth inference and learning models, we analyze connections and distinctions among these techniques as well as clarify the level of the progress of related researches. In order to facilitate the studies in this field, we also introduce open accessible real-world data sets collected from crowdsourcing systems and open source libraries and tools. Finally, some potential issues for future studies are discussed.
Keyword:
Crowdsourcing
Learning from crowds
Multiple noisy labeling
Label quality
Learning model quality
Ground truth inference
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Artificial Intelligence Review 封面图
Artificial Intelligence Review
IF:
13.9
论文数:
6.1K
被引数:
1.9W

机构

H
hefei university of technology
学者数:
2.5W
论文数: 1.7W
被引数: 35
University of Central Arkansas 封面图
University of Central Arkansas
学者数:
469
论文数: 392
被引数: 284
引用论文

引用论文

Learning from multiple annotators: Distinguishing good from random labelers
err2013-09-01
err86
errOAAI
errRodrigues, Filipe; Pereira, Francisco; Ribeiro, Bernardete
err分享
err收藏
Incremental learning for ν-Support Vector RegressionΝ-支持向量回归的增量学习
err2015-07-01
err432
PREAI
errGu, Bin; Sheng, Victor S.; Wang, Zhijie; Ho, Derek; Osman, Said; Li, Shuo
err分享
err收藏
Imine-linked micron-network polymers with high polyethylene glycol uptake for shaped-stabilized phase change materials
err2016-01-01
err0
PREAI
errJia Tang; Shuang Fan; Wenjun Dong; Jingjing Wang; Hongyi Gao; Mu Yang; Ming Yang; Ge Wang
err分享
err收藏
err分享
err收藏
学者 查看更多内容