.png){kind=icon}
返回
Multi-Label Truth Inference for Crowdsourcing Using Mixture Models
.png){kind=icon}
PRE
AI
DOI：10.1109/TKDE.2019.2951668.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
When acquiring labels from crowdsourcing platforms, a task may be designed to include multiple labels and the values of each label may belong to a set of various distinct options, which is the so-called multi-class multi-label annotation. To improve the quality of labels, requesters usually let one task be independently completed by a group of heterogeneous crowdsourced workers. Then, the true values of the multiple labels of each task are inferred from these repeated noisy labels. In this paper, we propose two novel probabilistic models MCMLI and MCMLD to address the multi-class multi-label inference problem in crowdsourcing. MCMLI assumes that the labels of each task are mutually independent and MCMLD utilizes a mixture of multiple independently multinoulli distributions to capture the correlation among the labels. Both models can jointly infer multiple true labels of each instance as well as estimate the reliability of crowdsourced workers modeled by a set of confusion matrices with an expectation-maximization algorithm. Experiments with three typical crowdsourcing scenarios and a real-world dataset show that our proposed models significantly outperform existing competitive alternatives. When the labels are strongly correlated, MCMLD substantially outperforms MCMLI. Furthermore, our models can be easily simplified to the one-coin models, which show more advantageous when errors are uniformly distributed, or labels are sparse.
Keyword:
Crowdsourcing
Probabilistic logic
Correlation
Task analysis
Reliability
Inference algorithms
Hidden Markov models
Crowdsourcing
maximum likelihood estimation
mixture models
probabilistic graphical models
statistical inference
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
10.4
论文数:
6.8K
被引数:
3.2W
机构
引用论文
分享收藏EFFECT OF TESTOSTERONE ON PROTEIN SYNTHESIS AND CONTRACTILITY OF THE LEVATOR ANI MUSCLE OF THE RAT
PREAI
分享收藏Recycled-Oil-Based Polyurethane Modified with Organic Silicone for Controllable Release of Coated Fertilizer有机硅改性再生油基聚氨酯用于包膜肥料的可控释放.png)
Polymers
OAAI
PolymersIF0
OAAI分享收藏分享收藏
查看更多内容