arrow
返回

Crowdsourced Label Aggregation Using Bilayer Collaborative Clustering

delete2019-10-01
delete28
PRE
AI
张静 封面图
张静 (Jing Zhang) *
V
Victor S. Sheng
J
Jian Wu
DOI:10.1109/TNNLS.2018.2890148delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
With online crowdsourcing platforms, labels can be acquired at relatively low costs from massive nonexpert workers. To improve the quality of labels obtained from these imperfect crowdsourced workers, we usually let different workers provide labels for the same instance. Then, the true labels for all instances are estimated from these multiple noisy labels. This traditional general-purpose label aggregation process, solely relying on the collected noisy labels, cannot significantly improve the accuracy of integrated labels under a low labeling quality circumstance. This paper proposes a novel bilayer collaborative clustering (BLCC) method for the label aggregation in crowd-sourcing. BLCC first generates the conceptual-level features for the instances from their multiple noisy labels and infers the initially integrated labels by performing clustering on the conceptual-level features. Then, it performs another clustering on the physical-level features to form the estimations of the true labels on the physical layer. The clustering results on both layers can facilitate in tracking the changes in the uncertainties of the instances. Finally, the initially integrated labels that are likely to be wrongly inferred on the conceptual layer can be addressed using the estimated labels on the physical layer. The clustering processes on both layers can keep providing guidance information for each other in the multiple label remedy rounds. The experimental results on 12 real-world crowdsourcing data sets show that the performance of the proposed method in terms of accuracy is better than that of the state-of-the-art methods.
Keyword:
Clustering
crowdsourcing
label aggregation
label noise handling
truth inference
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.6K
被引数:
7.2W

机构

University of Central Arkansas 封面图
University of Central Arkansas
学者数:
469
论文数: 392
被引数: 284
引用论文

引用论文

Effect of Temperature on Physico-Mechanical Properties of Chunar Sandstone, Mirzapur, U.P., India
err2023-07-05
err0
PREAI
errAnand Singh; A. K. Verma; Abhinav Kumar; C. S. Singh; Sanjay Kr. Roy
err分享
err收藏
err分享
err收藏
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容