.png){kind=icon}
返回
DLTA: A Framework for Dynamic Crowdsourcing Classification Tasks
.png){kind=icon}
PRE
AI
DOI：10.1109/TKDE.2018.2849385.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The increasing popularity of crowdsourcing markets enables the application of crowdsourcing classification tasks. How to conduct quality control in such an application to achieve accurate classification results from noisy workers is an important and challenging task, and has drawn broad research interests. However, most existing works do not exploit the label acquisition phase, which results in their disability of making a proper budget allocation. Moreover, some works impractically make the assumption of managing workers, which is not supported by common crowdsourcing platforms such as AMT or CrowdFlower. To overcome these drawbacks, in this paper, we devise a Dynamic Label Acquisition and Answer Aggregation (DLTA) framework for crowdsourcing classification tasks. The framework proceeds in a sequence of rounds, adaptively conducting label inference and label acquisition. In each round, it analyzes the collected answers of previous rounds to perform proper budget allocation, and then issues the resultant query to the crowd. To support DLTA, we propose a generative model for the collection of labels, and correspondingly strategies for label inference and budget allocation. Experimental results show that compared with existing methods, DLTA obtains competitive accuracy in the binary case. Besides, its extended version, which plugs in the state-of-the-art inference technique, achieves the highest accuracy.
Keyword:
Classification crowdsourcing
quality control
label inference
label acquisition
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
10.4
论文数:
6.8K
被引数:
3.2W
机构
暂无机构信息
引用论文
.png){kind=icon}
Physicochemical Properties of ZnSO4−H2SO4−H2O Electrolytes of Relevance to Zinc ElectrowinningZnSO4-h 2SO4-h 2O与锌电积相关电解质的理化性质
PREAI
分享收藏EFFECT OF TESTOSTERONE ON PROTEIN SYNTHESIS AND CONTRACTILITY OF THE LEVATOR ANI MUSCLE OF THE RAT
PREAI
分享收藏Crystal chemistry and metal-hydrogen bonding in anisotropic and interstitial hydrides of intermetallics of rare earth (R) and transition metals (T), RT3 and R2T7稀土 (R) 和过渡金属 (T) 的金属间化合物的各向异性和间隙氢化物中的晶体化学和金属氢键，RT3 和R2T7
PREAI
分享收藏分享收藏
查看更多内容