.png){kind=icon}
返回
Optimizing microtask assignment on crowdsourcing platforms using Markov chain Monte Carlo
.png){kind=icon}
PRE
AI
DOI：10.1016/j.dss.2020.113404.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Microtasking is a type of crowdsourcing, denoting the act of breaking a job into several tasks and allocating them to multiple workers to complete. The assignment of tasks to workers is a complex decision-making process, particularly when considering budget and quality constraints. While there is a growing body of knowledge on the development of task assignment algorithms, the current algorithms suffer from shortcomings including: after worker quality estimation, meaning that workers need to complete all tasks after which point their quality can be estimated; and one-off quality estimation method which estimates workers' quality only at the start of micro tasking using a set of pre-defined quality-control tasks. To address these shortcomings, we propose a Markov Chain Monte Carlo-based task assignment approach known as MCMC-TA which provides iterative estimations of workers' quality and dynamic task assignment. Specifically, we apply Gaussian mixture model (GMM) to estimate workers' quality and Markov Chain Monte Carlo to shortlist workers for task assignment. We use Google Fact Evaluation dataset to measure the performance of MCMC-TA and compare it against the state-of-the-art algorithms in terms of AUC and F-Score. The results show that the proposed MCMC-TA algorithm not only outperforms the rival algorithms, but also offers a spammer-resistant result that maximizes the learning of workers' quality with minimal budget.
Keyword:
Crowdsourcing
Task assignment
Markov chain
Crowd labeling
Quality estimation
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
6.8
论文数:
3.8K
被引数:
1.5W
机构
引用论文
.png){kind=icon}
A Joint Gaussian Process Model for Active Visual Recognition with Expertise Estimation in Crowdsourcing面向众包的主动视觉识别与专业知识估计的联合高斯过程模型
OAAI
OAAI分享收藏
查看更多内容