.png){kind=icon}
返回
A Generative Answer Aggregation Model for Sentence-Level Crowdsourcing Tasks
.png){kind=icon}
PRE
AI
DOI：10.1109/TKDE.2022.3142821.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Previous answer aggregation methods for sentence-level crowdsourcing tasks extract one sentence from a collection of redundant sentences. However, these extractive methods have a drawback in that they ignore the phenomenon of answer complementarity and the spammer dilemma in crowdsourcing. To alleviate this problem, in this paper, we generate new, comprehensive sentences that synthesize all redundant sentences. To achieve this goal, we design a sequence-to-sequence neural model composed of an encoder and decoder. Specifically, considering the complementarity phenomenon, the encoder synthesizes all the collected sentences into hidden states, which are then utilized by the decoder to generate the final sentence. Next, considering the spammer dilemma, we model the workers in the neural network to detect spammers. Furthermore, to train the neural model better, we construct pseudo-sentences to enrich the training data. The experimental results demonstrate that our method can efficiently aggregate redundant sentences and generate comprehensive sentences with increased quality.
Keyword:
Task analysis
Decoding
Crowdsourcing
Transformers
Satellites
Feeds
Training
answer aggregation
sentence-level task
期刊
IF:
10.4
论文数:
6.8K
被引数:
3.2W
机构
引用论文
Eggs sunny-side up: A new species of Olea, an unusual oophagous sea slug (Gastropoda: Heterobranchia: Sacoglossa), from the western Atlantic.png)
Zootaxa
ZootaxaIF0
PREAI
分享收藏Solution structure of the Lewis x oligosaccharide determined by NMR spectroscopy and molecular dynamics simulationsBiochemistry
BiochemistryIF0
PREAI
分享收藏分享收藏Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations视觉基因组: 使用众包密集图像注释连接语言和视觉
OAAI
OAAI分享收藏分享收藏分享收藏
查看更多内容