arrow
返回

Learning from multiple inconsistent and dependent annotators to support classification tasks

delete2021-01-01
delete6
PRE
AI
J
Julián Gil-González *
Á
Álvaro A. Orozco
A
Andrés Marino Álvarez-Meza
DOI:10.1016/j.neucom.2020.10.045delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Training a supervised learning model requires a labeled dataset, where the labeling process is usually carried out by an expert to provide the ground truth/gold standard for each sample. However, in many applications, such a gold standard is not available. Instead, several real-world scenarios give us access to annotations provided by crowds, holding different and unknown levels of expertise. Thus, Learning from crowds is a subject undergoing intense study, and its main aim is to manage various machine learning paradigms in the presence of multiple annotators. Most of the state-of-the-art approaches reside on two key assumptions: i) the labeler's performance does not depend on the input feature space, and ii) independence among the annotators is imposed. Here, we introduce a localized kernel alignment based annotator relevance analysis (LKAAR) to code each labeler's expertise as the matching between the feature and label spaces. Namely, LKAAR takes into account inter-annotators dependencies and models labelers' knowledge as a function of the input feature space. Experimental results devoted to classification, show that LKAAR achieves suitable performances from inconsistent labelers, even if the gold standard is not available. (C) 2020 Elsevier B.V. All rights reserved.
Keyword:
Learning from crowds
Localized kernel alignment
Inconsistent annotators
Dependent labelers
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

U
universidad tecnologica de pereira
学者数:
868
论文数: 594
被引数: 0
U
Universidad Nacional de Colombia
学者数:
7.8K
论文数: 5.8K
被引数: 4.8K
引用论文

引用论文

err分享
err收藏
Learning from multiple annotators: Distinguishing good from random labelers
err2013-09-01
err86
errOAAI
errRodrigues, Filipe; Pereira, Francisco; Ribeiro, Bernardete
err分享
err收藏
Learning from multiple annotators using kernel alignment
err2018-12-01
err14
PREAI
errGil-Gonzalez, J.; Alvarez-Meza, A.; Orozco-Gutierrez, A.
err分享
err收藏
Serbian heavy clays behavior: Application in rough ceramics
err2013-01-01
err0
errOAAI
errMilica Arsenovic; Lato Pezo; Zagorka Radojevic; Slavka Stankovic
err分享
err收藏
Learning from multiple annotators with varying expertise
err2013-10-19
err129
errOAAI
errYan, Yan; Rosales, Romer; Fung, Glenn; Subramanian, Ramanathan; Dy, Jennifer
err分享
err收藏
Learning from crowds with variational Gaussian processes
err2019-04-01
err33
errOAAI
errRuiz, Pablo; Morales-Alvarez, Pablo; Molina, Rafael; Katsaggelos, Aggelos K.
err分享
err收藏
Unsupervised Bayesian Inference to Fuse Biosignal Sensory Estimates for Personalizing Care
err2019-01-01
err10
errOAAI
errZhu, Tingting; Pimentel, Marco A. F.; Clifford, Gari D.; Clifton, David A.
err分享
err收藏
学者 查看更多内容