返回
Inter-Coder Agreement for Computational Linguistics
DOI:10.1162/coli.07-034-R2.png)
摘要
En 中文
This article is a survey of methods for measuring agreement among corpus annotators. It exposes the mathematics and underlying assumptions of agreement coefficients, covering Krippendorff's alpha as well as Scott's pi and Cohen's kappa; discusses the use of coefficients in several annotation tasks; and argues that weighted, alpha-like coefficients, traditionally less used than kappa-like measures in computational linguistics, may be more appropriate for many corpus annotation tasks-but that their use makes the interpretation of the value of the coefficient even harder.
Keyword:
LOW KAPPA
RELIABILITY
TEXT
DISCOURSE
期刊
IF:
5.3
论文数:
837
被引数:
2.7K
机构
引用论文
Development and assessment of an academic performance enrichment program for low-performing, first-year pharmacy students针对低表现、药学专业一年级学生的学业成绩提升计划的开发与评估
The influence of various precursors on solar-light-driven g-C3N4 synthesis and its effect on photocatalytic tetracycline hydrochloride (TCH) degradation各种前体对太阳光驱动的g-C3N4合成及其对光催化盐酸四环素 (TCH) 降解的影响

