arrow
Return

Weighted Kappa for Interobserver Agreement and Missing Data

delete2025-02-14
delete0
delete
OA
AI
M
Matthijs J. Warrens *
A
Alexandra de Raadt
R
Roel Bosker
H
Henk A. L. Kiers
DOI:10.3390/make7010018delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
The weighted kappa coefficient is commonly used for assessing agreement between two raters on an ordinal scale. This study is the first to assess the impact of missing data on the value of weighted kappa. We compared three methods for handling missing data in a simulation study: predictive mean matching, listwise deletion and a weighted version of Gwet's kappa. We compared their performances under three missing data mechanisms, using agreement tables with various numbers of categories and different values of weighted kappa. Predictive mean matching outperformed the other two methods in most simulated cases in terms of root mean squared error and in all cases in terms of bias.
Keywords:
ordinal ratings
inter-rater reliability
weighted kappa
missing data
listwise deletion
predictive mean matching
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

M
Machine Learning and Knowledge Extraction
IF:
6
Papers:
809
Citations:
1.8K

Organization

U
University of Groningen
Scholars:
4.4W
Papers: 4.3W
Citations: 5.9W