.png){kind=icon}
返回
Validity and Transparency in Quantifying Open-Ended Data
.png){kind=icon}
OA
AI
DOI：10.1177/25152459241275217.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Quantitatively coding open-ended data (e.g., from videos, interviews) can be a rich source of information in psychological research, but reporting practices vary substantially. We provide strategies for improving validity and reliability of coding open-ended data and investigate questionable research practices in this area. First, we systematically examined articles in four top psychology journals (N = 956) and found that 21% included open-ended data coded by humans. However, only about one-third of those articles reported sufficient details to replicate or evaluate the validity of the coding process. Next, we propose multiphase guidelines for transparently reporting on the quantitative coding of open-ended data, informed by concerns with replicability, content validity, and statistical validity. The first phase involves research design, including selecting data and identifying units reliably. The second phase includes developing a coding manual and training coders. The final phase outlines how to establish reliability. As part of this phase, we used data simulations to examine a common statistic for testing reliability on open-ended data, Cohen's kappa, and found that it can become inflated when researchers repeatedly test interrater reliability or manipulate categories, such as by including a missing-data category. Finally, to facilitate transparent and valid coding of open-ended data, we provide a preregistration template that reflects these guidelines. All of the guidelines and resources provided in this article can be adapted for different types of studies, depending on context.
Keyword:
coding
data analysis
data coding
open science
psychology
social sciences
期刊
A
IF:
13.4
论文数:
324
被引数:
3.7K
机构
查看更多机构
引用论文
Template-Assembled Triple-Helical Peptide Molecules: Mimicry of Collagen by Molecular Architecture and Integrin-Specific Cell Adhesion.png)
Biochemistry
BiochemistryIF0
PREAI
分享收藏Thematic analysis of qualitative data: AMEE Guide No. 131定性数据专题分析: AMEE指南131号MEDICAL TEACHER
MEDICAL TEACHERIF4.4
PREAI
分享收藏
查看更多内容