arrow
Return

Sample-Size Planning in Item-Response Theory: A Tutorial

delete2025-02-24
delete0
delete
OA
AI
U
Ulrich Schroeders
T
Timo Gnambs
DOI:10.1177/25152459251314798delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Although item-response-theory (IRT) models offer well-established psychometric advantages over traditional scoring methods, they remain underused in practice. Following a brief introduction to the IRT framework, we emphasize its major advantages and explore potential applications in various research areas. The main part of this tutorial provides a comprehensive, step-by-step guide to Monte Carlo simulation-based sample-size estimation in IRT, which is essential for obtaining precise estimates of item and person parameters, structural effects, and model fit. Accurate a priori sample-size estimation is also crucial for effective study planning, especially in preregistration and registered reports. We highlight 10 key decisions, organized into four areas: (a) determining the data-generation model, (b) defining the test design and the process of missing values, (c) selecting the IRT model and parameters of interest, and (d) setting up and running the Monte Carlo simulation. The procedure is illustrated with examples from educational, personality, and clinical psychology. An extensively annotated and easily customizable syntax is available in an online repository.
Keywords:
item-response theory
sample-size estimation
study planning
reproducibility
open data
open materials

Journal

A
Advances in Methods and Practices in Psychological Science
IF:
13.4
Papers:
311
Citations:
3.7K

Organization

U
Universitat Kassel
Scholars:
4.0K
Papers: 3.5K
Citations: 39
L
Leibniz Inst Educ Trajectories
Scholars:
4
Papers: 4
Citations: 1