1
Return

A Tutorial on Using Generative Models to Advance Psychological Science: Lessons From the Reliability Paradox

delete2025-04-14
delete2
delete
OA
AI
N
Nathaniel Haines
P
Peter D. Kvam
L
Louis Horowitz Irving
C
Colin Tucker Smith
T
Theodore P. Beauchaine
M
Mark A. Pitt
W
Woo‐Young Ahn
B
Brandon M. Turner
DOI:10.1037/met0000674delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Theories of individual differences are foundational to psychological and brain sciences, yet they are traditionally developed and tested using superficial summaries of data (e.g., mean response times) that are disconnected from our otherwise rich conceptual theories of behavior. To resolve this theory-description gap, we review the generative modeling approach, which involves formally specifying how behavior is generated within individuals, and in turn how generative mechanisms vary across individuals. Generative modeling shifts our focus away from estimating descriptive statistical effects toward estimating psychologically interpretable parameters, while simultaneously enhancing the reliability and validity of our measures. We demonstrate the utility of generative modeling in the context of the reliability paradox, a phenomenon wherein replicable group effects (e.g., Stroop effect) fail to capture individual differences (e.g., low test-retest reliability). Simulations and empirical data from the Implicit Association Test and Stroop, Flanker, Posner, and delay discounting tasks show that generative models yield (a) more theoretically informative parameters, and (b) higher test-retest reliability estimates relative to traditional approaches, illustrating their potential for enhancing theory development.
Keywords:
Bayesian analysis
individual differences
generative modeling
measurement error
reliability

Journal

Psychological Methods cover
Psychological Methods
IF:
7.8
Papers:
1.3K
Citations:
2.1W

Organization

U
Univ Florida
Scholars:
2.8K
Papers: 2.0K
Citations: 556
S
Seoul Natl Univ
Scholars:
4.1K
Papers: 1.9K
Citations: 590
 
 ohio state university
Scholars:
3.9K
Papers: 2.6K
Citations: 5
U
Univ Notre Dame
Scholars:
576
Papers: 324
Citations: 106
Cited Papers

Cited Papers

Citing Papers

Citing Papers