arrow
Return

Meta-Analytic Criterion Profile Analysis

delete2021-04-01
delete12
PRE
AI
B
Brenton M. Wiernik *
M
Michael P. Wilmot
M
Mark L. Davison
D
Deniz S. Öneş
DOI:10.1037/met0000305delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Intraindividual patterns or configurations are intuitive explanations for phenomena, and popular in both lay and research contexts. Criterion profile analysis (CPA; Davison & Davenport, 2002) is a well-established, regression-based pattern matching procedure that identifies a pattern of predictors that optimally relate to a criterion of interest and quantifies the strength of that association. Existing CPA methods require individual-level data, limiting opportunities for reanalysis of published work, including research synthesis via meta-analysis and associated corrections for psychometric artifacts. In this article, we develop methods for meta-analytic criterion profile analysis (MACPA), including new methods for estimating cross-validity and fungibility of criterion patterns. We also review key methodological considerations for applying MACPA, including homogeneity of studies in meta-analyses, corrections for statistical artifacts, and second-order sampling error. Finally, we present example applications of MACPA to published meta-analyses from organizational, educational, personality, and clinical psychological literatures. R code implementing these methods is provided in the configural package, available at https://cran.r-project.org/package=configural and at https://doi.org/10.17605/osf.io/aqmpc. Translational Abstract Patterns or configurations of predictors are popular ways for researchers and science consumers to understand phenomena. Criterion profile analysis (CPA; Davison & Davenport, 2002) is a regression-based pattern matching procedure that identifies patterns of predictors that are maximally related to a criterion of interest. This technique allows researchers to consider a new perspective on the relationship between a set of predictors and a criterion-that the criterion is associated most with a specific pattern or configuration of predictors. Existing CPA methods require individual-level data, limiting opportunities for research synthesis via meta-analysis or reanalysis of published research. In this article, we develop methods for meta-analytic criterion profile analysis (MACPA), including new methods for estimating cross-validation performance and sensitivity analyses. We also review methodological considerations and caveats for MACPA, including homogeneity of studies in meta-analyses, correction for statistical artifacts, and second-order sampling error. Finally, we present example applications of MACPA to published meta-analyses from organizational, educational, personality, and clinical psychological literatures. R code implementing these methods is provided. Application of MACPA in both new meta-analyses and reanalysis of existing correlational research can open new avenues of inquiry into the potential mechanisms driving important outcomes in psychological research.
Keywords:
criterion profile analysis
meta-analysis
configural
pattern analysis
fungible regression weights

Journal

Psychological Methods cover
Psychological Methods
IF:
7.8
Papers:
1.3K
Citations:
2.1W

Organization

State University System of Florida cover
State University System of Florida
Scholars:
12.7W
Papers: 10.9W
Citations: 130
U
university of south florida
Scholars:
1.5W
Papers: 1.2W
Citations: 9
U
University of Arkansas System
Scholars:
1.9W
Papers: 1.5W
Citations: 295
U
university of arkansas fayetteville
Scholars:
5.2K
Papers: 4.5K
Citations: 2
researcher View more organizations