arrow
Return

Statistical Analyses for Studying Replication: Meta-Analytic Perspectives

delete2019-10-01
delete56
delete
OA
AI
L
Larry V. Hedges *
J
Jacob M. Schauer
DOI:10.1037/met0000189delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Formal empirical assessments of replication have recently become more prominent in several areas of science, including psychology. These assessments have used different statistical approaches to determine if a finding has been replicated. The purpose of this article is to provide several alternative conceptual frameworks that lead to different statistical analyses to test hypotheses about replication. All of these analyses are based on statistical methods used in meta-analysis. The differences among the methods described involve whether the burden of proof is placed on replication or nonreplication, whether replication is exact or allows for a small amount of negligible heterogeneity, and whether the studies observed are assumed to be fixed (constituting the entire body of relevant evidence) or are a sample from a universe of possibly relevant studies. The statistical power of each of these tests is computed and shown to be low in many cases, raising issues of the interpretability of tests for replication.
Keywords:
replication
meta-analysis
heterogeneity
replicability
reproducibility

Journal

Psychological Methods cover
Psychological Methods
IF:
7.8
Papers:
1.3K
Citations:
2.1W

Organization

N
Northwestern University
Scholars:
6.1W
Papers: 5.3W
Citations: 3.9K