Is Replication Possible Without Fidelity?

doi:10.1037/met0000473

Is Replication Possible Without Fidelity?

2023-12-01

7

OA

AI

M

Michelle R. Ellefson *

D

Daniel M. Oppenheimer

DOI：10.1037/met0000473

原文链接

原文求助

摘要

En 中文

Failure of replication attempts in experimental psychology might extend beyond p-hacking, publication bias or hidden moderators; reductions in experimental power can be caused by violations of fidelity to a set of experimental protocols. In this article, we run a series of simulations to systematically explore how manipulating fidelity influences effect size. We find statistical patterns that mimic those found in ManyLabs style replications and meta-analyses, suggesting that fidelity violations are present in many replications attempts in psychology. Scholars in intervention science, medicine, and education have developed methods of improving and measuring fidelity, and as replication becomes more mainstream in psychology, the field would benefit from adopting such approaches as well. Translational Abstract Failure of replication attempts in experimental psychology might extend beyond p-hacking, publication bias or hidden moderators; reductions in experimental power can be caused by violations of fidelity to a set of experimental protocols. In this article, we run a series of simulations to systematically explore how manipulating fidelity influences effect size. We find statistical patterns that mimic those found in ManyLabs style replications and meta-analyses, suggesting that fidelity violations are present in many replications attempts in psychology. Scholars in intervention science, medicine, and education have developed methods of improving and measuring fidelity, and as replication becomes more mainstream in psychology, the field would benefit from adopting such approaches as well.

Keyword:

replication

fidelity

effect size

heterogeneity

simulations

Is Replication Possible Without Fidelity?

摘要

期刊

机构

引用论文