arrow
返回

Contextual sensitivity in scientific reproducibility

delete2016-05-23
delete290
delete
OA
AI
J
Jay J. Van Bavel *
P
Peter Mende‐Siedlecki
W
William J. Brady
D
Diego A. Reinero
DOI:10.1073/pnas.1521897113delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
In recent years, scientists have paid increasing attention to reproducibility. For example, the Reproducibility Project, a large-scale replication attempt of 100 studies published in top psychology journals found that only 39% could be unambiguously reproduced. There is a growing consensus among scientists that the lack of reproducibility in psychology and other fields stems from various methodological factors, including low statistical power, researcher's degrees of freedom, and an emphasis on publishing surprising positive results. However, there is a contentious debate about the extent to which failures to reproduce certain results might also reflect contextual differences (often termed hiddenmoderators) between the original research and the replication attempt. Although psychologists have found extensive evidence that contextual factors alter behavior, some have argued that context is unlikely to influence the results of direct replications precisely because these studies use the same methods as those used in the original research. To help resolve this debate, we recoded the 100 original studies from the Reproducibility Project on the extent to which the research topic of each study was contextually sensitive. Results suggested that the contextual sensitivity of the research topic was associated with replication success, even after statistically adjusting for several methodological characteristics (e.g.,statistical power, effect size). The association between contextual sensitivity and replication success did not differ across psychological subdisciplines. These results suggest that researchers, replicators, and consumers should bemindful of contextual factors that might influence a psychological process. We offer several guidelines for dealing with contextual sensitivity in reproducibility.
Keyword:
replication
reproducibility
context
psychology
meta-science
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

P
Proceedings of the National Academy of Sciences of the United States of America
IF:
9.1
论文数:
10.8W
被引数:
73.5W

机构

N
New York University
学者数:
4.4W
论文数: 3.9W
被引数: 5.8W
引用论文

引用论文

Low Hopes, High Expectations: Expectancy Effects and the Replicability of Behavioral Experiments
err2012-11-07
err101
PREAI
errKlein, Olivier; Doyen, Stephane; Leys, Christophe; da Gama, Pedro A. Magalhaes de Saldanha; Miller, Sarah; Questienne, Laurence; Cleeremans, Axel
err分享
err收藏
Twisted gastrulation (Tsg) is regulated by Tob and enhances TGF-β signaling in activated T lymphocytes
err2006-12-12
err0
errOAAI
errDimitrios Tzachanis; Lequn Li; Esther M. Lafuente; Alla Berezovskaya; Gordon J. Freeman; Vassiliki A. Boussiotis
err分享
err收藏
err分享
err收藏
Response to Comment on Estimating the reproducibility of psychological science
errSCIENCE
IF45.8
err2016-03-04
err115
errOAAI
errAnderson, Christopher J.; Bahnik, Stepan; Barnett-Cowan, Michael; Bosco, Frank A.; Chandler, Jesse; Chartier, Christopher R.; Cheung, Felix; Christopherson, Cody D.; Cordes, Andreas; Cremata, Edward J.; Della Penna, Nicolas; Estel, Vivien; Fedor, Anna; Fitneva, Stanka A.; Frank, Michael C.; Grange, James A.; Hartshorne, Joshua K.; Hasselman, Fred; Henninger, Felix; van der Hulst, Marije; Jonas, Kai J.; Lai, Calvin K.; Levitan, Carmel A.; Miller, Jeremy K.; Moore, Katherine S.; Meixner, Johannes M.; Munafo, Marcus R.; Neijenhuijs, Koen I.; Nilsonne, Gustav; Nosek, Brian A.; Plessow, Franziska; Prenoveau, Jason M.; Ricker, Ashley A.; Schmidt, Kathleen; Spies, Jeffrey R.; Stieger, Stefan; Strohminger, Nina; Sullivan, Gavin B.; van Aert, Robbie C. M.; van Assen, Marcel A. L. M.; Vanpaemel, Wolf; Vianello, Michelangelo; Voracek, Martin; Zuni, Kellylynn
err分享
err收藏
The effects of cellular contraction on aortic valve leaflet flexural stiffness
err2006-01-01
err0
PREAI
errW. David Merryman; Hsiao-Ying Shadow Huang; Frederick J. Schoen; Michael S. Sacks
err分享
err收藏
Using prediction markets to estimate the reproducibility of scientific research使用预测市场来估计科学研究的可重复性
err2015-11-09
err168
errOAAI
errDreber, Anna; Pfeiffer, Thomas; Almenberg, Johan; Isaksson, Siri; Wilson, Brad; Chen, Yiling; Nosek, Brian A.; Johannesson, Magnus
err分享
err收藏
学者 查看更多内容