arrow
返回

Detecting p-Hacking

delete2022-01-01
delete24
PRE
AI
G
Graham Elliott *
N
Nikolay Kudrin
K
Kaspar Wüthrich
DOI:10.3982/ECTA18583delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
We theoretically analyze the problem of testing for p-hacking based on distributions of p-values across multiple studies. We provide general results for when such distributions have testable restrictions (are non-increasing) under the null of no p-hacking. We find novel additional testable restrictions for p-values based on t-tests. Specifically, the shape of the power functions results in both complete monotonicity as well as bounds on the distribution of p-values. These testable restrictions result in more powerful tests for the null hypothesis of no p-hacking. When there is also publication bias, our tests are joint tests for p-hacking and publication bias. A reanalysis of two prominent data sets shows the usefulness of our new tests.
Keyword:
p-values
p-curve
complete monotonicity
publication bias

期刊

Econometrica 封面图
Econometrica
IF:
7.1
论文数:
3.0K
被引数:
4.3W

机构

University of California System 封面图
University of California System
学者数:
37.5W
论文数: 33.7W
被引数: 6.6K
引用论文

引用论文

err分享
err收藏
Identification of and Correction for Publication Bias
err2019-08-01
err188
errOAAI
errAndrews, Isaiah; Kasy, Maximilian
err分享
err收藏
err分享
err收藏
The optimal design of pressure swing adsorption systems
err1991-01-01
err0
PREAI
errOliver J. Smith; Arthur W. Westerberg
err分享
err收藏
Methods Matter: p-Hacking and Publication Bias in Causal Analysis in Economics
err2020-11-01
err131
PREAI
errBrodeur, Abel; Cook, Nikolai; Heyes, Anthony
err分享
err收藏
学者 查看更多内容