arrow
Return

Reusing Natural Experiments

delete2023-06-07
delete23
PRE
AI
D
Davidson Heath
M
Matthew C. Ringgenberg
M
Mehrdad Samadi
I
Ingrid M. Werner *
DOI:10.1111/jofi.13250delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
After a natural experiment is first used, other researchers often reuse the setting, examining different outcome variables. We use simulations based on real data to illustrate the multiple hypothesis testing problem that arises when researchers reuse natural experiments. We then provide guidance for future inference based on popular empirical settings including difference-in-differences, instrumental variables, and regression discontinuity designs. When we apply our guidance to two extensively studied natural experiments, business combination laws and the Regulation SHO pilot, we find that many results that were statistically significant using single hypothesis testing do not survive corrections for multiple hypothesis testing.
Keywords:
FALSE DISCOVERY RATE
PRICE TESTS
MULTIPLE
IDENTIFICATION
ECONOMICS
CON

Journal

Journal of Finance cover
Journal of Finance
IF:
9.5
Papers:
4.0K
Citations:
5.0W

Organization

U
University of Utah
Scholars:
3.0W
Papers: 2.2W
Citations: 4.6W
F
federal reserve system - usa
Scholars:
1.6K
Papers: 2.4K
Citations: 3
U
Utah System of Higher Education
Scholars:
4.6W
Papers: 4.0W
Citations: 161
researcher View more organizations
Cited Papers

Cited Papers

The Romano-Wolf multiple-hypothesis correction in Stata
err2020-12-22
err133
errOAAI
errClarke, Damian; Romano, Joseph P.; Wolf, Michael
errShare
errSave
Two distinct mechanisms for long-range patterning by Decapentaplegic in the Drosophila wing
err1996-05-30
err0
PREAI
errThomas Lecuit; William J. Brook; Medard Ng; Manuel Calleja; Henry Sun; Stephen M. Cohen
errShare
errSave
... and the Cross-Section of Expected Returns
err2015-10-09
err1.0K
errOAAI
errHarvey, Campbell R.; Liu, Yan; Zhu, Heqing
errShare
errSave
Repeated Human Exposure to Semivolatile Organic Compounds by Inhalation: Novel Protocol for a Nonrandomized Study
err2023-10-13
err0
errOAAI
errElena Reale; Nancy B Hopf; Florian Breider; Dominique Grandjean; Catherine Pirard; Corinne Charlier; Holger M Koch; Aurélie Berthet; Guillaume Suarez; Myriam Borgatta
errShare
errSave
Reassessing False Discoveries in Mutual Fund Performance: Skill, Luck, or Lack of Power?
err2019-05-15
err33
errOAAI
errAndrikogiannopoulou, Angie; Papakonstantinou, Filippos
errShare
errSave
researcher View more