arrow
Return

Randomization inference for treatment effect variation

delete2015-07-07
delete80
delete
OA
AI
P
Peng Ding
A
Avi Feller *
L
Luke Miratrix
DOI:10.1111/rssb.12124delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Applied researchers are increasingly interested in whether and how treatment effects vary in randomized evaluations, especially variation that is not explained by observed covariates. We propose a model-free approach for testing for the presence of such unexplained variation. To use this randomization-based approach, we must address the fact that the average treatment effect, which is generally the object of interest in randomized experiments, actually acts as a nuisance parameter in this setting. We explore potential solutions and advocate for a method that guarantees valid tests in finite samples despite this nuisance. We also show how this method readily extends to testing for heterogeneity beyond a given model, which can be useful for assessing the sufficiency of a given scientific theory. We finally apply our method to the National Head Start impact study, which is a large-scale randomized evaluation of a Federal preschool programme, finding that there is indeed significant unexplained treatment effect variation.
Keywords:
Causal inference
Head Start
Heterogeneous treatment effect
Randomization test

Journal

J
Journal of the Royal Statistical Society Series B-Statistical Methodology
IF:
3.6
Papers:
1.5K
Citations:
3.2W

Organization

H
Harvard University
Scholars:
26.5W
Papers: 22.0W
Citations: 28.7W