arrow
Return

External Validity and Meta-Analysis

delete2022-10-24
delete13
PRE
AI
T
Tara Slough *
S
Scott A. Tyson
DOI:10.1111/ajps.12742delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Meta-analysis is a method that combines estimates from studies conducted on different samples, in different contexts, or at different times. Social scientists increasingly use meta-analyses to aggregate evidence and learn about general substantive phenomena. We develop a framework to examine the theoretical foundations of meta-analysis, with emphasis on clarifying the role of external validity. We identify the conditions under which multiple studies are target-equivalent, meaning they identify the same empirical target. Our main result shows that external validity and harmonization, in comparisons made and how outcomes are measured, are necessary and sufficient for target-equivalence. We examine common formulations of meta-analysis-fixed- and random-effects models-developing the theoretical assumptions that underpin them and providing design-based identification results for these models. We then provide practical guidance based on our framework and results. Our results reveal limits to agnostic approaches to the combination of causal evidence from multiple studies.
Keywords:
TRIALS

Journal

American Journal of Political Science cover
American Journal of Political Science
IF:
5.6
Papers:
2.7K
Citations:
1.6W

Organization

N
New York University
Scholars:
4.4W
Papers: 3.9W
Citations: 5.8W
E
Emory University
Scholars:
5.0W
Papers: 4.2W
Citations: 5.7W