arrow
Return

Are Survey Experiments Externally Valid?

delete2010-05-07
delete314
PRE
AI
J
Jason Barabas *
J
Jennifer Jerit
DOI:10.1017/S0003055410000092delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Researchers use survey experiments to establish causal effects in descriptively representative samples, but concerns remain regarding the strength of the stimuli and the lack of realism in experimental settings. We explore these issues by comparing three national survey experiments on Medicare and immigration with contemporaneous natural experiments on the same topics. The survey experiments reveal that providing information increases political knowledge and alters attitudes. In contrast, two real-world government announcements had no discernable effects, except among people who were exposed to the same facts publicized in the mass media. Even among this exposed subsample, treatment effects were smaller and sometimes pointed in the opposite direction. Methodologically, our results suggest the need for caution when extrapolating from survey experiments. Substantively, we find that many citizens are able to recall factual information appearing in the news but may not adjust their beliefs and opinions in response to this information.
Keywords:
STATISTICAL POWER
VOTER TURNOUT
INFORMATION
KNOWLEDGE
DELIBERATION
QUESTIONS
FIELD
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

American Political Science Review cover
American Political Science Review
IF:
5.8
Papers:
8.7K
Citations:
2.1W

Organization

State University System of Florida cover
State University System of Florida
Scholars:
12.7W
Papers: 10.9W
Citations: 130