arrow
Return

Revolutionizing Estimation and Inference for Program Evaluation Using Bayesian Methods

delete2018-12-11
delete4
PRE
AI
L
Lauren Vollmer *
M
Mariel M. Finucane
R
Randall Brown
DOI:10.1177/0193841X18815817delete
deleteOriginal
deleteShare
deleteSave
Abstract

Abstract

En 中文
Background: Policy makers seek to replace the thumbs up-thumbs down of conventional hypothesis testing with statements about the probability that program effects on key outcomes exceed policy-relevant thresholds. Objective: We develop a Bayesian model that addresses the shortcomings of a typical frequentist approach to estimating the effects of the Comprehensive Primary Care (CPC) initiative, a Centers for Medicare and Medicaid Services demonstration. We compare findings from the two approaches to illustrate the relative merits of introducing additional assumptions through Bayesian methods. Research design: We apply Bayesian and frequentist methods to estimate the effects of CPC on total Medicare expenditures per beneficiary per month for Medicare beneficiaries attributed to participating practices. Under both paradigms, we estimated program effects using difference-in-differences regressions comparing the change in Medicare expenditures between baseline and follow-up for Medicare patients attributed to 497 primary care practices participating in CPC to Medicare patients attributed to 908 propensity score-matched comparison practices. Results: Results from the Bayesian and frequentist models are comparable for the overall sample, but in regional subsamples, the Bayesian model produces more precise etimates that exhibit less variation over time. The Bayesian results also permit probabilistic inference about the magnitudes of effects, offering policy makers the ability to draw conclusions about practically meaningful thresholds. Conclusions: Carefully developed Bayesian models can enhance precision and plausibility and offer a more nuanced understanding of where and when program effects occur, without imposing undue assumptions. At the same time, these methods frame conclusions in flexible, intuitive terms that respond directly to policy makers' needs.
Keywords:
economic evaluation
design and evaluation of programs and policies
quasi-experimental design
methodology (if appropriate)
Bayesian
primary care

Journal

Evaluation Review cover
Evaluation Review
IF:
3.7
Papers:
1.4K
Citations:
1.7K

Organization

M
mathematica
Scholars:
658
Papers: 483
Citations: 606
Cited Papers

Cited Papers

Role of MicroRNAs in Lung Cancer
err2012-05-01
err0
PREAI
errMattia Boeri; Ugo Pastorino; Gabriella Sozzi
errShare
errSave
Absolute x-ray reflectivity study of the Au(100) surface
err1988-10-15
err0
PREAI
errDoon Gibbs; B. M. Ocko; D. M. Zehner; S. G. J. Mochrie
errShare
errSave
Atherosclerosis, vascular amyloidosis and brain hypoperfusion in the pathogenesis of sporadic Alzheimer's disease
err2013-07-19
err0
errOAAI
errWalter Kalback; Chera Esh; Eduardo M. Castaño; Afroza Rahman; Tyler Kokjohn; Dean C. Luehrs; Lucia Sue; Raquel Cisneros; Francoise Gerber; Claudia Richardson; Bernd Bohrmann; Douglas G. Walker; Thomas G. Beach; Alex E. Roher
errShare
errSave
Dry reforming of methane over nickel supported on Nd–ceria: enhancement of the catalytic properties and coke resistance
err2020-01-01
err0
errOAAI
errHugo A. Lara-García; Daniel G. Araiza; Melissa Méndez-Galván; Samuel Tehuacanero-Cuapa; Antonio Gómez-Cortés; Gabriela Díaz
errShare
errSave
Bayesian Estimation of Population-Level Trends in Measures of Health Status
err2014-02-01
err41
errOAAI
errFinucane, Mariel M.; Paciorek, Christopher J.; Danaei, Goodarz; Ezzati, Majid
errShare
errSave
Influence of Oxygen Ion Migration from Substrates on Photochemical Degradation of CH3NH3PbI3 Hybrid Perovskite
err2021-08-17
err0
errOAAI
errIvan S. Zhidkov; Azat F. Akbulatov; Liana N. Inasaridze; Andrey I. Kukharenko; Lyubov A. Frolova; Seif O. Cholakh; Chu-Chen Chueh; Pavel A. Troshin; Ernst Z. Kurmaev
errShare
errSave
Neural changes associated with semantic processing in healthy aging despite intact behavioral performance
err2015-10-01
err0
PREAI
errJacinthe Lacombe; Pierre Jolicoeur; Stephan Grimault; Jessica Pineault; Sven Joubert
errShare
errSave
researcher View more