arrow
Return

Multisite Partially Nested Designs: Estimation, Inference, and Design

delete2025-10-01
delete0
PRE
AI
X
Xie, Yanli *
B
Ben Kelcey
DOI:10.1080/19345747.2025.2567241delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We develop design and analysis methods for the multisite replication of partially nested experiments. A novel feature in this design is that replicating partially nested designs across multiple sites can create site-level random effects that are correlated yet distinct across treatment conditions. Such site- and condition-specific effects can arise because, for example, the treatment condition introduces an intermediate layer of clustering-such as shared provider influences-that introduces dependencies among individuals within the treatment condition in ways that are absent in the control group. Although a review of prior substantive literature suggests that multisite partially nested designs are embedded in both theory and practice, the deliberate design and proper analysis of these structures have largely been overlooked. In this study, we outline the motivation for this design, map out its use in practice, and develop methods to estimate treatment effects, quantify cross-site heterogeneity, and assess statistical power to detect both the treatment effect and the cross-site heterogeneity. Collectively, the results provide the tools to effectively and efficiently design and analyze studies drawing on multisite partially nested experiments.
Keywords:
partially nested
multisite individual-randomized designs
estimation
statistical power

Journal

J
Journal of Research on Educational Effectiveness
IF:
1.6
Papers:
28
Citations:
1.3K

Organization

State University System of Florida cover
State University System of Florida
Scholars:
12.8W
Papers: 10.9W
Citations: 130
F
Florida State University
Scholars:
1.1W
Papers: 8.6K
Citations: 2.0W
Cited Papers

Cited Papers

Causal Inference for Treatment Effects in Partially Nested Designs
err2024-06-01
err2
errOAAI
errLiu, Xiao; Liu, Fang; Miller-Graff, Laura; Howell, Kathryn H.; Wang, Lijuan
errShare
errSave
Designing Large-Scale Multisite and Cluster-Randomized Studies of Professional Development
err2016-11-10
err0
PREAI
errBen Kelcey; Jessaca Spybrook; Geoffrey Phelps; Nathan Jones; Jiaqi Zhang
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
errShare
errSave
How Much Do the Effects of Education and Training Programs Vary Across Sites? Evidence From Past Multisite Randomized Trials
err2017-04-19
err0
PREAI
errMichael J. Weiss; Howard S. Bloom; Natalya Verbitsky-Savitz; Himani Gupta; Alma E. Vigil; Daniel N. Cullinan
errShare
errSave
Appropriate statistical methods for analysing partially nested randomised controlled trials with continuous outcomes: a simulation study
err2018-10-11
err45
errOAAI
errCandlish, Jane; Teare, M. Dawn; Dimairo, Munyaradzi; Flight, Laura; Mandefield, Laura; Walters, Stephen J.
errShare
errSave
researcher View more