arrow
Return

Conformal Prediction for Distributed Data

delete2026-05-13
delete1
PRE
AI
W
Wang, Tianzhen
W
Wang, Huixia Judy
W
Wang, Yinfeng
T
Tang, Yanlin *
DOI:10.1002/sta4.70157delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Conformal prediction is a powerful framework for constructing distribution-free prediction regions with guaranteed coverage. Existing conformal prediction methods are often developed in a centralized setting, assuming that all data are accessible at a single location. However, data are often distributed across multiple machines due to communication constraints or data access restrictions, making conventional conformal prediction methods infeasible. In this paper, we propose a distributed conformal prediction method that leverages random forests without centralizing raw data. To construct prediction sets, we design a communication-efficient distributed quantile estimation algorithm using binary search. Additionally, we investigate a distributed conformalized quantile regression approach that adapts the lengths of prediction sets to heteroscedasticity. To improve predictive efficiency, especially under complex error distributions such as skewed or multimodal structures, we further introduce a distributed conformal prediction method based on highest density sets, yielding narrower and more informative prediction regions. We establish upper and lower bounds on the coverage of the proposed methods. Numerical simulations and an illustrative airline data example demonstrate the effectiveness of our methods.
Keywords:
binary search
conformal prediction
distributed learning
highest density set
quantile regression forests

Journal

S
STAT
IF:
0.8
Papers:
59
Citations:
655

Organization

R
Rice University
Scholars:
1.4W
Papers: 1.2W
Citations: 2.6W
E
east china normal university
Scholars:
3.1W
Papers: 2.1W
Citations: 25
S
shanghai lixin university of accounting & finance
Scholars:
57
Papers: 42
Citations: 0
researcher View more organizations
Cited Papers

Cited Papers

errShare
errSave
Conformal Sensitivity Analysis for Individual Treatment Effects
err2022-09-23
err9
errOAAI
errYin, Mingzhang; Shi, Claudia; Wang, Yixin; Blei, David M.
errShare
errSave
DISTRIBUTED INFERENCE FOR QUANTILE REGRESSION PROCESSES
err2019-06-01
err112
errOAAI
errVolgushev, Stanislav; Chao, Shih-Kang; Cheng, Guang
errShare
errSave
errShare
errSave
TESTING FOR OUTLIERS WITH CONFORMAL P-VALUES
err2023-02-01
err36
errOAAI
errBates, Stephen; Candes, Emmanuel; Lei, Lihua; Romano, Yaniv; Sesia, Matteo
errShare
errSave
PREDICTIVE INFERENCE WITH THE JACKKNIFE
err2021-02-01
err155
errOAAI
errBarber, Rina Foygel; Candes, Emmanuel J.; Ramdas, Aaditya; Tibshirani, Ryan J.
errShare
errSave
errShare
errSave
researcher View more