arrow
返回

Causality-Oriented Robustness: Exploiting General Noise Interventions

delete2025-12-01
delete1
PRE
AI
X
Xinwei Shen
P
Peter Bühlmann
A
Armeen Taeb *
DOI:10.1080/01621459.2025.2544365delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Since distribution shifts are common in real-world applications, there is a pressing need to develop prediction models that are robust against such shifts. Existing frameworks, such as empirical risk minimization or distributionally robust optimization, either lack generalizability for unseen distributions or rely on postulated distance measures. Alternatively, causality offers a data-driven and structural perspective to robust predictions. However, the assumptions necessary for causal inference can be overly stringent, and the robustness offered by such causal models often lacks flexibility. In this article, we focus on causality-oriented robustness and propose Distributional Robustness via Invariant Gradients (DRIG), a method that exploits general noise interventions in training data for robust predictions against unseen interventions, and naturally interpolates between in-distribution prediction and causality. In a linear setting, we prove that DRIG yields predictions that are robust among a data-dependent class of distribution shifts. Furthermore, we show that our framework includes anchor regression as a special case, and that it yields prediction models that protect against more diverse perturbations. We establish finite-sample results and extend our approach to semi-supervised domain adaptation to further improve prediction performance. Finally, we empirically validate our methods on synthetic simulations and on single-cell and intensive health care datasets. Supplementary materials for this article are available online, including a standardized description of the materials available for reproducing the work.
Keyword:
Distribution shifts
Interventional data
Invariance
Robust prediction
Structural causal models

期刊

J
Journal of the American Statistical Association
IF:
3
论文数:
5.2K
被引数:
4.8W

机构

E
eth zurich
学者数:
2.3K
论文数: 1.1K
被引数: 0
S
swiss federal institutes of technology domain
学者数:
9.0W
论文数: 8.0W
被引数: 163
引用论文

引用论文

ENVIRONMENT INVARIANT LINEAR LEAST SQUARES
err2024-10-01
err0
errOAAI
errFan, Jianqing; Fang, Cong; Gu, Yihong; Zhang, Tong
err分享
err收藏
Shortcut learning in deep neural networks深度神经网络中的捷径学习
err2020-11-10
err489
PREAI
errGeirhos, Robert; Jacobsen, Joern-Henrik; Michaelis, Claudio; Zemel, Richard; Brendel, Wieland; Bethge, Matthias; Wichmann, Felix A.
err分享
err收藏
err分享
err收藏
err分享
err收藏
Invariance, Causality and Robustness
err2020-08-01
err74
errOAAI
errBuehlmann, Peter
err分享
err收藏
MAXIMIN EFFECTS IN INHOMOGENEOUS LARGE-SCALE DATA
err2015-08-01
err43
errOAAI
errMeinshausen, Nicolai; Buehlmann, Peter
err分享
err收藏
Mapping information-rich genotype-phenotype landscapes with genome-scale Perturb-seq用基因组规模的扰动序列绘制信息丰富的基因型-表型景观
errCell
IF0
err2022-07-01
err0
errOAAI
errJoseph M. Replogle; Reuben A. Saunders; Angela N. Pogson; Jeffrey A. Hussmann; Alexander Lenail; Alina Guna; Lauren Mascibroda; Eric J. Wagner; Karen Adelman; Gila Lithwick-Yanai; Nika Iremadze; Florian Oberstrass; Doron Lipson; Jessica L. Bonnar; Marco Jost; Thomas M. Norman; Jonathan S. Weissman
err分享
err收藏
学者 查看更多内容