arrow
返回

Stable Prediction With Leveraging Seed Variable

delete2022-01-01
delete4
PRE
AI
K
Kun Kuang
H
Haotian Wang
刘越 封面图
刘越 (Yue Liu)
R
Ruoxuan Xiong
R
Runze Wu
W
Weiming Lü *
Wu Fei 封面图
Wu Fei (Fei Wu) *
崔鹏 封面图
崔鹏 (Peng Cui)
B
Bo Li *
DOI:10.1109/TKDE.2022.3169333delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In this paper, we focus on the problem of stable prediction across unknown test data, where the test distribution might be different from the training one and is always agnostic when model training. In such a case, previous machine learning methods might exploit subtly spurious correlations induced by non-causal variables in training data for prediction. Those spurious correlations can vary across datasets, leading to instability of prediction across unknown test data. To address this problem, we propose an algorithm based on conditional independence tests to screen out non-causal features and reduce spurious correlations by leveraging a seed variable. We show, both theoretically and with empirical experiments, that our algorithm can precisely screen out the isolated non-causal variables, which have no causal relationship with other variables, and remove the spurious correlations induced by them, increasing the stability of prediction across unknown test data. Extensive experiments on both synthetic and real-world datasets demonstrate that our algorithm outperforms state-of-the-art methods for stable prediction across unknown test data.
Keyword:
Conditional independence
separation
seed variables
stable prediction

期刊

IEEE Transactions on Knowledge and Data Engineering 封面图
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
论文数:
6.8K
被引数:
3.2W

机构

T
tsinghua university
学者数:
11.9W
论文数: 10.0W
被引数: 137
R
Renmin University of China
学者数:
8.1K
论文数: 7.7K
被引数: 1.1W
E
Emory University
学者数:
5.0W
论文数: 4.2W
被引数: 5.7W
N
national university of defense technology - china
学者数:
1.8W
论文数: 1.4W
被引数: 9
Z
zhejiang university
学者数:
17.7W
论文数: 12.1W
被引数: 152
学者 查看更多机构
引用论文

引用论文

Causal Inference因果推理
err2020-03-01
err78
errOAAI
errKuang, Kun; Li, Lian; Geng, Zhi; Xu, Lei; Zhang, Kun; Liao, Beishui; Huang, Huaxin; Ding, Peng; Miao, Wang; Jiang, Zhichao
err分享
err收藏
An Exploration of Parameter Redundancy in Deep Networks with Circulant Projections
err2015-12-01
err0
errOAAI
errYu Cheng; Felix X. Yu; Rogerio S. Feris; Sanjiv Kumar; Alok Choudhary; Shi-Fu Chang
err分享
err收藏
An improvement on floating search algorithms for feature subset selection
err2009-09-01
err102
PREAI
errNakariyakul, Songyot; Casasent, David P.
err分享
err收藏
学者 查看更多内容