arrow
Return

Regression-based conditional independence test with adaptive kernels

delete2025-07-01
delete0
PRE
AI
任
任一鑫 (Yixin Ren)
J
Juncai Zhang
Y
Yewei Xia
R
Ruxin Wang
F
Feng Xie
J
Jihong Guan
H
Hao Zhang *
S
Shuigeng Zhou *
DOI:10.1016/j.artint.2025.104391delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We propose a novel framework for regression-based conditional independence (CI) test with adaptive kernels, where the task of CI test is reduced to regression and statistical independence test while proving that the test power of CI can be maximized by adaptively learning parameterized kernels of the independence test if the consistency of regression can be guaranteed. For the adaptively learning kernel of independence test, we first address the pitfall inherent in the existing signal-to-noise ratio criterion by modeling the change of the null distribution during the learning process, then design a new class of kernels that can adaptively focus on the significant dimensions of variables to judge independence, which makes the tests more flexible than using simple kernels that are adaptive only in length-scale, and especially suitable for high-dimensional complex data. Theoretically, we demonstrate the consistency of the proposed tests, and show that the non-convex objective function used for learning fits the L-smoothing condition, thus benefiting the optimization. Experimental results on both synthetic and real data show the superiority of our method. The source code and datasets are available at https://github.com/hzsiat/AdaRCIT .
Keywords:
regression-based conditional independence
adaptive kernels
signal-to-noise ratio
high-dimensional data
statistical independence test

Journal

Artificial Intelligence Review cover
Artificial Intelligence Review
IF:
13.9
Papers:
6.1K
Citations:
1.9W

Organization

B
Beijing Technology and Business University
Scholars:
4.1K
Papers: 1.7K
Citations: 1.6W
F
fudan university
Scholars:
11.8W
Papers: 7.7W
Citations: 121
T
tongji university
Scholars:
7.9W
Papers: 6.0W
Citations: 98
C
chinese academy of sciences
Scholars:
56.7W
Papers: 45.0W
Citations: 704
researcher View more organizations
Cited Papers

Cited Papers

ADAPTIVE TEST OF INDEPENDENCE BASED ON HSIC MEASURES
err2022-04-01
err21
errOAAI
errAlbert, Melisande; Laurent, Beatrice; Marrel, Amandine; Meynaoui, Anouar
errShare
errSave
Large-scale kernel methods for independence testing
err2017-01-24
err0
errOAAI
errQinyi Zhang; Sarah Filippi; Arthur Gretton; Dino Sejdinovic
errShare
errSave
Causal Protein-Signaling Networks Derived from Multiparameter Single-Cell Data
err2005-04-22
err0
PREAI
errKaren Sachs; Omar Perez; Dana Pe'er; Douglas A. Lauffenburger; Garry P. Nolan
errShare
errSave
Identification of causal relations in neuroimaging data with latent confounders: An instrumental variable approach
err2016-01-01
err0
PREAI
errMoritz Grosse-Wentrup; Dominik Janzing; Markus Siegel; Bernhard Schölkopf
errShare
errSave
researcher View more