arrow
Return

Causal Feature Selection With Dual Correction

delete2024-01-01
delete7
PRE
AI
X
Xianjie Guo
K
Kui Yu *
刘琳 (Lin Liu)
F
Fuyuan Cao
J
Jiuyong Li
DOI:10.1109/TNNLS.2022.3178075delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Causal feature selection methods aim to identify a Markov boundary (MB) of a class variable, and almost all the existing causal feature selection algorithms use conditional independence (CI) tests to learn the MB. However, in real-world applications, due to data issues (e.g., noisy or small samples), CI tests can be unreliable; thus, causal feature selection algorithms relying on CI tests encounter two types of errors: false positives (i.e., selecting false MB features) and false negatives (i.e., discarding true MB features). Existing algorithms only tackle either false positives or false negatives, and they cannot deal with both types of errors at the same time, leading to unsatisfactory results. To address this issue, we propose a dual-correction-strategy-based MB learning (DCMB) algorithm to correct the two types of errors simultaneously. Specifically, DCMB selectively removes false positives from the MB features currently selected, while selectively retrieving false negatives from the features currently discarded. To automatically determine the optimal number of selected features for the selective removal and retrieval in the dual correction strategy, we design the simulated-annealing-based DCMB (SA-DCMB) algorithm. Using benchmark Bayesian network (BN) datasets, the experimental results demonstrate that DCMB achieves substantial improvements on the MB learning accuracy compared with the existing MB learning methods. Empirical studies in real-world datasets validate the effectiveness of SA-DCMB for classification against state-of-the-art causal and traditional feature selection algorithms.
Keywords:
Feature extraction
Learning systems
Noise measurement
Markov processes
Bayes methods
Simulated annealing
Prediction algorithms
Bayesian network (BN)
dual correction
feature selection
Markov boundary (MB)

Journal

IEEE Transactions on Neural Networks and Learning Systems cover
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
Papers:
7.5K
Citations:
7.2W

Organization

H
hefei university of technology
Scholars:
2.5W
Papers: 1.7W
Citations: 35
S
Shanxi University
Scholars:
1.3W
Papers: 8.4K
Citations: 1.2W
U
University of South Australia
Scholars:
9.0K
Papers: 1.1W
Citations: 1.6W
researcher View more organizations