arrow
Return

A wrapper feature selection approach using Markov blankets

delete2025-02-01
delete1
PRE
AI
A
Atif Hassan *
J
Jiaul H. Paik
S
Swanand Khare
DOI:10.1016/j.patcog.2024.111069delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In feature selection, Markov Blanket (MB) based approaches have attracted considerable attention with most MB discovery algorithms being categorized as filter based techniques. Typically, the Conditional Independence (CI) test employed by such methods is different for different data types. In this article, we propose a novel Markov Blanket based wrapper feature selection method. The proposed approach employs Predictive Permutation Independence (PPI), a novel Conditional Independence (CI) test that allows it to work out-of-the- box for both classification and regression tasks on mixed data. PPI can work with any supervised algorithm to estimate the association of a feature with the target variable while also providing a measure of feature importance. The proposed approach also includes an optional MB aggregation step that can be used to find the optimal MB under non-faithful conditions. Our method1 1 outperforms other MB discovery methods, in terms of F1-score, by 7% on average, over 3 large-scale BN datasets. It also outperforms state-of-the-art feature selection techniques on 13 real-world datasets.
Keywords:
Feature selection
Markov blanket
Conditional independence test
Classification
Regression

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

I
indian institute of technology system (iit system)
Scholars:
9.5W
Papers: 9.9W
Citations: 93
I
indian institute of technology (iit) - kharagpur
Scholars:
6.2K
Papers: 6.5K
Citations: 6
Cited Papers

Cited Papers

Development policies on rural peripheral areas in Visegrad countries: a comparative policy analysis
err2015-10-14
err0
errOAAI
errZoltán Kovács; Stela Csachová; Mariola Ferenc; Vladan Hruška; Michał Konopski
errShare
errSave
A novel relation aware wrapper method for feature selection
err2023-08-01
err20
PREAI
errLiu, Zhaogeng; Yang, Jielong; Wang, Li; Chang, Yi
errShare
errSave
BAOA: Binary Arithmetic Optimization Algorithm With K-Nearest Neighbor Classifier for Feature Selection
err2023-01-01
err22
errOAAI
errKhodadadi, Nima; Khodadadi, Ehsan; Al-Tashi, Qasem; El-Kenawy, El-Sayed M.; Abualigah, Laith; Abdulkadir, Said Jadid; Alqushaibi, Alawi; Mirjalili, Seyedali
errShare
errSave
Towards scalable and data efficient learning of Markov boundaries
err2007-07-01
err170
PREAI
errPena, Jose M.; Nilsson, Roland; Bjorkegren, Johan; Tegner, Jesper
errShare
errSave
A feature selection based on genetic algorithm for intrusion detection of industrial control systems
err2024-04-01
err9
PREAI
errFang, Yushan; Yao, Yu; Lin, Xiaoli; Wang, Jiaxuan; Zhai, Hao
errShare
errSave
researcher View more