arrow
返回

Constrained class-wise feature selection (CCFS)

delete2022-06-20
delete2
PRE
AI
S
Syed Fawad Hussain *
F
Fatima Shahzadi
B
Badre Munir
DOI:10.1007/s13042-022-01589-5delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Feature selection plays a vital role as a preprocessing step for high dimensional data in machine learning. The basic purpose of feature selection is to avoid curse of dimensionality and reduce time and space complexity of training data. Several techniques, including those that use information theory, have been proposed in the literature as a means to measure the information content of a feature. Most of them incrementally select features with max dependency with the category but minimum redundancy with already selected features. A key missing idea in these techniques is the fair representation of features with max dependency among the different categories, i.e., skewed selection of features having high mutual information (MI) with a particular class. This can result in a biased classification in favor of that particular class while other classes have low matching scores during classification. We propose a novel approach based on information theory that selects features in a class-wise fashion rather than based on their global max dependency. In addition, a constrained search is used instead of a global sequential forward search. We prove that our proposed approach enhances Maximum Relevance while keeping Minimum Redundancy under a constrained search. Results on multiple benchmark datasets show that our proposed method improves accuracy as compared to other state-of-the-art feature selection algorithms while having a lower time complexity.
Keyword:
Feature selection
Information theory
Classification
Class-wise feature selection

期刊

International Journal of Machine Learning and Cybernetics 封面图
International Journal of Machine Learning and Cybernetics
IF:
2.7
论文数:
3.2K
被引数:
5.6K

机构

G
gik institute engineering science & technology
学者数:
1.1K
论文数: 1.0K
被引数: 2
引用论文

引用论文

err分享
err收藏
Processor Design for Soft Errors: Challenges and State of the Art
err2016-11-08
err22
PREAI
errLi, Tuo; Ambrose, Jude Angelo; Ragel, Roshan; Parameswaran, Sri
err分享
err收藏
Genetic circuit design automation for yeast
err2020-08-03
err0
PREAI
errYe Chen; Shuyi Zhang; Eric M. Young; Timothy S. Jones; Douglas Densmore; Christopher A. Voigt
err分享
err收藏
The evolution and functional divergence of the histone H2B family in plants
err2020-07-27
err0
errOAAI
errDanhua Jiang; Michael Borg; Zdravko J. Lorković; Sean A. Montgomery; Akihisa Osakabe; Ramesh Yelagandula; Elin Axelsson; Frédéric Berger
err分享
err收藏
Class-specific mutual information variation for feature selection
err2018-07-01
err125
PREAI
errGao, Wanfu; Hu, Liang; Zhang, Ping
err分享
err收藏
XCP1 is a caspase that proteolyzes Pathogenesis-related protein 1 to produce the cytokine CAPE9 for systemic immunity in Arabidopsis
err
IF0
err2021-02-15
err0
errOAAI
errYing-Lan Chen; Fan-Wei Lin; Kai-Tan Cheng; Hung-Yu Wang; Thomas Efferth; Yet-Ran Chen
err分享
err收藏
Subsequent Pain or Injury After Foot and Ankle Surgery in Patients Receiving Workers’ Compensation
err2019-10-25
err0
errOAAI
errGabrielle Bui; Yubo Gao; Natalie Glass; Christopher Cychosz; John Lawrence Marsh; Phinit Phisitkul
err分享
err收藏
学者 查看更多内容