返回
Maximum margin and global criterion based-recursive feature selection
DOI:10.1016/j.neunet.2023.10.037.png)
摘要
En 中文
In this research paper, we aim to investigate and address the limitations of recursive feature elimination (RFE) and its variants in high-dimensional feature selection tasks. We identify two main challenges associated with these methods. Firstly, the feature ranking criterion utilized in these approaches is inconsistent with the maximum-margin theory. Secondly, the computation of the criterion is performed locally, lacking the ability to measure the importance of features globally. To overcome these challenges, we propose a novel feature ranking criterion called Maximum Margin and Global (MMG) criterion. This criterion utilizes the classification margin to determine the importance of features and computes it globally, enabling a more accurate assessment of feature importance. Moreover, we introduce an optimal feature subset evaluation algorithm that leverages the MMG criterion to determine the best subset of features. To enhance the efficiency of the proposed algorithms, we provide two alpha seeding strategies that significantly reduce computational costs while maintaining high accuracy. These strategies offer a practical means to expedite the feature selection process. Through extensive experiments conducted on ten benchmark datasets, we demonstrate that our proposed algorithms outperform current state-of-the-art methods. Additionally, the alpha seeding strategies yield significant speedups, further enhancing the efficiency of the feature selection process.
Keyword:
Support vector machine
Linear discriminant function
Maximum margin
Global criterion
期刊
IF:
6.3
论文数:
8.2K
被引数:
3.0W
机构
引用论文
Feature clustering based support vector machine recursive feature elimination for gene selection基于特征聚类的支持向量机递归特征消除基因选择
APPLIED INTELLIGENCE
IF3.5
Feature selection and analysis on correlated gas sensor data with recursive feature elimination基于递归特征消除的气体传感器相关数据特征选择与分析
Multivariate Classification of Smokers and Nonsmokers Using SVM-RFE on Structural MRI Images
HUMAN BRAIN MAPPING
IF3.3

