arrow
返回

A More Flexible and Robust Feature Selection Algorithm

delete2023-01-01
delete7
delete
OA
AI
T
Tianyi Tu *
Y
Ye Su
Y
Y. A. Tang
W
Wenxue Tan
S
Sheng Ren
DOI:10.1109/ACCESS.2023.3342044delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
With the increasing amount of real data, the challenges of large-scale model operations as well as poor generalization capacity, making selection of an appropriate feature set a significant concern. This study proposes ImprovedRFECV, an enhanced approach for cross-validated recursive feature elimination (RFECV). The algorithm first enhances the robustness of the optimal feature subset through random sampling of different data, building multiple models, and comparing their scores. Simultaneously, the L1 and L2 regularization terms are introduced to evaluate the value of each feature more comprehensively, thus reducing the impact on the anti-interference term and further improving the accuracy of the algorithm and its stability. Furthermore, a multi-model ensemble learning framework is employed to enhance generalization ability and effectively prevent overfitting. Lastly, a both-end expansion removal strategy is adopted to address the issue of strong covariance among features while enhancing the algorithm's flexibility. The experimental results demonstrate that, compared to the RFECV algorithm, the ImprovedRFECV algorithm achieves fewer optimal average features and outperforms the optimal feature subset across five datasets spanning five different domains, demonstrating the algorithm's high level of robustness and generalization ability.
Keyword:
Feature selection
machine learning
stability evaluation
regularization
RFECV

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
36.3W

机构

湖南科技学院 封面图
湖南科技学院
学者数:
561
论文数: 324
被引数: 271
湖南文理学院 封面图
湖南文理学院
学者数:
743
论文数: 665
被引数: 701
引用论文

引用论文

Linear Cost-sensitive Max-margin Embedded Feature Selection for SVM
err2022-07-01
err15
PREAI
errAram, Khalid Y.; Lam, Sarah S.; Khasawneh, Mohammad T.
err分享
err收藏
学者 查看更多内容