arrow
返回

Efficient Feature Ranking and Selection Using Statistical Moments

delete2024-01-01
delete0
delete
OA
AI
Y
Yael Hochma *
Y
Yuval Felendler
M
Mark Last
DOI:10.1109/ACCESS.2024.3412851delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Unsupervised feature selection methods can be more efficient than supervised methods, which rely on the expensive and time-consuming data labeling process. The paper introduced skewness as a novel, unsupervised, and computationally efficient feature ranking metric, suitable for both classification and regression tasks. Its feature selection effectiveness is compared to several state-of-the-art supervised and unsupervised feature ranking and selection methods. Both theoretical analysis and empirical evaluation on several popular classification and regression algorithms show that statistical moment-based feature selection algorithms are competitive in terms of accuracy and mean squared error (MSE) with the state-of-the-art supervised approaches for feature ranking and selection, including Fast Correlation Based Filter (FCBF), Minimum Redundancy Maximum Relevance (MRMR), and Mutual Information Maximization (MIM). We also present a mathematical proof based on some common assumptions, which explains the high effectiveness of statistical moments in the feature ranking procedure. Moreover, statistical moment-based feature selection is shown empirically to run faster, on average, than the supervised approaches and the unsupervised Laplacian Score method. Additionally, skewness-based feature selection, in contrast to variance-based selection, does not depend on data normalization that requires additional computational time and may affect the feature ranking results.
Keyword:
Feature extraction
Ranking (statistics)
Prediction algorithms
Laplace equations
Classification algorithms
Redundancy
Logistics
Unsupervised learning
Feature ranking
unsupervised feature selection
skewness
variance

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

B
ben-gurion university of the negev
学者数:
8.4K
论文数: 5.1K
被引数: 1
引用论文

引用论文

err分享
err收藏
err分享
err收藏
Subspace clustering guided unsupervised feature selection
err2017-06-01
err187
PREAI
errZhu, Pengfei; Zhu, Wencheng; Hu, Qinghua; Zhang, Changqing; Zuo, Wangmeng
err分享
err收藏
Mitochondrial pseudogenes: evolution's misplaced witnesses
err2001-06-01
err1.0K
errOAAI
errBensasson, D; Zhang, DX; Hartl, DL; Hewitt, GM
err分享
err收藏
CRYSTALLINE CERAMIC WASTE FORMS: REFERENCE FORMULATION REPORT
err
IF0
err2012-05-15
err0
errOAAI
errK. Brinkman; K. Fox; J. Marra
err分享
err收藏
学者 查看更多内容