返回
Efficient Feature Ranking and Selection Using Statistical Moments
DOI:10.1109/ACCESS.2024.3412851.png)
摘要
En 中文
Unsupervised feature selection methods can be more efficient than supervised methods, which rely on the expensive and time-consuming data labeling process. The paper introduced skewness as a novel, unsupervised, and computationally efficient feature ranking metric, suitable for both classification and regression tasks. Its feature selection effectiveness is compared to several state-of-the-art supervised and unsupervised feature ranking and selection methods. Both theoretical analysis and empirical evaluation on several popular classification and regression algorithms show that statistical moment-based feature selection algorithms are competitive in terms of accuracy and mean squared error (MSE) with the state-of-the-art supervised approaches for feature ranking and selection, including Fast Correlation Based Filter (FCBF), Minimum Redundancy Maximum Relevance (MRMR), and Mutual Information Maximization (MIM). We also present a mathematical proof based on some common assumptions, which explains the high effectiveness of statistical moments in the feature ranking procedure. Moreover, statistical moment-based feature selection is shown empirically to run faster, on average, than the supervised approaches and the unsupervised Laplacian Score method. Additionally, skewness-based feature selection, in contrast to variance-based selection, does not depend on data normalization that requires additional computational time and may affect the feature ranking results.
Keyword:
Feature extraction
Ranking (statistics)
Prediction algorithms
Laplace equations
Classification algorithms
Redundancy
Logistics
Unsupervised learning
Feature ranking
unsupervised feature selection
skewness
variance
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
Combining Multiple Feature-Ranking Techniques and Clustering of Variables for Feature Selection结合多种特征排序技术和变量聚类进行特征选择
IEEE ACCESS
IF3.6
Adversary pretrial procedures and testimonial evidence: Effects of lawyer's role and Machiavellianism.对手审前程序和证词证据: 律师角色和马基雅维利主义的影响。
Determinants of wasting among schoolchildren in a Southwestern state of Nigeria: Implications to strengthen the nutritional component of primary health-care model尼日利亚西南部州学龄儿童消瘦的决定因素:对加强初级卫生保健模型营养组成部分的启示

