arrow
返回

Compactness score: a fast filter method for unsupervised feature selection

delete2023-03-21
delete0
PRE
AI
P
Peican Zhu
X
Xin Hou
K
Keke Tang
王
王祯 (Zhen Wang)
聂
聂飞平 (Feiping Nie) *
DOI:10.1007/s10479-023-05271-zdelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The rapid development of big data era incurs the generation of huge amount of data day by day in various fields. Due to the large-scale and high-dimensional characteristics of these data, it is often difficult to achieve better decision-making in practical applications. Therefore, an efficient big data analytical method is urgently necessary. For feature engineering, feature selection seems to be an important research topic which is anticipated to select excellent features from candidate ones. The implementation of feature selection can not only achieve the purpose of dimensionality reduction, but also improve the computational efficiency and result performance of the model. In many classification tasks, researchers found that data seem to be usually close to each other if they are from the same class; thus, local compactness is of great importance for the evaluation of a feature. Based on this discovery, we propose a fast unsupervised feature selection algorithm, named Compactness Score (CSUFS), to select desired features. To prove the superiority of the proposed algorithm, several public data sets are considered with extensive experiments being performed. The experiments are presented by applying feature subsets selected through several different algorithms to the clustering task. The performance of clustering tasks is indicated by two well-known evaluation metrics, while the efficiency is reflected by the corresponding running time. As demonstrated, our proposed algorithm is more accurate and efficient compared with existing ones.
Keyword:
Big data analytics
Unsupervised feature selection
Dimensionality reduction
k nearest neighbor distances

期刊

Annals of Operations Research 封面图
Annals of Operations Research
IF:
4.5
论文数:
8.1K
被引数:
2.1W

机构

G
Guangzhou University
学者数:
1.8W
论文数: 1.3W
被引数: 1.8W
N
Northwestern Polytechnical University
学者数:
4.6W
论文数: 3.7W
被引数: 5.3W
引用论文

引用论文

Adipose Tissue Response to Insulin following Injury损伤后脂肪组织对胰岛素的反应
err1987-11-01
err0
PREAI
errJan Rakinic; Glen Takimoto; John A. Barrett; Deborah A. Lange; Arnold P. Robin
err分享
err收藏
Optimized Graph Learning Using Partial Tags and Multiple Features for Image and Video Annotation
err2016-11-01
err101
PREAI
errSong, Jingkuan; Gao, Lianli; Nie, Feiping; Shen, Heng Tao; Yan, Yan; Sebe, Nicu
err分享
err收藏
A novel framework of credit risk feature selection for SMEs during industry 4.0
err2022-07-25
err31
errOAAI
errLu, Yang; Yang, Lian; Shi, Baofeng; Li, Jiaxiang; Abedin, Mohammad Zoynul
err分享
err收藏
Governing Misvalued Firms
err
IF0
err2014-01-01
err0
errOAAI
errDalida Kadyrzhanova; Matthew Rhodes-Kropf
err分享
err收藏
The evolution and functional divergence of the histone H2B family in plants
err2020-07-27
err0
errOAAI
errDanhua Jiang; Michael Borg; Zdravko J. Lorković; Sean A. Montgomery; Akihisa Osakabe; Ramesh Yelagandula; Elin Axelsson; Frédéric Berger
err分享
err收藏
学者 查看更多内容