返回
Compactness score: a fast filter method for unsupervised feature selection
DOI:10.1007/s10479-023-05271-z.png)
摘要
En 中文
The rapid development of big data era incurs the generation of huge amount of data day by day in various fields. Due to the large-scale and high-dimensional characteristics of these data, it is often difficult to achieve better decision-making in practical applications. Therefore, an efficient big data analytical method is urgently necessary. For feature engineering, feature selection seems to be an important research topic which is anticipated to select excellent features from candidate ones. The implementation of feature selection can not only achieve the purpose of dimensionality reduction, but also improve the computational efficiency and result performance of the model. In many classification tasks, researchers found that data seem to be usually close to each other if they are from the same class; thus, local compactness is of great importance for the evaluation of a feature. Based on this discovery, we propose a fast unsupervised feature selection algorithm, named Compactness Score (CSUFS), to select desired features. To prove the superiority of the proposed algorithm, several public data sets are considered with extensive experiments being performed. The experiments are presented by applying feature subsets selected through several different algorithms to the clustering task. The performance of clustering tasks is indicated by two well-known evaluation metrics, while the efficiency is reflected by the corresponding running time. As demonstrated, our proposed algorithm is more accurate and efficient compared with existing ones.
Keyword:
Big data analytics
Unsupervised feature selection
Dimensionality reduction
k nearest neighbor distances
期刊
IF:
4.5
论文数:
8.1K
被引数:
2.1W
机构
引用论文
Improving performance of classification on incomplete data using feature selection and clustering利用特征选择和聚类提高不完整数据的分类性能
Unsupervised feature selection based extreme learning machine for clustering基于无监督特征选择的极限学习机聚类
NEUROCOMPUTING
IF6.5

