arrow
返回

Unsupervised spectral feature selection algorithms for high dimensional data

delete2022-12-24
delete8
PRE
AI
王明钊 封面图
王明钊 (Mingzhao Wang)
H
Henry Han
黄昭 封面图
黄昭 (Zhao Hui Huang)
J
Juanying Xie *
DOI:10.1007/s11704-022-2135-0delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
It is a significant and challenging task to detect the informative features to carry out explainable analysis for high dimensional data, especially for those with very small number of samples. Feature selection especially the unsupervised ones are the right way to deal with this challenge and realize the task. Therefore, two unsupervised spectral feature selection algorithms are proposed in this paper. They group features using advanced Self-Tuning spectral clustering algorithm based on local standard deviation, so as to detect the global optimal feature clusters as far as possible. Then two feature ranking techniques, including cosine-similarity-based feature ranking and entropy-based feature ranking, are proposed, so that the representative feature of each cluster can be detected to comprise the feature subset on which the explainable classification system will be built. The effectiveness of the proposed algorithms is tested on high dimensional benchmark omics datasets and compared to peer methods, and the statistical test are conducted to determine whether or not the proposed spectral feature selection algorithms are significantly different from those of the peer methods. The extensive experiments demonstrate the proposed unsupervised spectral feature selection algorithms outperform the peer ones in comparison, especially the one based on cosine similarity feature ranking technique. The statistical test results show that the entropy feature ranking based spectral feature selection algorithm performs best. The detected features demonstrate strong discriminative capabilities in downstream classifiers for omics data, such that the AI system built on them would be reliable and explainable. It is especially significant in building transparent and trustworthy medical diagnostic systems from an interpretable AI perspective.
Keyword:
feature selection
spectral clustering
feature ranking techniques
entropy
cosine similarity

期刊

Frontiers of Computer Science 封面图
Frontiers of Computer Science
IF:
4.6
论文数:
1.6K
被引数:
2.8K

机构

B
Baylor University
学者数:
6.3K
论文数: 5.4K
被引数: 5.2K
S
Shaanxi Normal University
学者数:
1.6W
论文数: 1.1W
被引数: 1.7W
引用论文

引用论文

err分享
err收藏
Gene expression profiles of prostate cancer reveal involvement of multiple molecular pathways in the metastatic process
err2007-04-12
err472
errOAAI
errChandran, Uma R.; Ma, Changqing; Dhir, Rajiv; Bisceglia, Michelle; Lyons-Weiler, Maureen; Liang, Wenjing; Michalopoulos, George; Becich, Michael; Monzon, Federico A.
err分享
err收藏
A survey on online feature selection with streaming features
err2018-05-11
err56
PREAI
errHu, Xuegang; Zhou, Peng; Li, Peipei; Wang, Jing; Wu, Xindong
err分享
err收藏
Diffuse large B-cell lymphoma outcome prediction by gene-expression profiling and supervised machine learning
err2002-01-01
err2.1K
PREAI
errShipp, MA; Ross, KN; Tamayo, P; Weng, AP; Kutok, JL; Aguiar, RCT; Gaasenbeek, M; Angelo, M; Reich, M; Pinkus, GS; Ray, TS; Koval, MA; Last, KW; Norton, A; Lister, TA; Mesirov, J; Neuberg, DS; Lander, ES; Aster, JC; Golub, TR
err分享
err收藏
Spectral clustering with eigenvector selection based on entropy ranking
err2010-06-01
err74
PREAI
errZhao, Feng; Jiao, Licheng; Liu, Hanqiang; Gao, Xinbo; Gong, Maoguo
err分享
err收藏
学者 查看更多内容