返回
Unsupervised spectral feature selection algorithms for high dimensional data
DOI:10.1007/s11704-022-2135-0.png)
摘要
En 中文
It is a significant and challenging task to detect the informative features to carry out explainable analysis for high dimensional data, especially for those with very small number of samples. Feature selection especially the unsupervised ones are the right way to deal with this challenge and realize the task. Therefore, two unsupervised spectral feature selection algorithms are proposed in this paper. They group features using advanced Self-Tuning spectral clustering algorithm based on local standard deviation, so as to detect the global optimal feature clusters as far as possible. Then two feature ranking techniques, including cosine-similarity-based feature ranking and entropy-based feature ranking, are proposed, so that the representative feature of each cluster can be detected to comprise the feature subset on which the explainable classification system will be built. The effectiveness of the proposed algorithms is tested on high dimensional benchmark omics datasets and compared to peer methods, and the statistical test are conducted to determine whether or not the proposed spectral feature selection algorithms are significantly different from those of the peer methods. The extensive experiments demonstrate the proposed unsupervised spectral feature selection algorithms outperform the peer ones in comparison, especially the one based on cosine similarity feature ranking technique. The statistical test results show that the entropy feature ranking based spectral feature selection algorithm performs best. The detected features demonstrate strong discriminative capabilities in downstream classifiers for omics data, such that the AI system built on them would be reliable and explainable. It is especially significant in building transparent and trustworthy medical diagnostic systems from an interpretable AI perspective.
Keyword:
feature selection
spectral clustering
feature ranking techniques
entropy
cosine similarity
期刊
IF:
4.6
论文数:
1.6K
被引数:
2.8K
机构
引用论文
Gene expression profiles of prostate cancer reveal involvement of multiple molecular pathways in the metastatic process
BMC CANCER
IF3.4
Tinnitus Retraining Therapy (TRT) as a Method for Treatment of Tinnitus and Hyperacusis Patients耳鸣再训练疗法 (TRT) 作为治疗耳鸣和高亢患者的方法
Unsupervised feature selection based extreme learning machine for clustering基于无监督特征选择的极限学习机聚类
NEUROCOMPUTING
IF6.5
Diffuse large B-cell lymphoma outcome prediction by gene-expression profiling and supervised machine learning
NATURE MEDICINE
IF50

