arrow
Return

Bi-level ensemble method for unsupervised feature selection

delete2023-12-01
delete10
PRE
AI
周
周芃 (Peng Zhou) *
王
王霞 (Xia Wang)
杜亮 cover
杜亮 (Liang Du)
DOI:10.1016/j.inffus.2023.101910delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Unsupervised feature selection is an important machine learning task and thus attracts increasingly more attention. However, due to the absence of labels, unsupervised feature selection often suffers from stability and robustness problems. To tackle these problems, some works try to ensemble multiple feature selection results to obtain a consensus result. Most of the existing methods do the ensemble on the feature level, i.e., they directly ensemble feature selection results by feature ranking or voting aggregation, without paying any attention to the following downstream tasks. In this paper, we take clustering as the downstream task and wish to ensemble the base results to select features which are appropriate for clustering. To this end, we propose a novel bi-level feature selection ensemble method, which ensembles on two levels: the feature level and the clustering level. Together with feature level ensemble, we also learn a consensus clustering result from base feature selection results with self-paced learning. Then, we apply the consensus clustering result to guide the feature selection in turn. Extensive experiments are conducted to demonstrate that the proposed method outperforms other state-of-the-art feature selection and feature selection ensemble methods in the clustering task. The codes of this paper are released in https://doctor-nobody.github.io/codes/BLFSE.zip.
Keywords:
Ensemble learning
Feature selection
Clustering ensemble

Journal

Information Fusion cover
Information Fusion
IF:
15.5
Papers:
4.3K
Citations:
2.7W

Organization

S
Shanxi University
Scholars:
1.3W
Papers: 8.4K
Citations: 1.2W
A
anhui university
Scholars:
1.9W
Papers: 1.2W
Citations: 24
Cited Papers

Cited Papers

An Adaptive Semisupervised Feature Analysis for Video Semantic Recognition
err2018-02-01
err279
PREAI
errLuo, Minnan; Chang, Xiaojun; Nie, Liqiang; Yang, Yi; Hauptmann, Alexander G.; Zheng, Qinghua
errShare
errSave
Adaptive Semi-Supervised Feature Selection for Cross-Modal Retrieval
err2019-05-01
err124
PREAI
errYu, En; Sun, Jiande; Li, Jing; Chang, Xiaojun; Han, Xian-Hua; Hauptmann, Alexander G.
errShare
errSave
Unsupervised feature selection via latent representation learning and manifold regularization
err2019-09-01
err104
PREAI
errTang, Chang; Bian, Meiru; Liu, Xinwang; Li, Miaomiao; Zhou, Hua; Wang, Pichao; Yin, Hailin
errShare
errSave
Recurrence of Acute Disseminated Encephalomyelitis at the Previously Affected Brain Site
err2001-05-01
err0
PREAI
errOren Cohen; Bettina Steiner-Birmanns; Iftah Biran; Oded Abramsky; Sylvia Honigman; Israel Steiner
errShare
errSave
errShare
errSave
Enhanced Ensemble Clustering via Fast Propagation of Cluster-Wise Similarities
err2021-01-01
err149
errOAAI
errHuang, Dong; Wang, Chang-Dong; Peng, Hongxing; Lai, Jianhuang; Kwoh, Chee-Keong
errShare
errSave
researcher View more