arrow
返回

Unsupervised feature selection using sparse manifold learning: Auto-encoder approach

delete2025-01-01
delete2
PRE
AI
A
Amir Moslemi
M
Mina Jamshidi *
DOI:10.1016/j.ipm.2024.103923delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Feature selection techniques are widely being used as a preprocessing step to train machine learning algorithms to circumvent the curse of dimensionality, overfitting, and computation time challenges. Projection-based methods are frequently employed in feature selection, leveraging the extraction of linear relationships among features. The absence of nonlinear information extraction among features is notable in this context. While auto-encoder based techniques have recently gained traction for feature selection, their focus remains primarily on the encoding phase, as it is through this phase that the selected features are derived. The subtle point is that the performance of auto-encoder to obtain the most discriminative features is significantly affected by decoding phase. To address these challenges, in this paper, we proposed a novel feature selection based on auto-encoder to not only extracting nonlinear information among features but also decoding phase is regularized as well to enhance the performance of algorithm. In this study, we defined a new model of auto-encoder to preserve the topological information of reconstructed close to input data. To geometric structure of input data is preserved in projected space using Laplacian graph, and geometrical projected space is preserved in reconstructed space using a suitable term (abstract Laplacian graph of reconstructed data) in optimization problem. Preserving abstract Laplacian graph of reconstructed data close to Laplacian graph of input data affects the performance of feature selection and we experimentally showed this. Therefore, we show an effective approach to solve the objective of the corresponding problem. Since this approach can be mainly used for clustering aims, we conducted experiments on ten benchmark datasets and assessed our propped method based on clustering accuracy and normalized mutual information (NMI) metric. Our method obtained considerable superiority over recent state-of-the-art techniques in terms of NMI and accuracy.
Keyword:
Feature selection
Auto-encoder
Manifold structure

期刊

I
Information Processing and Management
IF:
6.9
论文数:
5.2K
被引数:
1.4W

机构

Graduate University of Advanced Technology 封面图
Graduate University of Advanced Technology
学者数:
1.1K
论文数: 1.1K
被引数: 1.3K
引用论文

引用论文

Subspace learning for unsupervised feature selection via matrix factorization
err2015-01-01
err142
PREAI
errWang, Shiping; Pedrycz, Witold; Zhu, Qingxin; Zhu, William
err分享
err收藏
Recurrence of Acute Disseminated Encephalomyelitis at the Previously Affected Brain Site
err2001-05-01
err0
PREAI
errOren Cohen; Bettina Steiner-Birmanns; Iftah Biran; Oded Abramsky; Sylvia Honigman; Israel Steiner
err分享
err收藏
Decoding clinical biomarker space of COVID-19: Exploring matrix factorization-based feature selection methods
err2022-07-01
err43
errOAAI
errSaberi-Movahed, Farshad; Mohammadifard, Mahyar; Mehrpooya, Adel; Rezaei-Ravari, Mohammad; Berahmand, Kamal; Rostami, Mehrdad; Karami, Saeed; Najafzadeh, Mohammad; Hajinezhad, Davood; Jamshidi, Mina; Abedi, Farshid; Mohammadifard, Mahtab; Farbod, Elnaz; Safavi, Farinaz; Dorvash, Mohammadreza; Mottaghi-Dastjerdi, Negar; Vahedi, Shahrzad; Eftekhari, Mahdi; Saberi-Movahed, Farid; Alinejad-Rokny, Hamid; Band, Shahab S.; Tavassoly, Iman
err分享
err收藏
Quantitative CT Lung Imaging and Machine Learning Improves Prediction of Emergency Room Visits and Hospitalizations in COPD
err2023-04-01
err16
PREAI
errMoslemi, Amir; Makimoto, Kalysta; Tan, Wan C.; Bourbeau, Jean; Hogg, James C.; Coxson, Harvey O.; Kirby, Miranda
err分享
err收藏
Dual Regularized Unsupervised Feature Selection Based on Matrix Factorization and Minimum Redundancy with application in gene selection
err2022-11-01
err59
errOAAI
errSaberi-Movahed, Farid; Rostami, Mehrdad; Berahmand, Kamal; Karami, Saeed; Tiwari, Prayag; Oussalah, Mourad; Band, Shahab S.
err分享
err收藏
Adaptive orthogonal semi-supervised feature selection with reliable label matrix learning
err2024-07-01
err4
PREAI
errLiao, Huming; Chen, Hongmei; Yin, Tengyu; Horng, Shi-Jinn; Li, Tianrui
err分享
err收藏
学者 查看更多内容