arrow
返回

Locally alignment based manifold learning for simultaneous feature selection and extraction in classification problems

delete2023-01-01
delete11
PRE
AI
M
Mohammad Hossein Moattar *
Y
Yahya Forghani
DOI:10.1016/j.knosys.2022.110088delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
Dimensionality reduction is an important step in increasing the performance of machine learning algorithms while decreasing the processing time. From feature reduction approaches, feature extraction is aimed to achieve better data representation while feature selection is meant to discard redundant features. The main contribution of this manuscript is to propose a hybrid feature selection and extraction approach which performs these tasks in a unified framework, simultaneously. Also, the proposed approach aims to maintain the manifold of data using locally alignment constrains. The main goal of these suggestions is to discriminate different classes while reducing the redundancy of the samples specially for the imbalanced data classification problems. The proposed approach optimizes a hybrid objective function that tries to both increase the between class discrimination and decrease the within class distribution while minimizing the information loss. Also, we have embedded a weighting factor into the objective function to achieve a basis for feature importance measurement and feature selection. To evaluate the proposed approach, a multiclass linear SVM classifier is applied on the reduced data in a k-fold cross-validation scheme, and the accuracy, as well as F-score, is used as the performance measure. Comparisons of the proposed method with some recent approaches on 12 datasets of UCI, show the superiority of the proposed method over previously proposed approaches. Also, Friedman and Nemenyi tests are applied which show significant improvement in the proposed approach.(c) 2022 Published by Elsevier B.V.
Keyword:
Feature selection
Feature extraction
Locality alignment
Manifold learning
High dimensionality
Error bound minimization

期刊

K
Knowledge-Based Systems
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

I
Islamic Azad University
学者数:
4.0W
论文数: 3.3W
被引数: 9.8K
引用论文

引用论文

err分享
err收藏
Encapsulation of L-Histidine Amino Acid Inside Single-Walled Carbon Nanotubes
err2016-05-01
err0
PREAI
errHakim AL Garalleh; Ngamta Thamwattana; Barry J. Cox; James M. Hill
err分享
err收藏
Avaliação da simulação ou esforço insuficiente com o Rey 15-Item Memory Test (15-IMT): Estudos de validação em grupos de adultos idosos
err2012-12-06
err0
errOAAI
errMário Simões; Liliana Sousa; Paula Duarte; Horácio Firmino; Maria Salomé Pinho; Nuno Gaspar; Luís Pires; Pedro Batista; Ana Rita Silva; Sandra Silva; Ana Rita Ferreira; Sara França
err分享
err收藏
err分享
err收藏
学者 查看更多内容