arrow
Return

Optimizing feature selection methods by removing irrelevant features using sparse least squares

delete2022-08-01
delete12
PRE
AI
H
Hamid Usefi *
DOI:10.1016/j.eswa.2022.116928delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Feature (variable) selection is recognized as an integral part of model construction in machine learning. One can use feature selection to remove redundant and irrelevant features. This in turn can help overcome the curse of dimensionality, reduce overfitting, and come up with interpretable models. In this paper, we propose Sparse Least Squares method (SLS) based on singular value decomposition and least squares to remove irrelevant features. We show that augmenting well-known feature selection methods with SLS significantly reduces the running time while improving or maintaining the prediction accuracy of the model.
Keywords:
Feature selection
Least squares
Singular value decomposition
Irrelevant features
Rank-1 update
Supervised learning

Journal

Expert Systems with Applications cover
Expert Systems with Applications
IF:
7.5
Papers:
3.0W
Citations:
10.2W

Organization

M
Memorial University Newfoundland
Scholars:
8.0K
Papers: 7.8K
Citations: 64
Cited Papers

Cited Papers

The Emerging Big Dimensionality
err2014-08-01
err180
errOAAI
errZhai, Yiteng; Ong, Yew-Soon; Tsang, Ivor W.
errShare
errSave
errShare
errSave
Sparse and stable gene selection with consensus SVM-RFE
err2012-01-01
err29
PREAI
errTapia, E.; Bulacio, P.; Angelone, L.
errShare
errSave
Gene selection for cancer classification using support vector machines
err2002-01-01
err7.5K
errOAAI
errGuyon, I; Weston, J; Barnhill, S; Vapnik, V
errShare
errSave
NCBI GEO: archive for functional genomics data sets-update
err2012-11-26
err7.3K
errOAAI
errBarrett, Tanya; Wilhite, Stephen E.; Ledoux, Pierre; Evangelista, Carlos; Kim, Irene F.; Tomashevsky, Maxim; Marshall, Kimberly A.; Phillippy, Katherine H.; Sherman, Patti M.; Holko, Michelle; Yefanov, Andrey; Lee, Hyeseung; Zhang, Naigong; Robertson, Cynthia L.; Serova, Nadezhda; Davis, Sean; Soboleva, Alexandra
errShare
errSave
researcher View more