arrow
Return

Dimensionality reduction using singular vectors

delete2021-02-15
delete4
delete
OA
AI
H
Hamid Usefi *
DOI:10.1038/s41598-021-83150-ydelete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
A common problem in machine learning and pattern recognition is the process of identifying the most relevant features, specifically in dealing with high-dimensional datasets in bioinformatics. In this paper, we propose a new feature selection method, called Singular-Vectors Feature Selection (SVFS). Let D=[A|b] be a labeled dataset, where b is the class label and features (attributes) are columns of matrix A. We show that the signature matrix SA=I-A dagger A can be used to partition the columns of A into clusters so that columns in a cluster correlate only with the columns in the same cluster. In the first step, SVFS uses the signature matrix SD of D to find the cluster that contains b. We reduce the size of A by discarding features in the other clusters as irrelevant features. In the next step, SVFS uses the signature matrix SA of reduced A to partition the remaining features into clusters and choose the most important features from each cluster. Even though SVFS works perfectly on synthetic datasets, comprehensive experiments on real world benchmark and genomic datasets shows that SVFS exhibits overall superior performance compared to the state-of-the-art feature selection methods in terms of accuracy, running time, and memory usage. A Python implementation of SVFS along with the datasets used in this paper are available at https://github.com/Majid1292/SVFS.
Keywords:
FEATURE-SELECTION
GENE SELECTION
ALGORITHM
INFORMATION
OPTIMIZATION
FRAMEWORK
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Scientific Reports cover
Scientific Reports
IF:
3.9
Papers:
28.0W
Citations:
83.5W

Organization

M
Memorial University Newfoundland
Scholars:
8.0K
Papers: 7.8K
Citations: 64
Cited Papers

Cited Papers

Molecular hydrogels of therapeutic agents
err2009-01-01
err0
PREAI
errFan Zhao; Man Lung Ma; Bing Xu
errShare
errSave
Gene-expression pro-files to predict distant metastasis of lymph-node-negative primary breast cancer
errLANCET
IF88.5
err2005-02-01
err2.6K
PREAI
errWang, YX; Klijn, JGM; Zhang, Y; Sieuwerts, A; Look, MP; Yang, F; Talantov, D; Timmermans, M; Meijer-van Gelder, ME; Yu, J; Jatkoe, T; Berns, EMJJ; Atkins, D; Foekens, JA
errShare
errSave
Least angle regression
err2004-04-01
err7.5K
errOAAI
errEfron, B; Hastie, T; Johnstone, I; Tibshirani, R
errShare
errSave
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
Benefits and limitations of genome-wide association studies
err2019-05-08
err1.2K
PREAI
errTam, Vivian; Patel, Nikunj; Turcotte, Michelle; Bosse, Yohan; Pare, Guillaume; Meyre, David
errShare
errSave
researcher View more