arrow
Return

PLS-based recursive feature elimination for high-dimensional small sample

delete2014-01-01
delete44
PRE
AI
W
Wenjie You
Z
Zijiang Yang
G
Guoli Ji *
DOI:10.1016/j.knosys.2013.10.004delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This paper focused on feature selection for high-dimensional small samples (HDSS). We first presented a general analytical framework for feature selection on a HDSS including selection strategy (single-feature ranking and multi-feature ranking) and evaluation criteria (feature subset consistency and compactness). Then we proposed partial least squares (PLS) based feature selection methods for HDSS and two theorems. The proposed methodologies include a PLS model for classification, parameter selection, PLSRanking, and PLS-based recursive feature elimination. Furthermore, we compared our proposed methods with several existing feature selection methods such as Support Vector Machine (SVM) based feature selection, SVM-based recursive feature elimination (SVMRFE), Random Forest (RF) based feature selection, RF-based recursive feature elimination (RFRFE), ReliefF algorithm and ReliefF-based recursive feature elimination (ReliefFRFE). Using twelve high-dimensional datasets from different areas of research, we evaluated the results in terms of accuracy (sensitivity and specificity), running time, and the feature subset consistency and compactness. The analysis demonstrated that the proposed approach from our research performed very well when handling both two-category and multi-category problems. (C) 2013 Elsevier B.V. All rights reserved.
Keywords:
High-dimensional small samples (HDSS)
Partial least squares (PLS)
Recursive feature elimination (RFE)
Feature subset consistency
Feature subset compactness
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

K
Knowledge-Based Systems
IF:
7.6
Papers:
1.2W
Citations:
4.5W

Organization

Y
york university - canada
Scholars:
8.3K
Papers: 9.0K
Citations: 10
X
xiamen university
Scholars:
5.8W
Papers: 3.8W
Citations: 67