Return
FREL: A Stable Feature Selection Algorithm
DOI:10.1109/TNNLS.2014.2341627.png)
Abstract
En 中文
Two factors characterize a good feature selection algorithm: its accuracy and stability. This paper aims at introducing a new approach to stable feature selection algorithms. The innovation of this paper centers on a class of stable feature selection algorithms called feature weighting as regularized energy-based learning (FREL). Stability properties of FREL using L1 or L2 regularization are investigated. In addition, as a commonly adopted implementation strategy for enhanced stability, an ensemble FREL is proposed. A stability bound for the ensemble FREL is also presented. Our experiments using open source real microarray data, which are challenging high dimensionality small sample size problems demonstrate that our proposed ensemble FREL is not only stable but also achieves better or comparable accuracy than some other popular stable feature weighting methods.
Keywords:
Energy-based learning
ensemble
feature selection
feature weighting
uniform weighting stability
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
IF:
8.9
Papers:
7.5K
Citations:
7.2W
Organization
Cited Papers
A Unified Framework for High-Dimensional Analysis of M-Estimators with Decomposable Regularizers
STATISTICAL SCIENCE
IF3.4

