arrow
Return

Elastic-Net Prefiltering for Two-Class Classification

delete2013-02-01
delete5
delete
OA
AI
H
Hong Xia *
S
Sheng Chen
C
C.J. Harris
DOI:10.1109/TSMCB.2012.2205677delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
A two-stage linear-in-the-parameter model construction algorithm is proposed aimed at noisy two-class classification problems. The purpose of the first stage is to produce a prefiltered signal that is used as the desired output for the second stage which constructs a sparse linear-in-the-parameter classifier. The prefiltering stage is a two-level process aimed at maximizing a model's generalization capability, in which a new elastic-net model identification algorithm using singular value decomposition is employed at the lower level, and then, two regularization parameters are optimized using a particle-swarm-optimization algorithm at the upper level by minimizing the leave-one-out (LOO) misclassification rate. It is shown that the LOO misclassification rate based on the resultant prefiltered signal can be analytically computed without splitting the data set, and the associated computational cost is minimal due to orthogonality. The second stage of sparse classifier construction is based on orthogonal forward regression with the D-optimality algorithm. Extensive simulations of this approach for noisy data sets illustrate the competitiveness of this approach to classification of noisy data problems.
Keywords:
Cross-validation (CV)
elastic net (EN)
forward regression
leave-one-out (LOO) errors
linear-in-the-parameter model
regularization
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Cybernetics cover
IEEE Transactions on Cybernetics
IF:
10.5
Papers:
1.1W
Citations:
5.0W

Organization

U
university of southampton
Scholars:
3.3W
Papers: 3.2W
Citations: 52
U
University of Reading
Scholars:
1.0W
Papers: 1.1W
Citations: 1.7W