arrow
Return

Sparse kernel feature extraction via support vector learning

delete2018-01-01
delete7
PRE
AI
K
Kunzhe Wang
H
Huaitie Xiao *
DOI:10.1016/j.patrec.2017.11.023delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
'Kernel' principal component analysis (PCA) generalizes the standard PCA to its nonlinear counterpart while retaining the elegance by solving a kernel eigenvalue problem. Unfortunately, the fact that each component is spanned by every training patterns leads to computational problems for feature extractors, as well as large storage requirements especially for datasets such as images and gene expression data: a weakness for PCA as a completely non-parametric algorithm. Inspired by the sparse solutions obtained from support vector machine (SVM), this paper exploits the possibility to introduce the merits of SVM into kernel PCA. The geometric interpretation of PCA as estimating the best-fit ellipsoid provides a way to parameterize kernel PCA. The associated optimal ellipsoid turns out to be a variant of SVM. Instead of computing the principal axes from the sample covariance, the proposed method diagonalizes a parametric covariance in feature space, consisting of support vectors. The resulting expansion for each principal component is sparse in that only support objects have nonzero weights. Experiments show that the proposed sparse kernel PCA (SKPCA) provides similar features and classification performance to the full non-sparse kernel PCA. (C) 2017 Elsevier B.V. All rights reserved.
Keywords:
Kernel principal component analysis
Sparse feature extractor
Support vector machine
Minimum volume covering ellipsoid
Kernel methods
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Pattern Recognition Letters cover
Pattern Recognition Letters
IF:
3.3
Papers:
7.9K
Citations:
1.6W

Organization

N
national university of defense technology - china
Scholars:
1.8W
Papers: 1.4W
Citations: 9