arrow
Return

A general kernelization framework for learning algorithms based on kernel PCA

delete2010-01-01
delete91
PRE
AI
C
Changshui Zhang
聂飞平 (Feiping Nie) *
向世明 (Shiming Xiang)
DOI:10.1016/j.neucom.2009.08.014delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this paper, a general kernelization framework for learning algorithms is proposed via a two-stage procedure, i.e., transforming data by kernel principal component analysis (KPCA), and then directly performing the learning algorithm with the transformed data. It is worth noting that although a very few learning algorithms were also kernelized by this procedure before, why and under what condition this procedure is feasible have not been further studied. In this paper, we explicitly present this kernelization framework, and give a rigorous justification to reveal that under some mild conditions, the kernelization under this framework is equivalent to traditional kernel method. We show that these mild conditions are usually satisfied in most of learning algorithms. Therefore, most of learning algorithms can be kernelized under this framework without having to reformulate it into inner product form, which is a common yet vital step in traditional kernel methods. Enlightened by this framework, we also propose a novel kernel method based on the low-rank KPCA, which could be used to remove the noise in the feature space, speed up the kernel algorithm and improve the numerical stability for the kernel algorithm. Experiments are presented to verify the validity and effectiveness of the proposed methods. (C) 2009 Elsevier B.V. All rights reserved.
Keywords:
Kernel method
Learning algorithm
Kernel PCA
Two-stage framework
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

T
tsinghua university
Scholars:
11.9W
Papers: 10.0W
Citations: 137
Cited Papers

Cited Papers

The total synthesis of (±)-geneserine
err1986-01-01
err0
PREAI
errKozo Shishido; Kou Hiroya; Hironori Komatsu; Keiichiro Fukumoto; Tetsuji Kametani
errShare
errSave
Nonlinear Component Analysis as a Kernel Eigenvalue Problem
err1998-07-01
err0
errOAAI
errBernhard Schölkopf; Alexander Smola; Klaus-Robert Müller
errShare
errSave
Solution structure of 5-keto-D-fructose: relevance to the specificity of hexose kinases
err2002-05-01
err0
PREAI
errJohn S. Blanchard; C. F. Brewer; Sasha Englard; Gad Avigad
errShare
errSave
DemoCut
err2013-10-08
err0
errOAAI
errPei-Yu Chi; Joyce Liu; Jason Linder; Mira Dontcheva; Wilmot Li; Bjoern Hartmann
errShare
errSave
Can primary care research be conducted more efficiently using routinely reported practice-level data: a cluster randomised controlled trial conducted in England?
err2022-07-01
err0
errOAAI
errPeter S Blair; Jenny Ingram; Clare Clement; Grace Young; Penny Seume; Jodi Taylor; Christie Cabral; Patricia Jane Lucas; Elizabeth Beech; Jeremy Horwood; Padraig Dixon; Martin C Gulliford; Nick Francis; Sam T Creavin; Athene Lane; Scott Bevan; Alastair D Hay
errShare
errSave
researcher View more