arrow
Return

Supervised principal component analysis: Visualization, classification and regression on subspaces and submanifolds

delete2011-07-01
delete241
PRE
AI
A
Ali Ghodsi
Z
Zohreh Azimifar *
M
Mansoor Zolghadri Jahromi
DOI:10.1016/j.patcog.2010.12.015delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We propose supervised principal component analysis (supervised PCA), a generalization of PCA that is uniquely effective for regression and classification problems with high-dimensional input data. It works by estimating a sequence of principal components that have maximal dependence on the response variable. The proposed supervised PCA is solvable in closed-form, and has a dual formulation that significantly reduces the computational complexity of problems in which the number of predictors greatly exceeds the number of observations (such as DNA microarray experiments). Furthermore, we show how the algorithm can be kernelized, which makes it applicable to non-linear dimensionality reduction tasks. Experimental results on various visualization, classification and regression problems show significant improvement over other supervised approaches both in accuracy and computational efficiency. (c) 2011 Elsevier Ltd. All rights reserved.
Keywords:
Dimensionality reduction
Principal component analysis (PCA)
Kernel methods
Supervised learning
Visualization
Classification
Regression
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

U
University of Waterloo
Scholars:
2.2W
Papers: 2.3W
Citations: 3.3W
S
Shiraz University
Scholars:
8.1K
Papers: 7.5K
Citations: 7.4K