返回
Linear Centroid Encoder for Supervised Principal Component Analysis
DOI:10.1016/j.patcog.2024.110634.png)
摘要
En 中文
We propose a new supervised dimensionality reduction technique called Supervised Linear Centroid-Encoder (SLCE), a linear counterpart of the nonlinear Centroid-Encoder (CE) (Ghosh and Kirby, 2022). SLCE works by mapping the samples of a class to its class centroid using a linear transformation. The transformation is a projection that reconstructs a point such that its distance from the corresponding class centroid, i.e., centroid-reconstruction loss, is minimized in the ambient space. We derive a closed-form solution using an eigendecomposition of a symmetric matrix. We did a detailed analysis and presented some crucial mathematical properties of the proposed approach. We establish a connection between the eigenvalues and the centroidreconstruction loss. In contrast to Principal Component Analysis (PCA) which reconstructs a sample in the ambient space, the transformation of SLCE uses the instances of a class to rebuild the corresponding class centroid. Therefore the proposed method can be considered a form of supervised PCA. Experimental results show the performance advantage of SLCE over other supervised methods.
Keyword:
Supervised Linear Centroid-Encoder
Centroid-Encoder
Principal component analysis (PCA)
Supervised PCA
Linear dimensionality reduction
Supervised dimensionality reduction
期刊
IF:
7.6
论文数:
1.4W
被引数:
6.1W
机构
引用论文
Two phase cooperative learning for supervised dimensionality reduction用于监督降维的两阶段协作学习
PATTERN RECOGNITION
IF7.6
Stratified feature sampling method for ensemble clustering of high dimensional data高维数据集成聚类的分层特征抽样方法
PATTERN RECOGNITION
IF7.6

