Two-Stage Regularized Linear Discriminant Analysis for 2-D Data

Jianhua Zhao

doi:10.1109/TNNLS.2014.2350993

Two-Stage Regularized Linear Discriminant Analysis for 2-D Data

2015-08-01

19

PRE

AI

DOI：10.1109/TNNLS.2014.2350993

Original

Original request for help

Save

Abstract

En 中文

Fisher linear discriminant analysis (LDA) involves within-class and between-class covariance matrices. For 2-D data such as images, regularized LDA (RLDA) can improve LDA due to the regularized eigenvalues of the estimated within-class matrix. However, it fails to consider the eigenvectors and the estimated between-class matrix. To improve these two matrices simultaneously, we propose in this paper a new two-stage method for 2-D data, namely a bidirectional LDA (BLDA) in the first stage and the RLDA in the second stage, where both BLDA and RLDA are based on the Fisher criterion that tackles correlation. BLDA performs the LDA under special separable covariance constraints that incorporate the row and column correlations inherent in 2-D data. The main novelty is that we propose a simple but effective statistical test to determine the subspace dimensionality in the first stage. As a result, the first stage reduces the dimensionality substantially while keeping the significant discriminant information in the data. This enables the second stage to perform RLDA in a much lower dimensional subspace, and thus improves the two estimated matrices simultaneously. Experiments on a number of 2-D synthetic and real-world data sets show that BLDA+RLDA outperforms several closely related competitors.

Keywords:

2-D data

dimension reduction

linear discriminant analysis (LDA)

regularization

separable covariance

Two-Stage Regularized Linear Discriminant Analysis for 2-D Data

Abstract

AI Summary

Journal

Organization