arrow
Return

An Improved Binary Quadratic Discriminant Analysis Classifier by Using Robust Regularization

delete2024-01-01
delete0
delete
OA
AI
A
Alam Zaib
S
Shahid Khattak
G
Ghulam Mujtaba
S
Shahid Khan
A
Amal Al‐Rasheed *
DOI:10.1109/ACCESS.2024.3437246delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In many real classification problems where a limited number of training samples is available, the linear classifiers based on discriminant analysis are unable to deliver accurate results. Moreover, the testing and/or the training data can be erroneous due to noise contamination which further degrades their performance. Regularization techniques become imperative to deal with these problems. However, the existing regularization techniques, to some extent, mainly focus on data scarcity issues but completely ignore the noisy nature of the testing and/or the training data. We propose a novel regularized quadratic discriminant analysis (R-QDA) classifier which addresses both issues simultaneously. The procedure involves a reformulation of the discriminant function of the conventional QDA classifier into least square problems and then solving them by using regularized least squares (Reg-LS) based on $\ell _{2}$ -norm. In contrast to existing R-QDA techniques, the proposed R-QDA classifier employs two regularization parameters pertaining to each class, which can be independently selected by various robust techniques. Numerical results demonstrate the effectiveness of the proposed method over classical R-QDA methods, especially in high noise regimes.
Keywords:
Covariance matrices
Training data
Noise measurement
Perturbation methods
Distributed databases
Classification algorithms
Discriminant analysis
LDA
QDA
regularization
data classification

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

P
Princess Nourah bint Abdulrahman University
Scholars:
8.0K
Papers: 9.4K
Citations: 10
C
comsats university islamabad (cui)
Scholars:
1.1W
Papers: 1.1W
Citations: 7