arrow
返回

Regularized Gaussian discriminant analysis through eigenvalue decomposition

delete1996-12-01
delete144
delete
OA
AI
H
Halima Bensmail *
G
Gilles Celeux
DOI:10.2307/2291604delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Friedman proposed a regularization technique (RDA) of discriminant analysis in the Gaussian framework. RDA uses two regularization parameters to design an intermediate classifier between the linear, the quadratic, and the nearest-means classifiers. In this article we propose an alternative approach, called EDDA, that is based on the reparameterization of the covariance matrix [Sigma(k)] of a group G(k) in terms of its eigenvalue decomposition Sigma(k) = lambda(k)D(k)A(k)D(k)', where lambda(k) specifies the volume of density contours of G(k), the diagonal matrix of eigenvalues specifies its shape, and the eigenvectors specify its orientation. Variations on constraints concerning volumes, shapes, and orientations lambda(k), A(k), and D-k lead to 14 discrimination models of interest. For each model, we derived the normal theory maximum likelihood parameter estimates. Our approach consists of selecting a model by minimizing the sample-based estimate of future misclassification risk by cross-validation. Numerical experiments on simulated and real data show favorable behavior of this approach compared to RDA.
Keyword:
covariance matrix
maximum likelihood
normal-based classification
spectral decomposition

期刊

J
Journal of the American Statistical Association
IF:
3
论文数:
5.2K
被引数:
4.8W

机构

暂无机构信息
引用论文

引用论文

暂无论文信息