Self-weighted Robust LDA for Multiclass Classification with Edge Classes

Caixia Yan

doi:10.1145/3418284

Self-weighted Robust LDA for Multiclass Classification with Edge Classes

2020-12-22

83

OA

AI

DOI：10.1145/3418284

Save

View PDF

Abstract

En 中文

Linear discriminant analysis (LDA) is a popular technique to learn the most discriminative features for multi-class classification. A vast majority of existing LDA algorithms are prone to be dominated by the class with very large deviation from the others, i.e., edge class, which occurs frequently in multi-class classification. First, the existence of edge classes often makes the total mean biased in the calculation of between-class scatter matrix. Second, the exploitation of l(2)-norm based between-class distance criterion magnifies the extremely large distance corresponding to edge class. In this regard, a novel self-weighted robust LDA with l(2,1)-norm based pairwise between-class distance criterion, called SWRLDA, is proposed for multi-class classification especially with edge classes. SWRLDA can automatically avoid the optimal mean calculation and simultaneously learn adaptive weights for each class pair without setting any additional parameter. An efficient re-weighted algorithm is exploited to derive the global optimum of the challenging l(2,1)-norm maximization problem. The proposed SWRLDA is easy to implement and converges fast in practice. Extensive experiments demonstrate that SWRLDA performs favorably against other compared methods on both synthetic and real-world datasets while presenting superior computational efficiency in comparison with other techniques.

Keywords:

Robust linear discriminant analysis

dimension reduction

multi-class classification

edge class

Self-weighted Robust LDA for Multiclass Classification with Edge Classes

Abstract

AI Summary

Journal

Organization