arrow
Return

Wasserstein discriminant analysis

delete2018-05-18
delete61
delete
OA
AI
R
Rémi Flamary *
M
Marco Cuturi
N
Nicolas Courty
A
Alain Rakotomamonjy
DOI:10.1007/s10994-018-5717-1delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Wasserstein discriminant analysis (WDA) is a new supervised linear dimensionality reduction algorithm. Following the blueprint of classical Fisher Discriminant Analysis, WDA selects the projection matrix that maximizes the ratio of the dispersion of projected points pertaining to different classes and the dispersion of projected points belonging to a same class. To quantify dispersion, WDA uses regularized Wasserstein distances. Thanks to the underlying principles of optimal transport, WDA is able to capture both global (at distribution scale) and local (at samples' scale) interactions between classes. In addition, we show that WDA leverages a mechanism that induces neighborhood preservation. Regularized Wasserstein distances can be computed using the Sinkhorn matrix scaling algorithm; the optimization problem of WDA can be tackled using automatic differentiation of Sinkhorn's fixed-point iterations. Numerical experiments show promising results both in terms of prediction and visualization on toy examples and real datasets such as MNIST and on deep features obtained from a subset of the Caltech dataset.
Keywords:
Linear discriminant analysis
Optimal transport
Wasserstein distance
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.6K
Citations:
3.4W

Organization

O
observatoire de la cote d'azur
Scholars:
2.4K
Papers: 1.7K
Citations: 7
E
Ecole Polytechnique
Scholars:
6.6K
Papers: 4.8K
Citations: 211
I
institut polytechnique de paris
Scholars:
1.3W
Papers: 1.0W
Citations: 6
researcher View more organizations