Two phase cooperative learning for supervised dimensionality reduction

doi:10.1016/j.patcog.2023.109871

Two phase cooperative learning for supervised dimensionality reduction

2023-12-01

2

PRE

AI

S

Sotiris K. Tasoulis

S

Spiros V. Georgakopoulos

V

Vassilis P. Plagianakos

DOI：10.1016/j.patcog.2023.109871

Original

Original request for help

Save

Abstract

En 中文

The simultaneous minimization of the reconstruction and classification error is a hard non convex problem, especially when a non-linear mapping is utilized. To overcome this obstacle, motivated by the widespread success of Cooperative Neural Networks, an innovative supervised dimensionality reduction framework is proposed, based on a cooperative two phase optimization strategy. Specifically, the proposed framework that requires minimal parameter adjustment consists of an autoencoder for dimensionality reduction and a separator network for separability assessment of the embedding. This scheme results in meaningful and discriminable codes, which are optimized for the classification task and are exploitable by any trainable classifier. The experimental results showed that the proposed methodology achieved competitive results against the state-of-the-art competing methods, while being much more efficient in terms of parameter count. Finally, it was empirically justified that the proposed methodology introduces advanced behavioural explainability, while enabling applicability for image generation tasks.

Keywords:

Artificial neural networks

Deep learning

Dimensionality reduction

Autoencoders

Image classification

Two phase cooperative learning for supervised dimensionality reduction

Abstract

Journal

Organization