Learning Robust Representations by Autoencoders With Dynamical Implicit Mapping

doi:10.1109/LSP.2025.3544969

Learning Robust Representations by Autoencoders With Dynamical Implicit Mapping

2025-01-01

0

PRE

AI

DOI：10.1109/LSP.2025.3544969

Original

Original request for help

Save

Abstract

En 中文

Autoencoder is an unsupervised neural network that learns effective representations of data and has wide applications in feature learning, data compression, etc. However, Autoencoder is very sensitive to noise, resulting in low generalization and robustness of the model. To solve this problem, we propose a stable and efficient Autoencoder model called nmFunc-Autoencoder. Inspired by the Neural Memory Ordinary Differential Equation, the Neural Memory Activation Function uses its excellent dynamic nonlinear implicit mapping to establish a mapping relationship between external inputs and stable values to ensure the stability of distinguishable feature extraction, thereby performing better robustness when subjected to noise attacks. We conduct robustness experiments to evaluate its performance. The result showed that compared with other Autoencoder models, the data features extracted by the proposed model are more robust. Subsequently, in the execution efficiency experiments and ablation study, the model was shown to be low-cost and effective.

Keywords:

Feature extraction

Noise

Mathematical models

Autoencoders

Robustness

Data models

Noise reduction

Training

Neural networks

Ordinary differential equations

noise robustness

autoencoders

neural ordinary differential equations

Learning Robust Representations by Autoencoders With Dynamical Implicit Mapping

Abstract

Journal

Organization