arrow
Return

Feature alignment as a generative process

delete2023-01-11
delete0
delete
OA
AI
T
Tiago de Souza Farias *
M
Maziero, Jonas
DOI:10.3389/frai.2022.1025148delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Reversibility in artificial neural networks allows us to retrieve the input given an output. We present feature alignment, a method for approximating reversibility in arbitrary neural networks. We train a network by minimizing the distance between the output of a data point and the random output with respect to a random input. We applied the technique to the MNIST, CIFAR-10, CelebA, and STL-10 image datasets. We demonstrate that this method can roughly recover images from just their latent representation without the need of a decoder. By utilizing the formulation of variational autoencoders, we demonstrate that it is possible to produce new images that are statistically comparable to the training data. Furthermore, we demonstrate that the quality of the images can be improved by coupling a generator and a discriminator together. In addition, we show how this method, with a few minor modifications, can be used to train networks locally, which has the potential to save computational memory resources.
Keywords:
machine learning
neural network
generative
reversibility
local training
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

F
Frontiers in Artificial Intelligence
IF:
4.7
Papers:
2.5K
Citations:
4.4K

Organization

U
universidade federal de santa maria - ufsm)
Scholars:
9.5K
Papers: 6.1K
Citations: 8
Cited Papers

Cited Papers

errShare
errSave
Mass Transport and Heat Transfer in the Microcirculation
err2015-01-01
err0
PREAI
errDavid A. Rubenstein; Wei Yin; Mary D. Frame
errShare
errSave
On Model-guided Neural Networks for System Identification
err2019-12-01
err0
PREAI
errLei Lu; Ying Tan; Denny Oetomo; Iven Mareels; Erying Zhao; Shi An
errShare
errSave
Beginning Adobe Experience Design
err
IF0
err2017-01-01
err0
errOAAI
errRob Huddleston
errShare
errSave
researcher View more