arrow
Return

Deep Mixture Generative Autoencoders

delete2022-10-01
delete26
delete
OA
AI
F
Fei Ye
A
Adrian G. Borş *
DOI:10.1109/TNNLS.2021.3071401delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Variational autoencoders (VAEs) are one of the most popular unsupervised generative models that rely on learning latent representations of data. In this article, we extend the classical concept of Gaussian mixtures into the deep variational framework by proposing a mixture of VAEs (MVAE). Each component in the MVAE model is implemented by a variational encoder and has an associated subdecoder. The separation between the latent spaces modeled by different encoders is enforced using the d-variable Hilbert-Schmidt independence criterion (dHSIC). Each component would capture different data variational features. We also propose a mechanism for finding the appropriate number of VAE components for a given task, leading to an optimal architecture. The differentiable categorical Gumbel-softmax distribution is used in order to generate dropout masking parameters within the end-to-end backpropagation training framework. Extensive experiments show that the proposed MVAE model can learn a rich latent data representation and is able to discover additional underlying data representation factors.
Keywords:
Mixture models
Decoding
Data models
Training
Linear programming
Probabilistic logic
Task analysis
Generative deep learning
mixtures of variational autoencoders (MVAEs)
optimal number of components in mixtures
representation learning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Neural Networks and Learning Systems cover
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
Papers:
7.6K
Citations:
7.2W

Organization

U
university of york - uk
Scholars:
1.5W
Papers: 1.5W
Citations: 15
Cited Papers

Cited Papers

Relationship between trait anxiety, prefrontal cortex, and attention bias to angry faces in children and adolescents
err2008-10-01
err0
errOAAI
errEva H. Telzer; Karin Mogg; Brendan P. Bradley; Xiaoqin Mai; Monique Ernst; Daniel S. Pine; Christopher S. Monk
errShare
errSave
ChainForge: A Visual Toolkit for Prompt Engineering and LLM Hypothesis Testing
err2024-05-11
err0
errOAAI
errIan Arawjo; Chelse Swoopes; Priyan Vaithilingam; Martin Wattenberg; Elena L. Glassman
errShare
errSave
errShare
errSave
Quantized load distribution for tree and bus-connected processors
err2004-07-01
err0
PREAI
errGerassimos Barlas; Bharadwaj Veeravalli
errShare
errSave
researcher View more