arrow
Return

Cloud-VAE: Variational autoencoder with concepts emb e dde d

delete2023-08-01
delete9
PRE
AI
Y
Yue Liu *
李双 cover
李双 (Shuang Li)
Q
Qun Liu
G
Guoyin Wang
DOI:10.1016/j.patcog.2023.109530delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Variational Autoencoder (VAE) has been widely and successfully used in learning coherent latent repre-sentation of data. However, the lack of interpretability in the latent space constructed by the VAE under the prior distribution is still an urgent problem. This paper proposes a VAE with understandable concept embedding named Cloud-VAE, which constructs interpretable latent space by disentangling the latent variables and considering their uncertainty based on cloud model. Firstly, cloud model-based clustering algorithm cast initial constraint of latent space into a prior distribution of concept which can be em-bedded into the latent space of the VAE to disentangle the latent variables. Secondly, reparameterization trick based on forward cloud transformation algorithm is designed to estimate the latent space concept by increasing the randomness of latent variables. Furthermore, variational lower bound of Cloud-VAE is derived to guide the training process to construct concepts of latent space, realizing the mutual mapping between latent space and concept space. Finally, experimental results on 6 benchmark datasets show that Cloud-VAE has good clustering and reconstruction performance, which can explicitly explain the aggre-gation process of the model and discover more interpretable disentangled representations.& COPY; 2023 Elsevier Ltd. All rights reserved.
Keywords:
Variational autoencoder
Disentangled representation
Concept embedded
Cloud Model
Deep Learning Interpretability

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

C
chongqing university of posts & telecommunications
Scholars:
6.7K
Papers: 5.3K
Citations: 5
S
shanghai university
Scholars:
3.9W
Papers: 2.7W
Citations: 52