.png){kind=icon}
Return
A topic modeling and image classification framework: The Generalized Dirichlet variational autoencoder
.png){kind=icon}
PRE
AI
DOI：10.1016/j.patcog.2023.110037.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Latent Dirichlet allocation model (LDA) has been widely used in topic modeling. Recent works have shown the effectiveness of integrating neural network mechanisms with this generative model for learning text representation. However, one of the significant setbacks of LDA is that it is based on a Dirichlet prior that has a restrictive covariance structure. All its variables are considered to be negatively correlated, which makes the model restrictive. In a practical sense, topics can be positively or negatively correlated. To address this problem, we proposed a generalized Dirichlet variational autoencoder (GD-VAE) for topic modeling. The Generalized Dirichlet (GD) distribution has a more general covariance structure than the Dirichlet distribution because it takes into account both positively and negatively correlated topics in the corpus. Our proposed model leverages rejection sampling variational inference using a reparameterization trick for effective training. GDVAE compares favorably to recent works on topic models on several benchmark corpora. Experiments show that accounting for topics' positive and negative correlations results in better performance. We further validate the superiority of our proposed framework on two image data sets. GD-VAE demonstrates its significance as an integral part of a classification architecture. For reproducibility and further research purposes, code for this work can be found at https://github.com/hormone03/GD-VAE.
Keywords:
Generalized Dirichlet distribution
Correlation
Variational autoencoder
Topic models
Reparameterization
Image classification
Journal
IF:
7.6
Papers:
1.3W
Citations:
4.5W
Organization
Cited Papers
ShareSaveData-free metrics for Dirichlet and generalized Dirichlet mixture-based HMMs - A practical study.png)
PATTERN RECOGNITION
OAAI
PATTERN RECOGNITIONIF7.6
OAAIShareSaveA Decomposition Dynamic graph convolutional recurrent network for traffic forecastingPATTERN RECOGNITION
PATTERN RECOGNITIONIF7.6
PREAI
ShareSaveEEG-based classification combining Bayesian convolutional neural networks with recurrence plot for motor movement/imageryPATTERN RECOGNITION
PATTERN RECOGNITIONIF7.6
PREAI
ShareSaveShareSaveShareSaveShareSave
View more