.png){kind=icon}
返回
A topic modeling and image classification framework: The Generalized Dirichlet variational autoencoder
.png){kind=icon}
PRE
AI
DOI：10.1016/j.patcog.2023.110037.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Latent Dirichlet allocation model (LDA) has been widely used in topic modeling. Recent works have shown the effectiveness of integrating neural network mechanisms with this generative model for learning text representation. However, one of the significant setbacks of LDA is that it is based on a Dirichlet prior that has a restrictive covariance structure. All its variables are considered to be negatively correlated, which makes the model restrictive. In a practical sense, topics can be positively or negatively correlated. To address this problem, we proposed a generalized Dirichlet variational autoencoder (GD-VAE) for topic modeling. The Generalized Dirichlet (GD) distribution has a more general covariance structure than the Dirichlet distribution because it takes into account both positively and negatively correlated topics in the corpus. Our proposed model leverages rejection sampling variational inference using a reparameterization trick for effective training. GDVAE compares favorably to recent works on topic models on several benchmark corpora. Experiments show that accounting for topics' positive and negative correlations results in better performance. We further validate the superiority of our proposed framework on two image data sets. GD-VAE demonstrates its significance as an integral part of a classification architecture. For reproducibility and further research purposes, code for this work can be found at https://github.com/hormone03/GD-VAE.
Keyword:
Generalized Dirichlet distribution
Correlation
Variational autoencoder
Topic models
Reparameterization
Image classification
期刊
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
分享收藏Data-free metrics for Dirichlet and generalized Dirichlet mixture-based HMMs - A practical study.png)
PATTERN RECOGNITION
OAAI
PATTERN RECOGNITIONIF7.6
OAAI分享收藏A Decomposition Dynamic graph convolutional recurrent network for traffic forecasting用于流量预测的分解动态图卷积递归网络PATTERN RECOGNITION
PATTERN RECOGNITIONIF7.6
PREAI
分享收藏EEG-based classification combining Bayesian convolutional neural networks with recurrence plot for motor movement/imageryPATTERN RECOGNITION
PATTERN RECOGNITIONIF7.6
PREAI
分享收藏MinEnt: Minimum entropy for self-supervised representation learning基于最小熵的自监督表示学习算法PATTERN RECOGNITION
PATTERN RECOGNITIONIF7.6
PREAI
分享收藏
查看更多内容