.png){kind=icon}
.png){kind=icon}
Return
Hierarchical topic modeling with nested hierarchical Dirichlet process
.png){kind=icon}
PRE
AI
DOI：10.1631/jzus.A0820796.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
This paper deals with the statistical modeling of latent topic hierarchies in text corpora. The height of the topic tree is assumed as fixed, while the number of topics on each level as unknown a priori and to be inferred from data. Taking a nonparametric Bayesian approach to this problem, we propose a new probabilistic generative model based on the nested hierarchical Dirichlet process (nHDP) and present a Markov chain Monte Carlo sampling algorithm for the inference of the topic tree structure as well as the word distribution of each topic and topic distribution of each document. Our theoretical analysis and experiment results show that this model can produce a more compact hierarchical topic structure and captures more fine-grained topic relationships compared to the hierarchical latent Dirichlet allocation model.
Keywords:
Topic modeling
Natural language processing
Chinese restaurant process
Hierarchical Dirichlet process
Markov chain Monte Carlo
Nonparametric Bayesian statistics
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
IF:
4.9
Papers:
2.1K
Citations:
4.6K