arrow
返回

Hierarchical topic modeling with nested hierarchical Dirichlet process

delete2009-06-01
delete2
PRE
AI
Y
Yiqun Ding
S
Shanping Li *
Z
Zhen Zhang
沈
沈彬 (Bin Shen)
DOI:10.1631/jzus.A0820796delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This paper deals with the statistical modeling of latent topic hierarchies in text corpora. The height of the topic tree is assumed as fixed, while the number of topics on each level as unknown a priori and to be inferred from data. Taking a nonparametric Bayesian approach to this problem, we propose a new probabilistic generative model based on the nested hierarchical Dirichlet process (nHDP) and present a Markov chain Monte Carlo sampling algorithm for the inference of the topic tree structure as well as the word distribution of each topic and topic distribution of each document. Our theoretical analysis and experiment results show that this model can produce a more compact hierarchical topic structure and captures more fine-grained topic relationships compared to the hierarchical latent Dirichlet allocation model.
Keyword:
Topic modeling
Natural language processing
Chinese restaurant process
Hierarchical Dirichlet process
Markov chain Monte Carlo
Nonparametric Bayesian statistics
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Journal of Zhejiang University-SCIENCE B 封面图
Journal of Zhejiang University-SCIENCE B
IF:
4.9
论文数:
2.2K
被引数:
4.6K

机构

Z
zhejiang university
学者数:
17.7W
论文数: 12.1W
被引数: 152
引用论文

引用论文

err1999-01-01
err0
PREAI
errMaria Dolores Ochando; Francisco J. Ayala
err分享
err收藏
err分享
err收藏
Red Queen hypothesis supported by parasitism in sexual and clonal fish
err1990-04-01
err0
PREAI
errCurtis M. Lively; Clark Craddock; Robert C. Vrijenhoek
err分享
err收藏
Biostratigraphy of some marine manganese nodules
err1976-04-01
err0
PREAI
errKENICHI HARADA; SHIRO NISHIDA
err分享
err收藏
Tree Root Intrusion in Sewer Systems: Review of Extent and Costs
err2001-03-01
err0
PREAI
errThomas B. Randrup; E. Gregory McPherson; Laurence R. Costello
err分享
err收藏
err分享
err收藏
学者 查看更多内容