arrow
返回

Topic Modeling in Embedding Spaces

delete2020-12-01
delete359
delete
OA
AI
A
Adji Bousso Dieng *
F
Francisco J. R. Ruiz
D
David M. Blei
DOI:10.1162/tacl_a_00325delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Topic modeling analyzes documents to learn meaningful patterns of words. However, existing topic models fail to learn interpretable topics when working with large and heavy-tailed vocabularies. To this end, we develop the embedded topic model (ETM), a generative model of documents that marries traditional topic models with word embeddings. More specifically, the ETM models each word with a categorical distribution whose natural parameter is the inner product between the word's embedding and an embedding of its assigned topic. To fit the ETM, we develop an efficient amortized variational inference algorithm. The ETM discovers interpretable topics even with large vocabularies that include rare words and stop words. It outperforms existing document models, such as latent Dirichlet allocation, in terms of both topic quality and predictive performance.
Keyword:
LANGUAGE
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

T
Transactions of the Association for Computational Linguistics
IF:
6.9
论文数:
486
被引数:
5.7K

机构

C
Columbia University
学者数:
7.1W
论文数: 6.4W
被引数: 263
引用论文

引用论文

err分享
err收藏
Understanding the Milieu Experiences of Patients on an Acute Inpatient Psychiatric Unit
err2010-08-01
err0
PREAI
errCatherine A. Thibeault; Kenneth Trudeau; Marguerite d’Entremont; Teresa Brown
err分享
err收藏
err分享
err收藏
An introduction to variational methods for graphical models
err1999-01-01
err2.3K
errOAAI
errJordan, MI; Ghahramani, Z; Jaakkola, TS; Saul, LK
err分享
err收藏
Probabilistic Topic Models
err2012-04-01
err3.7K
PREAI
errBlei, David M.
err分享
err收藏
Interleukin‐4 and interleukin‐10 modulate nuclear factor κB activity and nitric oxide synthase‐2 expression in Theiler's virus‐infected brain astrocytes
err2002-06-06
err0
errOAAI
errEduardo Molina‐Holgado; Angel Arévalo‐Martín; Antonio Castrillo; Lisardo Boscá; José M. Vela; Carmen Guaza
err分享
err收藏
Presence of Corticosterone and Cortisol in the Central and Peripheral Nervous System of the Cat1
err1968-05-01
err0
PREAI
errR. I. HENKIN; A. G. T. CASPER; R. BROWN; A. B. HARLAN; F. C. BARTTER
err分享
err收藏
没有更多内容