Combine Topic Modeling with Semantic Embedding: Embedding Enhanced Topic Model

doi:10.1109/TKDE.2019.2922179

Combine Topic Modeling with Semantic Embedding: Embedding Enhanced Topic Model

2020-12-01

16

PRE

AI

DOI：10.1109/TKDE.2019.2922179

Original

Original request for help

Save

Abstract

En 中文

Topic model and word embedding reflect two perspectives of text semantics. Topic model maps documents into topic distribution space by utilizing word collocation patterns within and across documents, while word embedding represents words within a continuous embedding space by exploiting the local word collocation patterns in context windows. Clearly, these two types of patterns are complementary. In this paper, we propose a novel integration framework to combine the two representation methods, where topic information can be transmitted into corresponding semantic embedding structure. Based on this framework, we construct a Embedding Enhanced Topic Model (EETM), which can improve topic modeling and generate topic embeddings by leveraging the word embedding. Extensive experimental results show that EETM can learn high-quality document representations for common text analysis tasks across multiple data sets, indicating it is very effective for merging topic models with word embeddings.

Keywords:

Topic model

word embedding

topical embedding

representation learning

Combine Topic Modeling with Semantic Embedding: Embedding Enhanced Topic Model

Abstract

AI Summary

Journal

Organization