arrow
Return

Bayesian Sparse Topical Coding

delete2019-06-01
delete19
delete
OA
AI
M
Min Peng
Q
Qianqian Xie
王华 (Hua Wang)
张彦春 (Yanchun Zhang)
G
Gang Tian *
DOI:10.1109/TKDE.2018.2847707delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Sparse topic models (STMs) are widely used for learning a semantically rich latent sparse representation of short texts in large scale, mainly by imposing sparse priors or appropriate regularizers on topic models. However, it is difficult for these STMs to model the sparse structure and pattern of the corpora accurately, since their sparse priors always fail to achieve real sparseness, and their regularizers bypass the prior information of the relevance between sparse coefficients. In this paper, we propose a novel Bayesian hierarchical topic models called Bayesian Sparse Topical Coding with Poisson Distribution (BSTC-P) on the basis of Sparse Topical Coding with Sparse Groups (STCSG). Different from traditional STMs, it focuses on imposing hierarchical sparse prior to leverage the prior information of relevance between sparse coefficients. Furthermore, we propose a sparsity-enhanced BSTC, Bayesian Sparse Topical Coding with Normal Distribution (BSTC-N), via mathematic approximation. We adopt superior hierarchical sparse inducing prior, with the purpose of achieving the sparsest optimal solution. Experimental results on datasets of Newsgroups and Twitter show that both BSTC-P and BSTC-N have better performance on finding clear latent semantic representations. Therefore, they yield better performance than existing works on document classification tasks.
Keywords:
Document representation
Bayesian topic model
sparse coding
hierarchical prior
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Knowledge and Data Engineering cover
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
Papers:
6.8K
Citations:
3.2W

Organization

V
Victoria University
Scholars:
3.2K
Papers: 3.8K
Citations: 22
W
wuhan university
Scholars:
8.1W
Papers: 5.8W
Citations: 70
Cited Papers

Cited Papers

An analysis of four different methods of producing focal cerebral ischemia with endothelin-1 in the rat
err2006-10-01
err0
PREAI
errV WINDLE; A SZYMANSKA; S GRANTERBUTTON; C WHITE; R BUIST; J PEELING; D CORBETT
errShare
errSave
errShare
errSave
Imine-linked micron-network polymers with high polyethylene glycol uptake for shaped-stabilized phase change materials
err2016-01-01
err0
PREAI
errJia Tang; Shuang Fan; Wenjun Dong; Jingjing Wang; Hongyi Gao; Mu Yang; Ming Yang; Ge Wang
errShare
errSave
errShare
errSave
Bayesian Compressive Sensing Using Laplace Priors
err2010-01-01
err679
PREAI
errBabacan, S. Derin; Molina, Rafael; Katsaggelos, Aggelos K.
errShare
errSave
Neuromuscular adaptations to sixteen weeks of whole-body high-intensity interval training compared to ergometer-based interval and continuous training
err2019-02-06
err0
PREAI
errGustavo Zaccaria Schaun; Stephanie Santana Pinto; Bruno Brasil; Gabriela Neves Nunes; Cristine Lima Alberton
errShare
errSave
researcher View more