Probabilistic topic models for sequence data

Nicola Barbieri

doi:10.1007/s10994-013-5391-2

Probabilistic topic models for sequence data

2013-07-03

21

OA

AI

DOI：10.1007/s10994-013-5391-2

Original

Original request for help

Save

Abstract

En 中文

Probabilistic topic models are widely used in different contexts to uncover the hidden structure in large text corpora. One of the main (and perhaps strong) assumption of these models is that generative process follows a bag-of-words assumption, i.e. each token is independent from the previous one. We extend the popular Latent Dirichlet Allocation model by exploiting three different conditional Markovian assumptions: (i) the token generation depends on the current topic and on the previous token; (ii) the topic associated with each observation depends on topic associated with the previous one; (iii) the token generation depends on the current and previous topic. For each of these modeling assumptions we present a Gibbs Sampling procedure for parameter estimation. Experimental evaluation over real-word data shows the performance advantages, in terms of recall and precision, of the sequence-modeling approaches.

Keywords:

Recommender systems

Collaborative filtering

Probabilistic topic models

Performance

Probabilistic topic models for sequence data

Abstract

Journal

Organization