arrow
Return

Topic model validation

delete2012-01-01
delete34
PRE
AI
E
Eduardo H. Ramírez
R
Ramón Brena
D
D. Magatti
F
Fabio Stella *
DOI:10.1016/j.neucom.2011.04.032delete
deleteOriginal
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this paper the problem of performing external validation of the semantic coherence of topic models is considered. The Fowlkes-Mallows index, a known clustering validation metric, is generalized for the case of overlapping partitions and multi-labeled collections, thus making it suitable for validating topic modeling algorithms. In addition, we propose new probabilistic metrics inspired by the concepts of recall and precision. The proposed metrics also have clear probabilistic interpretations and can be applied to validate and compare other soft and overlapping clustering algorithms. The approach is exemplified by using the Reuters-21578 multi-labeled collection to validate LDA models, then using Monte Carlo simulations to show the convergence to the correct results. Additional statistical evidence is provided to better understand the relation of the metrics presented. (C) 2011 Elsevier B.V. All rights reserved.
Keywords:
Topic models
Soft clustering
Fowlkes-Mallows index
Monte Carlo

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
8.4W

Organization

U
university of milano - bicocca
Scholars:
58
Papers: 27
Citations: 8.8K
Cited Papers

Cited Papers

The Unreasonable Effectiveness of Data
err2009-03-01
err1.0K
PREAI
errHalevy, Alon; Norvig, Peter; Pereira, Fernando
errShare
errSave
no more