返回
Topic model validation
DOI:10.1016/j.neucom.2011.04.032.png)
摘要
En 中文
In this paper the problem of performing external validation of the semantic coherence of topic models is considered. The Fowlkes-Mallows index, a known clustering validation metric, is generalized for the case of overlapping partitions and multi-labeled collections, thus making it suitable for validating topic modeling algorithms. In addition, we propose new probabilistic metrics inspired by the concepts of recall and precision. The proposed metrics also have clear probabilistic interpretations and can be applied to validate and compare other soft and overlapping clustering algorithms. The approach is exemplified by using the Reuters-21578 multi-labeled collection to validate LDA models, then using Monte Carlo simulations to show the convergence to the correct results. Additional statistical evidence is provided to better understand the relation of the metrics presented. (C) 2011 Elsevier B.V. All rights reserved.
Keyword:
Topic models
Soft clustering
Fowlkes-Mallows index
Monte Carlo
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
6.5
论文数:
2.5W
被引数:
8.4W
机构
引用论文
Towards a Symbiosis: Urban Development and Environmental Quality in the Taipei Metropolitan Region迈向共生:台北都会区城市发展与环境质量
Unsupervised learning by probabilistic latent semantic analysis基于概率潜在语义分析的无监督学习
MACHINE LEARNING
IF2.9
没有更多内容

