arrow
返回

Improving document clustering in a learned concept space

delete2010-03-01
delete17
delete
OA
AI
Y
Youngmin Kim
P
Patrick Gallinari
DOI:10.1016/j.ipm.2009.09.007delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Most document clustering algorithms operate in a high dimensional bag-of-words space. The inherent presence of noise in such representation obviously degrades the performance of most of these approaches. In this paper we investigate an unsupervised dimensionality reduction technique for document clustering. This technique is based upon the assumption that terms co-occurring in the same context with the same frequencies are semantically related. On the basis of this assumption we first find term clusters using a classification version of the EM algorithm. Documents are then represented in the space of these term clusters and a multinomial mixture model (mm) is used to build document clusters. We empirically show on four document collections, Reuters-21578, Reuters RCV2-French, 20Newsgroups and WebKB, that this new text representation noticeably increases the performance of the mm model. By relating the proposed approach to the Probabilistic Latent Semantic Analysis (PLSA) model we further propose an extension of the latter in which an extra latent variable allows the model to co-cluster documents and terms simultaneously. We show on these four datasets that the proposed extended version of the PLSA model produces statistically significant improvements with respect to two clustering measures over all variants of the original PLSA and the mm models. (C) 2009 Elsevier Ltd. All rights reserved.
Keyword:
Document clustering
Aspect models
Concept learning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

I
Information Processing and Management
IF:
6.9
论文数:
5.2K
被引数:
1.4W

机构

S
Sorbonne Universite
学者数:
6.2W
论文数: 4.5W
被引数: 605
引用论文

引用论文

err分享
err收藏
Phase II trial of rucaparib (Without ADT) in patients with metastatic hormone-sensitive prostate cancer harboring germline DNA repair gene mutations (TRIUMPH).
err2018-05-20
err0
PREAI
errMark Christopher Markowski; Hao Wang; Rana Sullivan; Michael Haffner; Angelo M De Marzo; Tamara L. Lotan; Emmanuel S. Antonarakis
err分享
err收藏
学者 查看更多内容