arrow
返回

Discovering Data Set Nature through Algorithmic Clustering Based on String Compression

delete2015-03-01
delete12
PRE
AI
A
Ana Granados *
F
Francisco B. Rodrı́guez
DOI:10.1109/TKDE.2014.2345396delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Text data sets can be represented using models that do not preserve text structure, or using models that preserve text structure. Our hypothesis is that depending on the data set nature, there can be advantages using a model that preserves text structure over one that does not, and vice versa. The key is to determine the best way of representing a particular data set, based on the data set itself. In this work, we proposde Borjae to investigate this problem by combining text distortion and algorithmic clustering based on string compression. Specifically, a distortion technique previously developed by the authors is applied to destroy text structure progressively. Following this, a clustering algorithm based on string compression is used to analyze the effects of the distortion on the information contained in the texts. Several experiments are carried out on text data sets and artificially-generated data sets. The results show that in strongly structural data sets the clustering results worsen as text structure is progressively destroyed. Besides, they show that using a compressor which enables the choice of the size of the left-context symbols helps to determine the nature of the data sets. Finally, the results are contrasted with a method based on multidimensional projections and analogous conclusions are obtained.
Keyword:
Normalized compression distance
data compression
word removal
compression-based text clustering
PPMD order
dendrogram silhouette coefficient
multidimensional projections
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Knowledge and Data Engineering 封面图
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
论文数:
6.8K
被引数:
3.2W

机构

C
Complutense University of Madrid
学者数:
2.6W
论文数: 2.2W
被引数: 31
A
Autonomous University of Madrid
学者数:
2.1W
论文数: 1.7W
被引数: 29
引用论文

引用论文

The Diagnosis and Characteristics of Moderate Dry Eye in Non-Contact Lens Wearers
err2005-05-01
err0
PREAI
errSrihari Narayanan; William L. Miller; Thomas C. Prager; Julie A. Jackson; Norman E. Leach; Alison M. McDermott; Mike T. Christensen; Jan P.G. Bergmanson
err分享
err收藏
The Google similarity distance
err2007-03-01
err1.0K
PREAI
errCilibrasi, Rudi L.; Vitanyi, Paul M. B.
err分享
err收藏
Adrenal in Toxicology
err
IF0
err1996-03-28
err0
PREAI
err
err分享
err收藏
Red Queen hypothesis supported by parasitism in sexual and clonal fish
err1990-04-01
err0
PREAI
errCurtis M. Lively; Clark Craddock; Robert C. Vrijenhoek
err分享
err收藏
Predicting metachronous liver metastasis from colorectal cancer using serum proteomic fingerprinting
err2013-10-01
err0
PREAI
errDexiang Zhu; Yunshi Zhong; Haifu Wu; Lechi Ye; Jie Wang; Yan Li; Ye Wei; Li Ren; Bin Xu; Jianmin Xu; Xinyu Qin
err分享
err收藏
Stylometry with R: A Package for Computational Text Analysis
err2016-01-01
err0
errOAAI
errMaciej Eder; Jan Rybicki; Mike Kestemont
err分享
err收藏
学者 查看更多内容