返回
Discovering Data Set Nature through Algorithmic Clustering Based on String Compression
DOI:10.1109/TKDE.2014.2345396.png)
摘要
En 中文
Text data sets can be represented using models that do not preserve text structure, or using models that preserve text structure. Our hypothesis is that depending on the data set nature, there can be advantages using a model that preserves text structure over one that does not, and vice versa. The key is to determine the best way of representing a particular data set, based on the data set itself. In this work, we proposde Borjae to investigate this problem by combining text distortion and algorithmic clustering based on string compression. Specifically, a distortion technique previously developed by the authors is applied to destroy text structure progressively. Following this, a clustering algorithm based on string compression is used to analyze the effects of the distortion on the information contained in the texts. Several experiments are carried out on text data sets and artificially-generated data sets. The results show that in strongly structural data sets the clustering results worsen as text structure is progressively destroyed. Besides, they show that using a compressor which enables the choice of the size of the left-context symbols helps to determine the nature of the data sets. Finally, the results are contrasted with a method based on multidimensional projections and analogous conclusions are obtained.
Keyword:
Normalized compression distance
data compression
word removal
compression-based text clustering
PPMD order
dendrogram silhouette coefficient
multidimensional projections
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
10.4
论文数:
6.8K
被引数:
3.2W
机构
引用论文
Predicting metachronous liver metastasis from colorectal cancer using serum proteomic fingerprinting

