arrow
Return

Clustering Data Streams Based on Shared Density between Micro-Clusters

delete2016-06-01
delete111
PRE
AI
M
Michael Hahsler *
DOI:10.1109/TKDE.2016.2522412delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
As more and more applications produce streaming data, clustering data streams has become an important technique for data and knowledge engineering. A typical approach is to summarize the data stream in real-time with an online process into a large number of so called micro-clusters. Micro-clusters represent local density estimates by aggregating the information of many data points in a defined area. On demand, a (modified) conventional clustering algorithm is used in a second offline step to recluster the microclusters into larger final clusters. For reclustering, the centers of the micro-clusters are used as pseudo points with the density estimates used as their weights. However, information about density in the area between micro-clusters is not preserved in the online process and reclustering is based on possibly inaccurate assumptions about the distribution of data within and between micro-clusters (e.g., uniform or Gaussian). This paper describes DBSTREAM, the first micro-cluster-based online clustering component that explicitly captures the density between micro-clusters via a shared density graph. The density information in this graph is then exploited for reclustering based on actual density between adjacent micro-clusters. We discuss the space and time complexity of maintaining the shared density graph. Experiments on a wide range of synthetic and real data sets highlight that using shared density improves clustering quality over other popular data stream clustering methods which require the creation of a larger number of smaller microclusters to achieve comparable results.
Keywords:
Data mining
data stream clustering
density-based clustering
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Knowledge and Data Engineering cover
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
Papers:
6.8K
Citations:
3.2W

Organization

S
Southern Methodist University
Scholars:
3.0K
Papers: 3.5K
Citations: 3.9K
Cited Papers

Cited Papers

Digital Twin Applications: A Survey of Recent Advances and Challenges
err2022-04-12
err0
errOAAI
errRafael da Silva Mendonça; Sidney de Oliveira Lins; Iury Valente de Bessa; Florindo Antônio de Carvalho Ayres; Renan Landau Paiva de Medeiros; Vicente Ferreira de Lucena
errShare
errSave
The human task-evoked pupillary response function is linear: Implications for baseline response scaling in pupillometry
err2018-09-27
err0
errOAAI
errJamie Reilly; Alexandra Kelly; Seung Hwan Kim; Savannah Jett; Bonnie Zuckerman
errShare
errSave
Role of pre-operative frailty status in relation to outcome after carotid endarterectomy: a systematic review
err2021-07-01
err0
errOAAI
errLouise B. D. Banning; Stan Benjamens; Reinoud P. H. Bokkers; Clark J. Zeebregts; Robert A. Pol
errShare
errSave
On evaluating stream learning algorithms
err2012-10-24
err360
errOAAI
errGama, Joao; Sebastiao, Raquel; Rodrigues, Pedro Pereira
errShare
errSave
Decoding binary decisions under differential target probabilities from pupil dilation: A random forest approach
err2021-07-14
err0
errOAAI
errChristoph Strauch; Teresa Hirzle; Stefan Van der Stigchel; Andreas Bulling
errShare
errSave
Data Stream Clustering: A Survey
err2013-07-11
err386
errOAAI
errSilva, Jonathan A.; Faria, Elaine R.; Barros, Rodrigo C.; Hruschka, Eduardo R.; de Carvalho, Andre C. P. L. F.; Gama, Joao
errShare
errSave
Density-Based Clustering of Data Streams at Multiple Resolutions
err2009-07-28
err109
errOAAI
errWan, Li; Ng, Wee Keong; Dang, Xuan Hong; Yu, Philip S.; Zhang, Kuan
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
Kinetics and mechanism of silver(III) reduction
err2002-05-01
err0
PREAI
errEdward T. Borish; Louis J. Kirschenbaum
errShare
errSave
researcher View more