.png){kind=icon}
返回
Distributed stream clustering using micro-clusters on Apache Storm
.png){kind=icon}
PRE
AI
DOI：10.1016/j.jpdc.2016.06.004.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The recent need to extract real-time insights from data has driven the need for machine learning algorithms that can operate on data streams. Given the current extreme rates of data generation (around 5000 messages per second), these algorithms need to be able to handle data streams of very high velocity. Many current algorithms do not reach this requirement, in some cases processing only tens of messages per second. In this work we address the problem of limited achievable throughput of stream clustering by developing scalable distributed algorithms based on the micro-clustering paradigm that run on cloud platforms. We present two distributed architectures to execute the algorithms in parallel and implement these architectures on the Apache Storm stream processing platform. We demonstrate that we are able to gain close to an order of magnitude of improvement of performance in our experiments. (C) 2016 Elsevier Inc. All rights reserved.
Keyword:
Stream data mining
Distributed data mining
Stream clustering
期刊
IF:
4
论文数:
3.8K
被引数:
4.8K
机构
引用论文
Development and Use of Core Subsets of Cool-season Food Legume Germplasm Collections.png)
HortScience
OAAI
HortScienceIF0
OAAI分享收藏A regulated switch of chick neurofascin isoforms modulates ligand recognition and neurite extension
PREAI
分享收藏 没有更多内容
没有更多内容