.png){kind=icon}
返回
Self-Adaptive Framework for Efficient Stream Data Classification on Storm
.png){kind=icon}
PRE
AI
DOI：10.1109/TSMC.2017.2757029.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In this era of big data, stream data classification which is one of typical data stream applications has become more and more significant and challengeable. In these applications, it is obvious that data classification is much more frequent than model training. The ratio of stream data to be classified is rapid and time-varying, so it is an important problem to classify the stream data efficiently with high throughput. In this paper, we first analyze and categorize the current data stream machine learning algorithms according to their data structures. Then, we propose stream data classification topology (SDC-Topology) on Storm. For the classification algorithms based on the matrix, we propose self-adaptive stream data classification framework (SASDC-Framework) for efficient stream data classification on Storm. In SASDC-Framework, all the data sets arriving at the same unit time are partitioned into subsets with the nearly best partition size and processed in parallel. To select the nearly best partition size for the stream data sets efficiently, we adopt bisection method strategy and inverse distance weighted strategy. Extreme learning machine, which is a fast and accurate machine learning method based on matrix calculating, is used to test the efficiency of our proposals. According to evaluation results, the throughputs based on SASDC-Framework are 8-35 times higher than those based on SDC-Topology and the best throughput is more than 40000 prediction requests per second in our environment.
Keyword:
Storms
Training
Learning systems
Proposals
Throughput
Artificial neural networks
Real-time systems
Classification
extreme learning machine (ELM)
partition strategy
Storm
stream data
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
10.5
论文数:
1.1W
被引数:
5.0W
机构
引用论文
Robust on-line neural learning classifier system for data stream classification tasks.png)
SOFT COMPUTING
SOFT COMPUTINGIF2.5
PREAI
分享收藏Effect of cadmium on ciliary and ATPase activity in the gills of freshwater mussel Anodonta cygnea
PREAI
分享收藏A dynamic programming approach to missing data estimation using neural networks使用神经网络进行缺失数据估计的动态规划方法
PREAI
分享收藏
查看更多内容