返回
Performance Prediction Method for Stream Computing Platform Based on Time Series
DOI:10.1109/ACCESS.2021.3079207.png)
摘要
En 中文
As one of the most popular high-performance data processing technology, existing task and resource scheduling strategies for stream computing platforms are suffering from the problem of triggering hysteresis, which seriously affects the cluster performance. To address this problem, the idea of performance prediction based on timeline series data is proposed. Firstly, the performance variation rule of the stream processing platform is analyzed, which provides a basis for proposing the performance prediction model. Secondly, the basic topology paradigm, periodic load prediction model, and real-time throughput prediction model are proposed as the theoretical foundation for performance prediction. Thirdly, the performance prediction algorithm is proposed to predict the variation trend of the processing load and throughput of the cluster. The processing load is predicted periodically while the throughput of the cluster is predicted in a real-time manner. Finally, the performance evaluation algorithm is proposed to evaluate the cluster performance based on the prediction results and trigger the corresponding scheduling strategies in advance. The experimental results showed that the prediction accuracy of the proposed algorithm meets the requirements in practical applications. Meanwhile, the proposed method improves the performance of stream computing performance by triggering the scheduling strategies in advance.
Keyword:
Throughput
Predictive models
Prediction algorithms
Processor scheduling
Load modeling
Scheduling
Data processing
Big data
stream computing
performance prediction
processing load
throughput
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
Machine learning for pore-water pressure time-series prediction: Application of recurrent neural networks
GEOSCIENCE FRONTIERS
IF8.9
Monthly runoff time series prediction by variational mode decomposition and support vector machine based on quantum-behaved particle swarm optimization
JOURNAL OF HYDROLOGY
IF6.3

