arrow
返回

Performance Prediction Method for Stream Computing Platform Based on Time Series

delete2021-01-01
delete0
delete
OA
AI
Z
Ziyang Li
J
Jiong Yu
L
Liang Lu *
DOI:10.1109/ACCESS.2021.3079207delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
As one of the most popular high-performance data processing technology, existing task and resource scheduling strategies for stream computing platforms are suffering from the problem of triggering hysteresis, which seriously affects the cluster performance. To address this problem, the idea of performance prediction based on timeline series data is proposed. Firstly, the performance variation rule of the stream processing platform is analyzed, which provides a basis for proposing the performance prediction model. Secondly, the basic topology paradigm, periodic load prediction model, and real-time throughput prediction model are proposed as the theoretical foundation for performance prediction. Thirdly, the performance prediction algorithm is proposed to predict the variation trend of the processing load and throughput of the cluster. The processing load is predicted periodically while the throughput of the cluster is predicted in a real-time manner. Finally, the performance evaluation algorithm is proposed to evaluate the cluster performance based on the prediction results and trigger the corresponding scheduling strategies in advance. The experimental results showed that the prediction accuracy of the proposed algorithm meets the requirements in practical applications. Meanwhile, the proposed method improves the performance of stream computing performance by triggering the scheduling strategies in advance.
Keyword:
Throughput
Predictive models
Prediction algorithms
Processor scheduling
Load modeling
Scheduling
Data processing
Big data
stream computing
performance prediction
processing load
throughput
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

C
Civil Aviation University of China
学者数:
3.0K
论文数: 1.9K
被引数: 1.5K
X
Xinjiang University
学者数:
1.4W
论文数: 8.7K
被引数: 1.1W
引用论文

引用论文

The key local segments of human body for personalized heating and cooling
err2019-04-01
err0
PREAI
errLijuan Wang; Yufei Tian; Jungsoo Kim; Haiguo Yin
err分享
err收藏
Machine learning for pore-water pressure time-series prediction: Application of recurrent neural networks
err2021-01-01
err131
errOAAI
errWei, Xin; Zhang, Lulu; Yang, Hao-Qing; Zhang, Limin; Yao, Yang-Ping
err分享
err收藏
Monthly runoff time series prediction by variational mode decomposition and support vector machine based on quantum-behaved particle swarm optimization
err2020-04-01
err192
PREAI
errFeng, Zhong-kai; Niu, Wen-jing; Tang, Zheng-yang; Jiang, Zhi-qiang; Xu, Yang; Liu, Yi; Zhang, Hai-rong
err分享
err收藏
Cytogenetic analysis of human oocytes after subzonal insemination
err2005-11-21
err0
PREAI
errJacqueline Selva; Jean Philippe Wolf; Patricia Rince; Daniel Rodrigues; René Frydman; Pierre Jouannet
err分享
err收藏
StreamCloud: An Elastic and Scalable Data Streaming SystemStreamCloud: 一个弹性可扩展的数据流系统
err2012-12-01
err223
errOAAI
errGulisano, Vincenzo; Jimenez-Peris, Ricardo; Patino-Martinez, Marta; Soriente, Claudio; Valduriez, Patrick
err分享
err收藏
New software for comparing the color gamuts generated by printing technologies
err2022-07-01
err0
errOAAI
errAna Belén López-Baldomero; Manuel Rubiño; Carolina Ortiz; Carlos Salas
err分享
err收藏
学者 查看更多内容