arrow
返回

Hybrid Workflow Scheduling on Edge Cloud Computing Systems

delete2021-01-01
delete21
delete
OA
AI
R
Raed Alsurdeh *
R
Rodrigo N. Calheiros
K
Kenan M Matawie
B
Bahman Javadi
DOI:10.1109/ACCESS.2021.3116716delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Internet of Things applications can be represented as workflows in which stream and batch processing are combined to accomplish data analytics objectives in many application domains such as smart home, health care, bioinformatics, astronomy, and education. The main challenge of this combination is the differentiation of service quality constraints between batch and stream computations. Stream processing is highly latency-sensitive while batch processing is more likely resource-intensive. In this work, we propose an end-to-end hybrid workflow scheduling on an edge cloud system as a two-stage framework. In the first stage, we propose a resource estimation algorithm based on a linear optimization approach, gradient descent search (GDS), and in the second stage, we propose a cluster-based provisioning and scheduling technique for hybrid workflows on heterogeneous edge cloud resources. We provide a multi-objective optimization model for execution time and monetary cost under constraints of deadline and throughput. Results demonstrate the framework performance in controlling the execution of hybrid workflows by efficiently tuning several parameters including stream arrival rate, processing throughput, and workflow complexity. In comparison to a meta-heuristics technique using Particle Swarm Optimization (PSO), the proposed scheduler provides significant improvement for large-scale hybrid workflows in terms of execution time and cost with an average of 8% and 35%, respectively.
Keyword:
Task analysis
Cloud computing
Costs
Computational modeling
Data models
Resource management
Real-time systems
Hybrid workflow scheduling
streaming scheduling
gradient search optimization
resource estimation and provisioning

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

W
western sydney university
学者数:
1.0W
论文数: 1.1W
被引数: 16
引用论文

引用论文

err分享
err收藏
Deep learning-based remote and social sensing data fusion for urban region function recognition
err2020-05-01
err128
PREAI
errCao, Rui; Tu, Wei; Yang, Cuixin; Li, Qing; Liu, Jun; Zhu, Jiasong; Zhang, Qian; Li, Qingquan; Qiu, Guoping
err分享
err收藏
err分享
err收藏
Multiple-mouse magnetic resonance imaging with cryogenic radiofrequency probes for evaluation of brain development
err2022-05-01
err0
errOAAI
errA. Arbabi; L. Spencer Noakes; D. Vousden; J. Dazai; S. Spring; O. Botelho; T. Keshavarzian; M. Mattingly; J.E. Ellegood; L.M.J. Nutter; R. Wissmann; J.G. Sled; J.P. Lerch; R.M. Henkelman; B.J. Nieman
err分享
err收藏
A comprehensive survey for scheduling techniques in cloud computing
err2019-10-01
err209
PREAI
errKumar, Mohit; Sharma, S. C.; Goel, Anubhav; Singh, S. P.
err分享
err收藏
Asymmetric synthesis of N-aryl aziridines
err2002-01-01
err0
PREAI
errJoão Aires-de-Sousa; Sundaresan Prabhakar; Ana M. Lobo; Ana M. Rosa; Mário J.S. Gomes; Marta C. Corvo; David J. Williams; Andrew J.P. White
err分享
err收藏
Multiobjective Cloud Workflow Scheduling: A Multiple Populations Ant Colony System Approach
err2019-08-01
err204
errOAAI
errChen, Zong-Gan; Zhan, Zhi-Hui; Lin, Ying; Gong, Yue-Jiao; Gu, Tian-Long; Zhao, Feng; Yuan, Hua-Qiang; Chen, Xiaofeng; Li, Qing; Zhang, Jun
err分享
err收藏
学者 查看更多内容