arrow
返回

A multi-objective reinforcement learning algorithm for deadline constrained scientific workflow scheduling in clouds

delete2021-05-27
delete12
PRE
AI
Y
Yao Qin
H
Hua Wang *
X
Xiaole Li *
L
Linbo Zhai
DOI:10.1007/s11704-020-9273-zdelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Recently, a growing number of scientific applications have been migrated into the cloud. To deal with the problems brought by clouds, more and more researchers start to consider multiple optimization goals in workflow scheduling. However, the previous works ignore some details, which are challenging but essential. Most existing multi-objective workflow scheduling algorithms overlook weight selection, which may result in the quality degradation of solutions. Besides, we find that the famous partial critical path (PCP) strategy, which has been widely used to meet the deadline constraint, can not accurately reflect the situation of each time step. Workflow scheduling is an NP-hard problem, so self-optimizing algorithms are more suitable to solve it.In this paper, the aim is to solve a workflow scheduling problem with a deadline constraint. We design a deadline constrained scientific workflow scheduling algorithm based on multi-objective reinforcement learning (RL) called DCMORL. DCMORL uses the Chebyshev scalarization function to scalarize its Q-values. This method is good at choosing weights for objectives. We propose an improved version of the PCP strategy called MPCP. The sub-deadlines in MPCP regularly update during the scheduling phase, so they can accurately reflect the situation of each time step. The optimization objectives in this paper include minimizing the execution cost and energy consumption within a given deadline. Finally, we use four scientific workflows to compare DCMORL and several representative scheduling algorithms. The results indicate that DCMORL outperforms the above algorithms. As far as we know, it is the first time to apply RL to a deadline constrained workflow scheduling problem.
Keyword:
workflow scheduling
energy saving
multi-objective reinforcement learning
deadline constrained
cloud computing
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Frontiers of Computer Science 封面图
Frontiers of Computer Science
IF:
4.6
论文数:
1.6K
被引数:
2.8K

机构

L
linyi university
学者数:
4.4K
论文数: 3.2K
被引数: 62
S
shandong university
学者数:
9.5W
论文数: 6.4W
被引数: 94
S
shandong normal university
学者数:
1.0W
论文数: 8.2K
被引数: 3
学者 查看更多机构
引用论文

引用论文

Use of Amazonian Forest Fragments by Understory Insectivorous Birds
err1995-12-01
err0
PREAI
errPhilip C. Stouffer; Richard O. Bierregaard
err分享
err收藏
err分享
err收藏
Grain-boundary character and grain growth in bulk tin and bulk lead-free solder alloys
err2004-12-01
err0
PREAI
errA. U. Telang; T. R. Bieler; J. P. Lucas; K. N. Subramanian; L. P. Lehman; Y. Xing; E. J. Cotts
err分享
err收藏
Planning virtual infrastructures for time critical applications with multiple deadline constraints
err2017-10-01
err25
errOAAI
errWang, Junchao; Taal, Arie; Martin, Paul; Hu, Yang; Zhou, Huan; Pang, Jianmin; de laat, Cees; Zhao, Zhiming
err分享
err收藏
Multi-Objective Workflow Scheduling With Deep-Q-Network-Based Multi-Agent Reinforcement Learning基于深度Q网络的多Agent强化学习的多目标工作流调度
err2019-01-01
err218
errOAAI
errWang, Yuandou; Liu, Hang; Zheng, Wanbo; Xia, Yunni; Li, Yawen; Chen, Peng; Guo, Kunyin; Xie, Hong
err分享
err收藏
学者 查看更多内容