arrow
Return

A collaborative scheduling method for cloud computing heterogeneous workflows based on deep reinforcement learning

delete2023-04-01
delete21
PRE
AI
G
Genxin Chen
J
Jin Qi
Y
Ying Sun
X
Xiaoxuan Hu
Z
Zhenjiang Dong
Y
Yanfei Sun *
DOI:10.1016/j.future.2022.11.032delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Aiming at the problem of low overall service quality caused by the disordered collaboration of heterogeneous workflows and discontinuous task execution in cloud computing scenarios, this paper proposes a collaborative scheduling method for heterogeneous workflows in cloud computing based on deep reinforcement learning. The method optimizes workflow makespan, cost, fairness and continuity in cloud computing under the constraints of task execution continuity. First, the structure and time sequence features are extracted for the dynamic scheduling process, and a reasonable scheduling decision support feature set is constructed. Second, a time-step adaptive scheduling mechanism is designed to simplify redundant information in the scheduling process and enables the agent to achieve efficient learning. In addition, using equilibrium, priority and preference scheduling strategies, an immediate-lag compound reward mechanism and a scheduling-switching hybrid action are designed to achieve a unification of the agent's learning objectives and actual scheduling requirements. Finally, by constructing a simulation platform and conducting comparative experiments with four other algorithms, the results show that the proposed method has advantages in collaborative optimization of high-dimensional objectives under task continuity constraints. Including the task loading strategy can optimize the makespan performance by 16.6% and improve the fairness index by 5.3%.(c) 2022 Elsevier B.V. All rights reserved.
Keywords:
Heterogeneous workflows
Cloud computing
Deep reinforcement learning
High -dimensional objectives
Collaborative scheduling
Adaptive mechanism

Journal

F
Future Generation Computer Systems-The International Journal of eScience
IF:
6.1
Papers:
6.8K
Citations:
2.3W

Organization

No organization information available
Cited Papers

Cited Papers

errShare
errSave
Online Multi-Workflow Scheduling under Uncertain Task Execution Time in IaaS Clouds
err2021-07-01
err74
PREAI
errLiu, Jiagang; Ren, Ju; Dai, Wei; Zhang, Deyu; Zhou, Pude; Zhang, Yaoxue; Min, Geyong; Najjari, Noushin
errShare
errSave
Antitumor agents. 258. Syntheses and evaluation of dietary antioxidant—taxoid conjugates as novel cytotoxic agents
err2007-09-01
err0
errOAAI
errKyoko Nakagawa-Goto; Koji Yamada; Seikou Nakamura; Tzu-Hsuan Chen; Po-Cheng Chiang; Kenneth F. Bastow; Shao-Chun Wang; Bill Spohn; Mien-Chie Hung; Fang-Yu Lee; Fang-Chen Lee; Kuo-Hsiung Lee
errShare
errSave
Providing Service Continuity in Clouds Under Power Outage
err2020-09-01
err3
PREAI
errWu, Weiwei; Wang, Jianping; Lu, Kejie; Qi, Wen; Shan, Feng; Luo, Junzhou
errShare
errSave
Running Industrial Workflow Applications in a Software-Defined Multicloud Environment Using Green Energy Aware Scheduling Algorithm
err2021-08-01
err26
errOAAI
errWen, Zhenyu; Garg, Saurabh; Aujla, Gagangeet Singh; Alwasel, Khaled; Puthal, Deepak; Dustdar, Schahram; Zomaya, Albert Y.; Ranjan, Rajiv
errShare
errSave
researcher View more