返回
UDL: a cloud task scheduling framework based on multiple deep neural networks
DOI:10.1186/s13677-023-00490-y.png)
摘要
En 中文
Cloud task scheduling and resource allocation (TSRA) constitute a core issue in cloud computing. Batch submission is a common user task deployment mode in cloud computing systems. In this mode, it has been a challenge for cloud systems to balance the quality of user service and the revenue of cloud service provider (CSP). To this end, with multi-objective optimization (MOO) of minimizing task latency and energy consumption, we propose a cloud TSRA framework based on deep learning (DL). The system solves the TSRA problems of multiple task queues and virtual machine (VM) clusters by uniting multiple deep neural networks (DNNs) as task scheduler of cloud system. The DNNs are divided into exploration part and exploitation part. At each scheduling time step, the model saves the best outputs of all scheduling policies from each DNN to the experienced sample memory pool (SMP), and periodically selects random training samples from SMP to train each DNN of exploitation part. We designed a united deep learning (UDL) algorithm based on this framework. Experimental results show that the UDL algorithm can effectively solve the MOO problem of TSRA for cloud tasks, and performs better than benchmark algorithms such as heterogeneous distributed deep learning (HDDL) in terms of task scheduling performance.
Keyword:
Deep neural network
Memory replay
United
Task scheduling
Sample memory pool
期刊
J
IF:
4.3
论文数:
746
被引数:
2.2K
机构
引用论文
Effects of Topological Constraints on Penetration Structures of Semi-Flexible Ring Polymers
Polymers
IF0
A drug repurposing screen identifies hepatitis C antivirals as inhibitors of the SARS-CoV2 main protease
PLOS ONE
IF0
A Two-Stage Framework for the Multi-User Multi-Data Center Job Scheduling and Resource Allocation多用户多数据中心作业调度和资源分配的两阶段框架
IEEE ACCESS
IF3.6
Study of bi-directional buck-boost converter topologies for application in electrical vehicle motor drives应用于电动汽车电机驱动的双向buck-boost变换器拓扑研究
Cloud Resource Scheduling With Deep Reinforcement Learning and Imitation Learning基于深度强化学习和模仿学习的云资源调度

