arrow
返回

UDL: a cloud task scheduling framework based on multiple deep neural networks

delete2023-07-28
delete2
delete
OA
AI
Q
Qirui Li
Z
Zhiping Peng *
D
Delong Cui
J
Jianpeng Lin
H
Hao Zhang
DOI:10.1186/s13677-023-00490-ydelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Cloud task scheduling and resource allocation (TSRA) constitute a core issue in cloud computing. Batch submission is a common user task deployment mode in cloud computing systems. In this mode, it has been a challenge for cloud systems to balance the quality of user service and the revenue of cloud service provider (CSP). To this end, with multi-objective optimization (MOO) of minimizing task latency and energy consumption, we propose a cloud TSRA framework based on deep learning (DL). The system solves the TSRA problems of multiple task queues and virtual machine (VM) clusters by uniting multiple deep neural networks (DNNs) as task scheduler of cloud system. The DNNs are divided into exploration part and exploitation part. At each scheduling time step, the model saves the best outputs of all scheduling policies from each DNN to the experienced sample memory pool (SMP), and periodically selects random training samples from SMP to train each DNN of exploitation part. We designed a united deep learning (UDL) algorithm based on this framework. Experimental results show that the UDL algorithm can effectively solve the MOO problem of TSRA for cloud tasks, and performs better than benchmark algorithms such as heterogeneous distributed deep learning (HDDL) in terms of task scheduling performance.
Keyword:
Deep neural network
Memory replay
United
Task scheduling
Sample memory pool

期刊

J
Journal of Cloud Computing-Advances Systems and Applications
IF:
4.3
论文数:
746
被引数:
2.2K

机构

F
fudan university
学者数:
11.8W
论文数: 7.7W
被引数: 121
G
Guangdong University of Petrochemical Technology
学者数:
2.0K
论文数: 1.6K
被引数: 1
S
south china university of technology
学者数:
6.8W
论文数: 5.1W
被引数: 85
学者 查看更多机构
引用论文

引用论文

Effects of Topological Constraints on Penetration Structures of Semi-Flexible Ring Polymers
err2020-11-11
err0
errOAAI
errFuchen Guo; Ke Li; Jiaxin Wu; Linli He; Linxi Zhang
err分享
err收藏
Deep neural network-based application partitioning and scheduling for hospitals and medical enterprises using IoT assisted mobile fog cloud
err2021-02-15
err71
PREAI
errLakhan, Abdullah; Mastoi, Qurat-Ul-Ain; Elhoseny, Mohamed; Memon, Muhammad Suleman; Mohammed, Mazin Abed
err分享
err收藏
A drug repurposing screen identifies hepatitis C antivirals as inhibitors of the SARS-CoV2 main protease
err2021-02-01
err0
errOAAI
errJeremy D. Baker; Rikki L. Uhrich; Gerald C. Kraemer; Jason E. Love; Brian C. Kraemer
err分享
err收藏
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容