arrow
返回

Imitation learning enabled fast and adaptive task scheduling in cloud

delete2024-05-01
delete4
PRE
AI
K
Kaixuan Kang
丁
丁丁 (Ding Ding) *
H
Huamao Xie
L
Lihong Zhao
Y
Yinong Li
Y
Yixuan Xie
DOI:10.1016/j.future.2024.01.002delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Studies of resource provision in cloud computing have drawn extensive attention, since effective task scheduling solutions promise an energy -efficient way of utilizing resources while meeting diverse requirements of users. Deep reinforcement learning (DRL) has demonstrated its outstanding capability in tackling this issue with the ability of online self -learning, however, it is still prevented by the low sampling efficiency, poor sample validity, and slow convergence speed especially for deadline constrained applications. To address these challenges, an Imitation Learning Enabled Fast and Adaptive Task Scheduling (ILETS) framework based on DRL is proposed in this paper. First, we introduce behavior cloning to provide a well-behaved and robust model through Offline Initial Network Parameters Training (OINPT) so as to guarantee the initial decision -making quality of DRL. Next, we design a novel Online Asynchronous Imitation Learning (OAIL)-based method to assist the DRL agent to re -optimize its policy and to against the oscillations caused by the high dynamic of the cloud, which promises DRL agent moving towards the optimal policy with a fast and stable process. Extensive experiments on the real -world dataset have demonstrated that the proposed ILETS can consistently produce shorter response time, lower energy consumption and higher success rate than the baselines and other state-of-the-art methods at the accelerated convergence speed.
Keyword:
Cloud computing
Task scheduling
Energy efficient
Deadline constrained
Deep reinforcement learning
Imitation learning

期刊

F
Future Generation Computer Systems-The International Journal of eScience
IF:
6.1
论文数:
6.9K
被引数:
2.3W

机构

B
Beijing Jiaotong University
学者数:
2.2W
论文数: 1.7W
被引数: 1.2W
引用论文

引用论文

Recalibrating global data center energy-use estimates重新校准全球数据中心能源使用估算
errSCIENCE
IF45.8
err2020-02-28
err564
PREAI
errMasanet, Eric; Shehabi, Arman; Lei, Nuoa; Smith, Sarah; Koomey, Jonathan
err分享
err收藏
Profit Maximization for Cloud Brokers in Cloud Computing
err2019-01-01
err80
PREAI
errMei, Jing; Li, Kenli; Tong, Zhao; Li, Qiang; Li, Keqin
err分享
err收藏
Intracranial germ cell tumor mimicking anorexia nervosa
err1991-07-01
err0
PREAI
errK. Berek; F. Aichner; E. Schmutzhard; M. Kofler; J. Langmayr; F. Gerstenbrand
err分享
err收藏
Qudit stabilizer codes, CFTs, and topological surfaces
err2024-10-31
err0
errOAAI
errMatthew Buican; Rajath Radhakrishnan
err分享
err收藏
学者 查看更多内容