arrow
返回

Adaptive and Efficient Resource Allocation in Cloud Datacenters Using Actor-Critic Deep Reinforcement Learning

delete2022-08-01
delete42
delete
OA
AI
陈哲毅 封面图
陈哲毅 (Zheyi Chen)
J
Jia Hu
G
Geyong Min *
C
Chunbo Luo
DOI:10.1109/TPDS.2021.3132422delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The ever-expanding scale of cloud datacenters necessitates automated resource provisioning to best meet the requirements of low latency and high energy-efficiency. However, due to the dynamic system states and various user demands, efficient resource allocation in cloud faces huge challenges. Most of the existing solutions for cloud resource allocation cannot effectively handle the dynamic cloud environments because they depend on the prior knowledge of a cloud system, which may lead to excessive energy consumption and degraded Quality-of-Service (QoS). To address this problem, we propose an adaptive and efficient cloud resource allocation scheme based on Actor-Critic Deep Reinforcement Learning (DRL). First, the actor parameterizes the policy (allocating resources) and chooses actions (scheduling jobs) based on the scores assessed by the critic (evaluating actions). Next, the resource allocation policy is updated by using gradient ascent while the variance of policy gradient is reduced with an advantage function, which improves the training efficiency of the proposed method. We conduct extensive simulation experiments using real-world data from Google cloud datacenters. The results show that our method can obtain the superior QoS in terms of latency and job dismissing rate with enhanced energy-efficiency, compared to two advanced DRL-based and five classic cloud resource allocation methods.
Keyword:
Resource management
Cloud computing
Quality of service
Training
Dynamic scheduling
Reinforcement learning
Energy consumption
Cloud computing
datacenters
resource allocation
energy-efficiency
deep reinforcement learning

期刊

IEEE Transactions on Parallel and Distributed Systems 封面图
IEEE Transactions on Parallel and Distributed Systems
IF:
6
论文数:
5.2K
被引数:
1.1W

机构

U
University of Exeter
学者数:
2.0W
论文数: 2.1W
被引数: 3.6W
G
George Washington University
学者数:
1.6W
论文数: 1.4W
被引数: 1.7W
引用论文

引用论文

Adjunctive Recombinant Human Interferon Gamma-1b for Treatment-Resistant Schizophrenia in 2 Patients
err2014-11-24
err0
errOAAI
errLena Grüber; Tilmann Bunse; Elif Weidinger; Heidi Reichard; Norbert Müller
err分享
err收藏
OPTIMIZACION DE CONSUMO DE COMBUSTIBLE DE VEHICULOS BASADA EN PROGRAMACION DINAMICA
err2012-01-01
err0
PREAI
errWILMAR CABRERA MONTIE; SANTIAGO TAPIA FERNANDEZ; FELIPE JIMÉNEZ ALONSO; FRANCISCO APARICIO IZQUIERDO
err分享
err收藏
学者 查看更多内容