arrow
返回

Scalable Virtual Machine Migration using Reinforcement Learning

delete2022-04-28
delete14
PRE
AI
A
Abdul Rahman Hummaida *
N
Norman W. Paton
R
Rizos Sakellariou
DOI:10.1007/s10723-022-09603-4delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Heuristic approaches require fixed knowledge of how resource allocation should be carried out, and this can be limiting when managing variable cloud workloads. Solutions based on Reinforcement Learning (RL) have been presented to manage cloud infrastructure, however, these tend to be centralized and suffer in their ability to maintain Quality of Service (QoS) for data centres with thousands of nodes. To address this, we propose a reinforcement learning management policy, which can run decentralized, and achieve fast convergence towards efficient resource allocation, resulting in lower SLA violations compared to centralized architectures. To address some of the common challenges in applying RL to cloud resource management, such as slow learning and state/action management, we use parallel learning and reduction of the state/action space. We apply a decision making approach to optimize the migration of a VM and choose a target node to host the VM in such a way that brings response time within SLA level. We have also demonstrate unique, multi-level reinforcement learning cooperation, that further reduces SLA violations. We use simulation to evaluate and demonstrate our proposal in practice, and compare the results obtained with an established heuristic, demonstrating significant improvement to SLA violations and higher scalability.
Keyword:
Reinforcement learning
Data centre scalability
Virtual machine migration
Hierarchical architecture
Distributed architecture

期刊

Journal of Grid Computing 封面图
Journal of Grid Computing
IF:
2.9
论文数:
764
被引数:
1.2K

机构

U
University of Manchester
学者数:
5.7W
论文数: 5.3W
被引数: 7.4W
引用论文

引用论文

Preoperative Lymphedema-Related Risk Factors in Early-Stage Breast Cancer
err2018-02-01
err0
PREAI
errZeynep Erdogan Iyigun; Tomris Duymaz; Ahmet Serkan Ilgun; Gul Alco; Cetin Ordu; Dauren Sarsenov; Ayse Esra Aydin; Filiz Elbuken Celebi; Filiz Izci; Yeşim Eralp; Vahit Ozmen
err分享
err收藏
Quercetin alleviates neonatal hypoxic-ischemic brain injury by inhibiting microglia-derived oxidative stress and TLR4-mediated inflammation
err2020-09-18
err0
PREAI
errKai Le; Zhiping Song; Jie Deng; Xin Peng; Jun Zhang; Liang Wang; Lu Zhou; Haidi Bi; Zhengyu Liao; Zhen Feng
err分享
err收藏
Autonomic decentralized elasticity based on a reinforcement learning controller for cloud applications
err2019-05-01
err45
PREAI
errNouri, Seyed Mohammad Reza; Li, Han; Venugopal, Srikumar; Guo, Wenxia; He, MingYun; Tian, Wenhong
err分享
err收藏
Comparison between technetium-99m methoxyisobutylisonitrile scintigraphy and ultrasound in the diagnosis of parathyroid adenoma and parathyroid hyperplasia
err2018-12-01
err0
errOAAI
errJianjun Xue; Yan Liu; Ting Ji; Aomei Zhao; Yiqian Liang; Huixing Deng; Qi Wang; Yuemin Zhang; Lulu Yang; Aimin Yang
err分享
err收藏
Impact of the FindMyApps program on people with mild cognitive impairment or dementia and their caregivers; an exploratory pilot randomised controlled trial
err2020-11-27
err0
errOAAI
errKim M. Beentjes; David P. Neal; Yvonne J. F. Kerkhof; Caroline Broeder; Zaïnah D. J. Moeridjan; Teake P. Ettema; Wiesje Pelkmans; Majon M. Muller; Maud J. L. Graff; Rose-Marie Dröes
err分享
err收藏
学者 查看更多内容