arrow
返回

Structure-Aware Reinforcement Learning for Node-Overload Protection in Mobile Edge Computing

delete2022-12-01
delete2
delete
OA
AI
A
Anirudha Jitani *
A
Aditya Mahajan
Z
Zhongwen Zhu
H
Hatem Abou-Zeid
E
Emmanuel Thepie Fapi
H
Hakimeh Purmehdi
DOI:10.1109/TCCN.2022.3195503delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Mobile Edge Computing (MEC) involves placing computational capability and applications at the edge of the network, providing benefits such as reduced latency, reduced network congestion, and improved performance of applications. The performance and reliability of MEC degrades significantly when the edge server(s) in the cluster are overloaded. In this work, an adaptive admission control policy to prevent edge node from getting overloaded is presented. This approach is based on a recently-proposed low complexity RL (Reinforcement Learning) algorithm called SALMUT (Structure-Aware Learning for Multiple Thresholds), which exploits the structure of the optimal admission control policy in multi-class queues for an average-cost setting. We extend the framework to work for node overload-protection problem in a discounted-cost setting. The proposed solution is validated using several scenarios mimicking real-world deployments in two different settings - computer simulations and a docker testbed. Our empirical evaluations show that the total discounted cost incurred by SALMUT is similar to state-of-the-art deep RL algorithms such as PPO (Proximal Policy Optimization) and A2C (Advantage Actor Critic) but requires an order of magnitude less time to train, outputs easily interpretable policy, and can be deployed in an online manner.
Keyword:
Communication systems
mobile communications
Markov process
adaptive control
traffic control (communications)

期刊

I
IEEE Transactions on Cognitive Communications and Networking
IF:
7
论文数:
1.6K
被引数:
5.5K

机构

U
University of Calgary
学者数:
3.8W
论文数: 3.3W
被引数: 52
A
AstraZeneca
学者数:
2.1W
论文数: 1.1W
被引数: 36
M
McGill University
学者数:
5.5W
论文数: 4.9W
被引数: 7.0W
学者 查看更多机构
引用论文

引用论文

Stigmatic high throughput monochromator for soft x rays
err1986-12-01
err0
PREAI
errMichael C. Hettrick; James H. Underwood
err分享
err收藏
Explicit and implicit reinforcement learning across the psychosis spectrum.
err2017-07-01
err0
errOAAI
errDeanna M. Barch; Cameron S. Carter; James M. Gold; Sheri L. Johnson; Ann M. Kring; Angus W. MacDonald; Diego A. Pizzagalli; J. Daniel Ragland; Steven M. Silverstein; Milton E. Strauss
err分享
err收藏
Optimized Computation Offloading Performance in Virtual Edge Computing Systems via Deep Reinforcement Learning
err2019-06-01
err529
errOAAI
errChen, Xianfu; Zhang, Honggang; Wu, Celimuge; Mao, Shiwen; Ji, Yusheng; Bennis, Mehdi
err分享
err收藏
err分享
err收藏
A Survey on Mobile Edge Computing: The Communication Perspective移动边缘计算综述: 通信视角
err2017-01-01
err2.6K
errOAAI
errMao, Yuyi; You, Changsheng; Zhang, Jun; Huang, Kaibin; Letaief, Khaled B.
err分享
err收藏
学者 查看更多内容