arrow
返回

Optimization for computational offloading in multi-access edge computing: A deep reinforcement learning scheme

delete2022-02-01
delete21
PRE
AI
王坚 封面图
王坚 (Jian Wang)
H
Hongchang Ke
刘
刘雪洁 (Xuejie Liu) *
王辉 封面图
王辉 (Hui Wang)
DOI:10.1016/j.comnet.2021.108690delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Owing to their limited computing power and battery level, wireless users (WUs) can hardly handle compute-intensive workflows by the local processor. Multi-access edge computing (MEC) servers attached to base stations have ample computing power and communication resources, which can be used to address the computation tasks or workloads of WUs. In this study, we design a framework with multiple static and vehicle-assisted MEC servers to handle the workloads offloaded by WUs. For obtaining the optimal computation offloading scheme to minimize the weighted sum cost, including transmission and execution cost, energy consumption cost, and communication bandwidth cost, we model the offloading decision optimization problem as a Markov decision process (MDP). Then, we propose a partial computation offloading scheme based on reinforcement learning (RL) to address the absence of priori knowledge. The proposed scheme can learn the optimal offloading decision based on stochastic workload arrival, the changing channel state, and the dynamic distance between WUs and the edge servers. Moreover, to avoid the curse of dimensionality caused by the complex state and action spaces, we present an improved computation offloading method based on deep RL (DRL) to learn the optimal offloading policy using deep neural networks. Extensive numerical results illustrate that the proposed algorithms based on RL and DRL can autonomously learn the optimal computation offloading policy with no priori knowledge, and their performance are better than that of four baselines algorithms.
Keyword:
Multi-access edge computing
Computation offloading
Markov decision process
Reinforcement learning

期刊

Computer Networks 封面图
Computer Networks
IF:
4.6
论文数:
1.7K
被引数:
1.6W

机构

C
Changchun University of Technology
学者数:
5.0K
论文数: 2.7K
被引数: 3.3K
J
Jilin University
学者数:
8.7W
论文数: 5.6W
被引数: 8.9K
引用论文

引用论文

err分享
err收藏
err分享
err收藏
Optimized Computation Offloading Performance in Virtual Edge Computing Systems via Deep Reinforcement Learning
err2019-06-01
err529
errOAAI
errChen, Xianfu; Zhang, Honggang; Wu, Celimuge; Mao, Shiwen; Ji, Yusheng; Bennis, Mehdi
err分享
err收藏
Analysis on smart material suitable for autogenous microelectronic application
err2019-08-30
err0
PREAI
errR Sitharthan; Manimaran Ponnusamy; Madurakavi Karthikeyan; D Shanmuga Sundar
err分享
err收藏
学者 查看更多内容