arrow
返回

Joint Computation Offloading and Resource Allocation for D2D-Assisted Mobile Edge Computing

delete2022-01-01
delete18
delete
OA
AI
W
Wei Jiang
D
Daquan Feng *
Y
Yao Sun
G
Gang Feng
Z
Zhenzhong Wang
X
Xiang‐Gen Xia
DOI:10.1109/TSC.2022.3190276delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Computation offloading via device-to-device communications can improve the performance of mobile edge computing by exploiting the computing resources of user devices. However, most proposed optimization-based computation offloading schemes lack self-adaptive abilities in dynamic environments due to time-varying wireless environment, continuous-discrete mixed actions, and coordination among devices. The conventional reinforcement learning based approaches are not effective for solving an optimal sequential decision problem with continuous-discrete mixed actions. In this paper, we propose a hierarchical deep reinforcement learning (HDRL) framework to solve the joint computation offloading and resource allocation problem. The proposed HDRL framework has a hierarchical actor-critic architecture with a meta critic, multiple basic critics and actors. Specifically, a combination of deep Q-network (DQN) and deep deterministic policy gradient (DDPG) is exploited to cope with the continuous-discrete mixed action spaces. Furthermore, to handle the coordination among devices, the meta critic acts as a DQN to output the joint discrete action of all devices and each basic critic acts as the critic part of DDPG to evaluate the output of the corresponding actor. Simulation results show that the proposed HDRL algorithm can significantly reduce the task computation latency compared with baseline offloading schemes.
Keyword:
Task analysis
Servers
Resource management
Device-to-device communication
Wireless communication
Mobile handsets
Energy consumption
Computation offloading
deep reinforcement learning
Index Terms
device-to-device
mobile edge computing
resource allocation

期刊

IEEE Transactions on Services Computing 封面图
IEEE Transactions on Services Computing
IF:
5.8
论文数:
2.2K
被引数:
6.5K

机构

U
University of Delaware
学者数:
1.3W
论文数: 1.3W
被引数: 2.0W
S
shenzhen university
学者数:
4.6W
论文数: 3.4W
被引数: 72
U
university of glasgow
学者数:
3.5W
论文数: 3.1W
被引数: 37
学者 查看更多机构
引用论文

引用论文

Mobile-Edge Computing: Partial Computation Offloading Using Dynamic Voltage Scaling
err2016-01-01
err867
PREAI
errWang, Yanting; Sheng, Min; Wang, Xijun; Wang, Liang; Li, Jiandong
err分享
err收藏
Smart Healthcare: RL-Based Task Offloading Scheme for Edge-Enable Sensor Networks
err2021-11-15
err64
PREAI
errYadav, Rahul; Zhang, Weizhe; Elgendy, Ibrahim A.; Dong, Guozhong; Shafiq, Muhammad; Laghari, Asif Ali; Prakash, Shiv
err分享
err收藏
Collaborative Mobile Edge Computing in 5G Networks: New Paradigms, Scenarios, and Challenges
err2017-04-01
err504
errOAAI
errTran, Tuyen X.; Hajisami, Abolfazl; Pandey, Parul; Pompili, Dario
err分享
err收藏
Learning for Computation Offloading in Mobile Edge Computing
err2018-12-01
err156
PREAI
errDinh, Thinh Quang; La, Quang Duy; Quek, Tony Q. S.; Shin, Hyundong
err分享
err收藏
Computation Offloading in Multi-Access Edge Computing: A Multi-Task Learning Approach
err2021-09-01
err136
PREAI
errYang, Bo; Cao, Xuelin; Bassey, Joshua; Li, Xiangfang; Qian, Lijun
err分享
err收藏
Optimized Computation Offloading Performance in Virtual Edge Computing Systems via Deep Reinforcement Learning
err2019-06-01
err529
errOAAI
errChen, Xianfu; Zhang, Honggang; Wu, Celimuge; Mao, Shiwen; Ji, Yusheng; Bennis, Mehdi
err分享
err收藏
学者 查看更多内容