返回
Joint Computation Offloading and Resource Allocation for D2D-Assisted Mobile Edge Computing
DOI:10.1109/TSC.2022.3190276.png)
摘要
En 中文
Computation offloading via device-to-device communications can improve the performance of mobile edge computing by exploiting the computing resources of user devices. However, most proposed optimization-based computation offloading schemes lack self-adaptive abilities in dynamic environments due to time-varying wireless environment, continuous-discrete mixed actions, and coordination among devices. The conventional reinforcement learning based approaches are not effective for solving an optimal sequential decision problem with continuous-discrete mixed actions. In this paper, we propose a hierarchical deep reinforcement learning (HDRL) framework to solve the joint computation offloading and resource allocation problem. The proposed HDRL framework has a hierarchical actor-critic architecture with a meta critic, multiple basic critics and actors. Specifically, a combination of deep Q-network (DQN) and deep deterministic policy gradient (DDPG) is exploited to cope with the continuous-discrete mixed action spaces. Furthermore, to handle the coordination among devices, the meta critic acts as a DQN to output the joint discrete action of all devices and each basic critic acts as the critic part of DDPG to evaluate the output of the corresponding actor. Simulation results show that the proposed HDRL algorithm can significantly reduce the task computation latency compared with baseline offloading schemes.
Keyword:
Task analysis
Servers
Resource management
Device-to-device communication
Wireless communication
Mobile handsets
Energy consumption
Computation offloading
deep reinforcement learning
Index Terms
device-to-device
mobile edge computing
resource allocation
期刊
IF:
5.8
论文数:
2.2K
被引数:
6.5K
机构
引用论文
Hybrid Trypsinized Nucleosomal Arrays: Identification of Multiple Functional Roles of the H2A/H2B and H3/H4 N-Termini in Chromatin Fiber Compaction
Biochemistry
IF0
Joint Task Assignment and Resource Allocation for D2D-Enabled Mobile-Edge ComputingD2D-Enabled移动-边缘计算联合任务分配与资源分配
Smart Healthcare: RL-Based Task Offloading Scheme for Edge-Enable Sensor Networks
IEEE SENSORS JOURNAL
IF4.5

