arrow
Return

Multi-Agent Deep Reinforcement Learning for Computation Offloading and Interference Coordination in Small Cell Networks

delete2021-09-01
delete119
PRE
AI
X
Xiaoyan Huang
S
Supeng Leng
S
Sabita Maharjan
张彦 cover
张彦 (Yan Zhang) *
DOI:10.1109/TVT.2021.3096928delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Integrating mobile edge computing (MEC) with small cell networks has been conceived as a promising solution to provide pervasive computing services. However, the interactions among small cells due to inter-cell interference, the diverse application-specific requirements, as well as the highly dynamic wireless environment make it challenging to design an optimal computation offloading scheme. In this paper, we focus on the joint design of computation offloading and interference coordination for edge intelligence empowered small cell networks. To this end, we propose a distributed multi-agent deep reinforcement learning (DRL) scheme with the objective of minimizing the overall energy consumption while ensuring the latency requirements. Specifically, we exploit the collaboration among small cell base station (SBS) agents to adaptively adjust their strategies, considering computation offloading, channel allocation, power control, and computation resource allocation. Further, to decrease the computation complexity and signaling overhead of the training process, we design a federated DRL scheme which only requires SBS agents to share their model parameters instead of local training data. Numerical results demonstrate that our proposed schemes can significantly reduce the energy consumption and effectively guarantee the latency requirements compared with the benchmark schemes.
Keywords:
Task analysis
Resource management
Microcell networks
Computational modeling
Servers
Interference
Reinforcement learning
Mobile edge computing
small cell networks
multi-agent deep reinforcement learning
computation offloading
interference coordination

Journal

IEEE Transactions on Vehicular Technology cover
IEEE Transactions on Vehicular Technology
IF:
7.1
Papers:
1.8W
Citations:
6.6W

Organization

U
university of oslo
Scholars:
4.2W
Papers: 3.5W
Citations: 53