arrow
Return

Hypergraph convolution mix DDPG for multi-aerial base station deployment

delete2023-12-06
delete2
delete
OA
AI
H
Haoran He
F
Fanqin Zhou
赵一琨 cover
赵一琨 (Yikun Zhao)
W
Wenjing Li *
L
Lei Feng
DOI:10.1186/s13677-023-00556-xdelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Aerial base stations (AeBS), as crucial components of air-ground integrated networks, can serve as the edge nodes to provide flexible services to ground users. Optimizing the deployment of multiple AeBSs to maximize system energy efficiency is currently a prominent and actively researched topic in the AeBS-assisted edge-cloud computing network. In this paper, we deploy AeBSs using multi-agent deep reinforcement learning (MADRL). We describe the multi-AeBS deployment challenge as a decentralized partially observable Markov decision process (Dec-POMDP), taking into consideration the constrained observation range of AeBSs. The hypergraph convolution mix deep deterministic policy gradient (HCMIX-DDPG) algorithm is designed to maximize the system energy efficiency. The proposed algorithm uses the value decomposition framework to solve the lazy agent problem, and hypergraph convolutional (HGCN) network is introduced to strengthen the cooperative relationship between agents. Simulation results show that the suggested HCMIX-DDPG algorithm outperforms alternative baseline algorithms in the multi-AeBS deployment scenario.
Keywords:
Aerial base station (AeBS)
Multi-agent deep reinforcement learning (MADRL)
Hypergraph convolution (HGCN)
Value decomposition, energy efficiency optimization

Journal

J
Journal of Cloud Computing-Advances Systems and Applications
IF:
4.3
Papers:
731
Citations:
2.2K

Organization

B
beijing university of posts & telecommunications
Scholars:
1.4W
Papers: 1.2W
Citations: 9