1
Return

DRL-Based Trajectory Optimization and Task Offloading in Hierarchical Aerial MEC

delete2025-02-01
delete0
PRE
AI
Z
Zhihao Hu
Y
Yaozong Yang
W
Wei Gu
Y
Ying Chen *
J
Jiwei Huang
DOI:10.1109/JIOT.2024.3480248delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
With the arrival of the 6G era, there is a rapid increase in computational demands, and multiaccess edge computing (MEC) has emerged as an effective mechanism to satisfy these needs. In disaster-affected or remote areas where ground base stations may struggle to provide service, unmanned aerial vehicle (UAV), and high-altitude platforms (HAPs) can leverage their flexible deployment capabilities to offer MEC services. In this article, we design a layered aerial computing framework comprising user equipments (UEs), UAV, and HAP. Building upon this, we establish a hierarchical offloading computation model and formulate an optimization problem to maximize resource utilization and task scheduling within the model. Specifically, the objective is to minimize task computation delay and maximize the remaining energy of the UAV, i.e., minimize energy consumption, subject to constraints on the total task quantity, delay requirements and UAV energy limitations. Due to the nonconvex and highly complex nature of this objective problem, we propose a deep reinforcement learning-based trajectory optimization and task offloading (DTOTO) algorithm that enables the agent, the UAV, to make correct decisions in complex environments and high-dimensional action spaces. The algorithm is capable of optimizing the UAV's trajectory to obtain the correct offloading decisions. Additionally, we employ state normalization to improve training efficiency. Simulation experiment results validate the effectiveness of the computing framework and the DTOTO algorithm, and numerical results analyze to evaluate system performance.
Keywords:
Autonomous aerial vehicles
Delays
Computational modeling
Heuristic algorithms
Servers
Energy consumption
Disasters
Adaptation models
Computer architecture
Bandwidth
Deep reinforcement learning (DRL)
hierarchical aerial computing
multiaccess edge computing (MEC)
task offloading
unmanned aerial vehicle (UAV)

Journal

IEEE Internet of Things Journal cover
IEEE Internet of Things Journal
IF:
8.9
Papers:
1.4W
Citations:
7.8W

Organization

C
china university of petroleum
Scholars:
4.0W
Papers: 2.7W
Citations: 30
Cited Papers

Cited Papers

Citing Papers

Citing Papers