1
Return

An Energy-Efficient Deep Reinforcement Learning Framework for Joint UAV Trajectory Optimization in Logistics-Assisted 5G/6G Cellular Networks

delete2026-02-23
delete0
PRE
AI
S
Saeid Iranmanesh
R
Raad Raad
M
Meisam Sharifi Sani
DOI:10.1109/tvt.2026.3666035delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Uncrewed Aerial Vehicles (UAVs) offer significant potential for dual-purpose operations, simultaneously enhancing 5/6G cellular network capacity and providing logistics services such as parcel delivery. However, existing trajectory optimization approaches rely on idealized disk coverage models that ignore realistic channel effects, leading to inefficient energy consumption and poor communication reliability. This paper proposes a novel Energy Consumption, Throughput, and Delay (ECTD) optimization framework that leverages Deep Reinforcement Learning (DRL) with attention mechanisms to address the NP-hard combinatorial-continuous optimization challenge of jointly determining UAV visiting sequences (discrete) and contact locations (continuous) for dual-purpose logistics-cellular missions. The DRL approach enables learning generalizable policies across variable cluster configurations while handling the joint discrete-continuous decision space that traditional optimization methods cannot efficiently solve. The ECTD algorithm employs an attention-based graph neural network architecture with greedy rollout baseline and incorporates a realistic Packet Reception Ratio-based coverage model with Nakagami-<inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$m$</tex-math></inline-formula> fading. Extensive simulation results demonstrate that the proposed framework achieves up to 12% energy savings over state-of-the-art DRL methods (DDPG, PPO, A3C, SAC) and up to 37% compared to heuristic approaches (TSP, CARLO, ENERGENT, ECAE). The algorithm achieves network throughput improvements of up to 37%, maintains communication reliability above 90% under fading conditions.
Keywords:
Logistics networks
UAVs
trajectory optimization
deep reinforcement learning
machine learning
flight path planning
cellular networks
network throughput
energy optimization
attention-based

Journal

IEEE Transactions on Vehicular Technology cover
IEEE Transactions on Vehicular Technology
IF:
7.1
Papers:
1.7W
Citations:
6.6W

Organization

U
university of wollongong
Scholars:
1.5K
Papers: 788
Citations: 0
Cited Papers

Cited Papers

Citing Papers

Citing Papers