arrow
Return

Dynamic Normalization TD3-Based Task Offloading for UAV-Assisted Collaborative Computing

delete2026-02-24
delete0
PRE
AI
X
Xin Song
B
Biao Zhang
Z
Ze Fan
R
Ruomeng Li
S
Siyang Xu
DOI:10.1109/TNSM.2026.3667404delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
To meet the computational requirements of computation-intensive and delay-sensitive applications, we construct an Unmanned Aerial Vehicle (UAV)-assisted three-layer collaborative computing framework that integrates local, edge, and cloud computing resources. However, in dynamic UAV-assisted environments, some existing approaches lack adaptability and struggle to effectively balance delay and energy consumption. To address these challenges, we formulate a joint optimization problem that minimizes the weighted sum of delay and energy consumption, where adaptive weight factors are dynamically adjusted according to system state variations. Due to the non-convex and high-dimensional nature of our proposed problem, traditional optimization methods are generally inadequate. Hence, the problem is modeled as a Markov Decision Process (MDP), and a normalization-based reward function is designed to eliminate the dimensional imbalance between delay and energy consumption. A Dynamic Normalization Twin Delayed Deep Deterministic Policy Gradient (DN-TD3) algorithm is then proposed, which incorporates mechanisms of adaptive exploration and critic-driven policy updates to enhance convergence stability and reduce sensitivity to hyperparameters. Simulation results demonstrate that the proposed DN-TD3 algorithm outperforms benchmark schemes in terms of system cost reduction, convergence speed, and overall stability.
Keywords:
Computation offloading
mobile edge computing
unmanned aerial vehicle
deep reinforcement learning
quality of service

Journal

IEEE Transactions on Network and Service Management cover
IEEE Transactions on Network and Service Management
IF:
5.4
Papers:
649
Citations:
9.2K

Organization

N
northeastern university
Scholars:
4.4K
Papers: 1.9K
Citations: 2
Cited Papers

Cited Papers

errShare
errSave
errShare
errSave
Stability and Accuracy-Aware Learning for Task Offloading in UAV-MEC-Assisted Smart Farms
err
IF0
err2024-10-01
err0
PREAI
errFahime Khoramnejad; Aisha Syed; W. Sean Kennedy; Melike Erol-Kantarci
errShare
errSave
Maximizing Energy Efficiency in UAV-Assisted NOMA-MEC Networks
err2023-12-15
err31
PREAI
errLiu, Zhixin; Qi, Junxiao; Shen, Yanyan; Ma, Kai; Guan, Xinping
errShare
errSave
Energy-Latency Tradeoff for Energy-Aware Offloading in Mobile Edge Computing Networks
err2018-08-01
err451
PREAI
errZhang, Jiao; Hu, Xiping; Ning, Zhaolong; Ngai, Edith C. -H.; Zhou, Li; Wei, Jibo; Cheng, Jun; Hu, Bin
errShare
errSave
Deep Reinforcement Learning for Energy-Efficient Computation Offloading in Mobile-Edge Computing
err2022-01-15
err173
PREAI
errZhou, Huan; Jiang, Kai; Liu, Xuxun; Li, Xiuhua; Leung, Victor C. M.
errShare
errSave
Delay and Energy Minimization for Cooperative NOMA-MEC Networks With SWIPT Aided by RIS
err2024-04-01
err8
PREAI
errYang, Zheng; Xia, Lu; Cui, Jingjing; Dong, Zhicheng; Ding, Zhiguo
errShare
errSave
Digital Twin Enhanced Federated Reinforcement Learning With Lightweight Knowledge Distillation in Mobile Networks
err2023-10-01
err38
PREAI
errZhou, Xiaokang; Zheng, Xuzhe; Cui, Xuesong; Shi, Jiashuai; Liang, Wei; Yan, Zheng; Yang, Laurence T.; Shimizu, Shohei; Wang, Kevin I-Kai
errShare
errSave
researcher View more