arrow
返回

A PDDQNLP Algorithm for Energy Efficient Computation Offloading in UAV-Assisted MEC

delete2023-12-01
delete31
PRE
AI
N
Na Lin
L
Liang Zhao *
万少华 封面图
万少华 (Shaohua Wan)
A
Ammar Hawbani
M
Mohsen Guizani
DOI:10.1109/TWC.2023.3266497delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Unmanned aerial vehicle (UAV)-assisted mobile edge computing (MEC) is a promising technology to provide computational services to ground terminal devices (TDs) in remote areas or for emergency incidents with its flexibility and mobility. This paper aims to maximize the UAV's energy efficiency while considering the fairness of offloading. We formulate this optimization problem by jointly considering the UAV flight time, the UAV 3D trajectory, the TD binary offloading decisions, and the time allocated to TDs, which is a mixed-integer nonlinear programming problem. The problem is transformed into two sub-problems and we propose a PDDQNLP (parametrized dueling deep Q-network and linear programming) algorithm based on the combination of deep reinforcement learning (DRL) and linear programming (LP) to address them. For the first sub-problem, a DRL-based algorithm is used to optimize the TD offloading decisions, the UAV trajectory, and the UAV flight time. The action space is hybrid that contains discrete actions (e.g., binary offloading) and continuous actions (e.g., UAV flight time). Therefore, we parameterize the action space and propose the PDDQN algorithm, which combines the DDPG algorithm for handling the continuous action space and the Dueling DQN algorithm for handling the discrete action space. According to the solution obtained from the first sub-problem, the LP is used to adjust the time allocated to TDs in the second sub-problem. The numerical results show that the PDDQNLP algorithm outperforms its counterparts.
Keyword:
UAV
MEC
computation offloading
energy efficiency
PDDQN
and time optimization

期刊

IEEE Transactions on Wireless Communications 封面图
IEEE Transactions on Wireless Communications
IF:
10.7
论文数:
1.3W
被引数:
5.3W

机构

S
shenzhen institute for advanced study, uestc
学者数:
419
论文数: 371
被引数: 1
S
Shenyang Aerospace University
学者数:
3.1K
论文数: 1.9K
被引数: 2.0K
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
学者 查看更多机构
引用论文

引用论文

Deep Reinforcement Learning for Minimizing Age-of-Information in UAV-assisted Networks
err2019-12-01
err85
errOAAI
errAbd-Elmagid, Mohamed A.; Ferdowsi, Aidin; Dhillon, Harpreet S.; Saad, Walid
err分享
err收藏
Assessment of human body influence on exposure measurements of electric field in indoor enclosures
err2014-11-14
err0
PREAI
errSilvia de Miguel‐Bilbao; Jorge García; Victoria Ramos; Juan Blas
err分享
err收藏
学者 查看更多内容