arrow
返回

Joint Computation Offloading and Trajectory Optimization for Edge Computing UAV: A KNN-DDPG Algorithm

delete2024-10-09
delete2
delete
OA
AI
Y
Yiran Lu
C
Chi Xu *
Y
Yitian Wang
DOI:10.3390/drones8100564delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Unmanned aerial vehicles (UAVs) are widely used to improve the coverage and communication quality of wireless networks and assist mobile edge computing (MEC) due to their flexible deployments. However, the UAV-assisted MEC systems also face challenges in terms of computation offloading and trajectory planning in the dynamic environment. This paper employs deep reinforcement learning to jointly optimize the computation offloading and trajectory planning for UAV-assisted MEC system. Specifically, this paper investigates a general scenario where multiple pieces of user equipment (UE) offload tasks to a UAV equipped with a MEC server to collaborate on a complex job. By fully considering UAV and UE movement, computation offloading ratio, and blocked relations, a joint computation offloading and trajectory optimization problem is formulated to minimize the maximum computational delay. Due to the non-convex nature of the problem, it is converted into a Markov decision process, and solved by the deep deterministic policy gradient (DDPG) algorithm. To enhance the exploration capability and stability of DDPG, the K-nearest neighbor (KNN) algorithm is employed, namely KNN-DDPG. Moreover, the prioritized experience replay algorithm, where the constant learning rate is replaced by the decaying learning rate, is utilized to enhance the converge. To validate the effectiveness and superiority of the proposed algorithm, KNN-DDPG is compared with the benchmark DDPG algorithm. Simulation results demonstrate that KNN-DDPG can converge and achieve 3.23% delay reduction compared to DDPG.
Keyword:
unmanned aerial vehicle
mobile edge computing
computation offloading
deep deterministic policy gradient
K-nearest neighbor

期刊

D
Drones
IF:
4.8
论文数:
3.9K
被引数:
8.3K

机构

S
Shenyang University of Chemical Technology
学者数:
3.3K
论文数: 1.9K
被引数: 2.4K
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

Rural Non-Farm Engagement and Agriculture Commercialization in Ghana: Complements or Competitors?农村非农参与和农业商业化在加纳:互补还是竞争?
err2018-01-01
err0
PREAI
errPaul Kwame Nkegbe; Abdelkrim Araar; Benjamin Abu; Yazidu Ustarz; Hamdiyah Alhassan; Edinam Dope Setsoafia; Shamsia Abdul-Wahab
err分享
err收藏
Power Control in UAV-Supported Ultra Dense Networks: Communications, Caching, and Energy Transfer
err2018-06-01
err142
errOAAI
errWang, Haichao; Ding, Guoru; Gao, Feifei; Chen, Jin; Wang, Jinlong; Wang, Le
err分享
err收藏
UAV-Aided Offloading for Cellular Hotspot
err2018-06-01
err259
errOAAI
errLyu, Jiangbin; Zeng, Yong; Zhang, Rui
err分享
err收藏
ARTIFICIAL INTELLIGENCE EMPOWERED EDGE COMPUTING AND CACHING FOR INTERNET OF VEHICLES
err2019-06-01
err206
PREAI
errDai, Yueyue; Xu, Du; Maharjan, Sabita; Qiao, Guanhua; Zhang, Yan
err分享
err收藏
err
IF0
err
err0
errOAAI
err
err分享
err收藏
A Survey on Mobile Edge Computing: The Communication Perspective移动边缘计算综述: 通信视角
err2017-01-01
err2.6K
errOAAI
errMao, Yuyi; You, Changsheng; Zhang, Jun; Huang, Kaibin; Letaief, Khaled B.
err分享
err收藏
学者 查看更多内容