arrow
Return

UAV-assisted dependency-aware computation offloading in device-edge-cloud collaborative computing based on improved actor-critic DRL

delete2024-09-01
delete2
PRE
AI
张龙信 (Longxin Zhang)
R
Runti Tan
Y
Yanfen Zhang
J
Jiwu Peng *
J
Jing Liu
李克勤 cover
李克勤 (Keqin Li)
DOI:10.1016/j.sysarc.2024.103215delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Unmanned aerial vehicle (UAV)-assisted mobile edge computing (MEC) has become a popular research topic, addressing challenges posed by the pressure of cloud computing and the limited service scope of MEC. However, the limited computing resources of UAVs and the data dependency of specific tasks hinder the practical implementation of efficient computational offloading (CO). Accordingly, a device-edge-cloud collaborative computing model is proposed in this study to provide complementary offloading services. This model considers stochastic movement and channel obstacles, representing the dependency relationships as a directed acyclic graph. An optimization problem is formulated to simultaneously optimize system costs (i.e., delay and energy consumption) and UAV endurance, taking into account resource and task-dependent constraints. Additionally, a saturated training SAC-based UAV-assisted dependency-aware computation offloading algorithm (STS-UDCO) is developed. STS-UDCO learns the entropy and value of the CO policy to efficiently approximate the optimal solution. The adaptive saturation training rule proposed in STS-UDCO dynamically controls the update frequency of the critic based on the current fitted state to enhance training stability. Finally, extensive experiments demonstrate that STS-UDCO achieves superior convergence and stability, while also reducing the system total cost and convergence speed by at least 11.83% and 39.10%, respectively, compared with other advanced algorithms.
Keywords:
Computation offloading
Device-edge-cloud collaboration
Dependent application
Soft actor-critic
UAV assistance

Journal

Journal of Systems Architecture cover
Journal of Systems Architecture
IF:
4.1
Papers:
3.0K
Citations:
4.2K

Organization

H
hunan university of finance & economics
Scholars:
245
Papers: 250
Citations: 0
S
state university of new york (suny) system
Scholars:
6.5W
Papers: 5.8W
Citations: 65
H
Hunan University of Technology
Scholars:
3.5K
Papers: 2.2K
Citations: 4.7K
researcher View more organizations