arrow
Return

Dynamic Task Offloading in Edge Computing Based on Dependency-Aware Reinforcement Learning

delete2024-04-01
delete1
PRE
AI
X
Xiangchun Chen
J
Jiannong Cao
Y
Yuvraj Sahni
江
江山 (Shan Jiang) *
Z
Zhixuan Liang
DOI:10.1109/TCC.2024.3381646delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Collaborative edge computing (CEC) is an emerging computing paradigm in which edge nodes collaborate to perform tasks from end devices. Task offloading decides when and at which edge node tasks are executed. Most existing studies assume task profiles and network conditions are known in advance, which can hardly adapt to dynamic real-world computation environments. Some learning-based methods use online task offloading without considering task dependency and network flow scheduling, leading to underutilized resources and flow congestion. We study Online Dependent Task Offloading (ODTO) in CEC, jointly optimizing network flow scheduling to optimize quality of service by reducing task completion time and energy consumption. The challenge of ODTO lies in how to offload dependent tasks and schedule network flows in dynamic networks. We model ODTO as the Markov Decision Process (MDP) and propose an Asynchronous Deep Progressive Reinforcement Learning (ADPRL) approach that optimize offloading and bandwidth decisions. We design a novel dependency-aware reward mechanism to address task dependency and dynamic network. Extensive experiments on the Alibaba cluster trace dataset and synthetic dataset indicate that our algorithm outperforms heuristic and learning-based methods in average task completion time and energy consumption.
Keywords:
Collaborative edge computing
deep reinforcement learning
network flow scheduling
task offloading

Journal

I
IEEE Transactions on Cloud Computing
IF:
5
Papers:
1.9K
Citations:
4.3K

Organization

H
hong kong polytechnic university
Scholars:
3.0W
Papers: 4.1W
Citations: 921
Cited Papers

Cited Papers

errShare
errSave
Blockchain-based Collaborative Edge Intelligence for Trustworthy and Real-Time Video Surveillance
err2023-02-01
err24
errOAAI
errZhang, Mingjin; Cao, Jiannong; Sahni, Yuvraj; Chen, Qianyi; Jiang, Shan; Yang, Lei
errShare
errSave
Sustainable Environmental Monitoring via Energy and Information Efficient Multinode Placement
err2023-12-15
err5
errOAAI
errAhmad, Sabtain; Uyanik, Halit; Ovatman, Tolga; Sandikkaya, Mehmet Tahir; De Maio, Vincenzo; Brandic, Ivona; Aral, Atakan
errShare
errSave
Multihop Offloading of Multiple DAG Tasks in Collaborative Edge Computing
err2021-03-15
err63
errOAAI
errSahni, Yuvraj; Cao, Jiannong; Yang, Lei; Ji, Yusheng
errShare
errSave
Dependent Task Offloading for Edge Computing based on Deep Reinforcement Learning
err2022-10-01
err106
errOAAI
errWang, Jin; Hu, Jia; Min, Geyong; Zhan, Wenhan; Zomaya, Albert Y.; Georgalas, Nektarios
errShare
errSave
Conditioned medium obtained from mesenchymal stem cells attenuates focal cerebral ischemia reperfusion injury through activation of ERK1/ERK2-BDNF signaling pathway
err2019-04-01
err0
PREAI
errNahid Aboutaleb; Masoumeh Faezi; Solmaz Nasseri Maleki; Donya Nazarinia; Seyed Mohammad Taghi Razavi Tousi; Narjes Hashemirad
errShare
errSave
researcher View more