arrow
Return

Collaborative cloud-edge-end task offloading with task dependency based on deep reinforcement learning

delete2023-09-01
delete8
PRE
AI
T
Tiantian Tang
C
Chao Li
刘
刘发贵 (Fagui Liu) *
DOI:10.1016/j.comcom.2023.06.021delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
With the explosive growth of the Internet of Things (IoT), IoT devices generate massive amounts of data and demand, which poses a huge challenge to IoT devices with limited CPU computing capability and battery capacity. Due to the dependency relationship in complex applications and network environments, effective offloading in such scenarios is complicated. In this paper, we address the problem of computation offloading with task dependency in the cloud-edge-end collaboration scenario including multi-user, multi-core edge servers, and a cloud server. We model multiple task dependencies using the directed acyclic graph (DAG) and formalize the offloading problem as a multi-objective mixed integer optimization problem. To solve this problem, a Task Priority and Deep Reinforcement learning-based Task Offloading algorithm (TPDRTO) is proposed. The task offloading decision is represented as a Markov Decision Process (MDP). Meanwhile, based on the task priority, an optimized Deep Reinforcement Learning (DRL) method with action-mask is proposed to leverage the computing resources of the cloud and edge servers and obtain the optimal policies of computation offloading. Experimental results show that the TPDRTO algorithm can effectively tradeoff and reduce the average energy consumption and time delay of IoT devices.
Keywords:
Edge computing
Computation offloading
Cloud-edge-end collaboration
Task dependency

Journal

Computer Communications cover
Computer Communications
IF:
4.3
Papers:
596
Citations:
1.1W

Organization

S
south china university of technology
Scholars:
6.8W
Papers: 5.1W
Citations: 85
Cited Papers

Cited Papers

Dependency-Aware Computation Offloading in Mobile Edge Computing: A Reinforcement Learning Approach
err2019-01-01
err49
PREAI
errPan, Shengli; Zhang, Zhiyong; Zhang, Zongwang; Zeng, Deze
errShare
errSave
Distributed Services Attestation in IoT
err2018-11-30
err0
PREAI
errMauro Conti; Edlira Dushku; Luigi V. Mancini
errShare
errSave
Deep Reinforcement Learning: A Brief Survey
err2017-11-01
err2.4K
errOAAI
errArulkumaran, Kai; Deisenroth, Marc Peter; Brundage, Miles; Bharath, Anil Anthony
errShare
errSave
Toward Low-Latency and Ultra-Reliable Virtual Reality
err2018-03-01
err383
errOAAI
errElbamby, Mohammed S.; Perfecto, Cristina; Bennis, Mehdi; Doppler, Klaus
errShare
errSave
Implementing action mask in proximal policy optimization (PPO) algorithm
err2020-09-01
err34
errOAAI
errTang, Cheng-Yen; Liu, Chien-Hung; Chen, Woei-Kae; You, Shingchern D.
errShare
errSave
Joint Task Offloading and Resource Allocation for IoT Edge Computing With Sequential Task Dependency
err2022-09-01
err40
errOAAI
errAn, Xuming; Fan, Rongfei; Hu, Han; Zhang, Ning; Atapattu, Saman; Tsiftsis, Theodoros A.
errShare
errSave
Energy-Optimal Mobile Cloud Computing under Stochastic Wireless Channel
err2013-09-01
err699
PREAI
errZhang, Weiwen; Wen, Yonggang; Guan, Kyle; Kilper, Dan; Luo, Haiyun; Wu, Dapeng Oliver
errShare
errSave
researcher View more