arrow
返回

Collaborative cloud-edge-end task offloading with task dependency based on deep reinforcement learning

delete2023-09-01
delete8
PRE
AI
T
Tiantian Tang
C
Chao Li
刘
刘发贵 (Fagui Liu) *
DOI:10.1016/j.comcom.2023.06.021delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
With the explosive growth of the Internet of Things (IoT), IoT devices generate massive amounts of data and demand, which poses a huge challenge to IoT devices with limited CPU computing capability and battery capacity. Due to the dependency relationship in complex applications and network environments, effective offloading in such scenarios is complicated. In this paper, we address the problem of computation offloading with task dependency in the cloud-edge-end collaboration scenario including multi-user, multi-core edge servers, and a cloud server. We model multiple task dependencies using the directed acyclic graph (DAG) and formalize the offloading problem as a multi-objective mixed integer optimization problem. To solve this problem, a Task Priority and Deep Reinforcement learning-based Task Offloading algorithm (TPDRTO) is proposed. The task offloading decision is represented as a Markov Decision Process (MDP). Meanwhile, based on the task priority, an optimized Deep Reinforcement Learning (DRL) method with action-mask is proposed to leverage the computing resources of the cloud and edge servers and obtain the optimal policies of computation offloading. Experimental results show that the TPDRTO algorithm can effectively tradeoff and reduce the average energy consumption and time delay of IoT devices.
Keyword:
Edge computing
Computation offloading
Cloud-edge-end collaboration
Task dependency

期刊

Computer Communications 封面图
Computer Communications
IF:
4.3
论文数:
596
被引数:
1.1W

机构

S
south china university of technology
学者数:
6.8W
论文数: 5.1W
被引数: 85
引用论文

引用论文

err分享
err收藏
Deep Reinforcement Learning: A Brief Survey深度强化学习: 简要综述
err2017-11-01
err2.4K
errOAAI
errArulkumaran, Kai; Deisenroth, Marc Peter; Brundage, Miles; Bharath, Anil Anthony
err分享
err收藏
Toward Low-Latency and Ultra-Reliable Virtual Reality
err2018-03-01
err383
errOAAI
errElbamby, Mohammed S.; Perfecto, Cristina; Bennis, Mehdi; Doppler, Klaus
err分享
err收藏
Implementing action mask in proximal policy optimization (PPO) algorithm
err2020-09-01
err34
errOAAI
errTang, Cheng-Yen; Liu, Chien-Hung; Chen, Woei-Kae; You, Shingchern D.
err分享
err收藏
Energy-Optimal Mobile Cloud Computing under Stochastic Wireless Channel
err2013-09-01
err699
PREAI
errZhang, Weiwen; Wen, Yonggang; Guan, Kyle; Kilper, Dan; Luo, Haiyun; Wu, Dapeng Oliver
err分享
err收藏
学者 查看更多内容