arrow
返回

Dependent Task Offloading for Edge Computing based on Deep Reinforcement Learning

delete2022-10-01
delete106
delete
OA
AI
J
Jin Wang
J
Jia Hu
G
Geyong Min *
A
Albert Y. Zomaya
N
Nektarios Georgalas
DOI:10.1109/TC.2021.3131040delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Edge computing is an emerging promising computing paradigm that brings computation and storage resources to the network edge, hence significantly reducing the service latency and network traffic. In edge computing, many applications are composed of dependent tasks where the outputs of some are the inputs of others. How to offload these tasks to the network edge is a vital and challenging problem which aims to determine the placement of each running task in order to maximize the Quality-of-Service (QoS). Most of the existing studies either design heuristic algorithms that lack strong adaptivity or learning-based methods but without considering the intrinsic task dependency. Different from the existing work, we propose an intelligent task offloading scheme leveraging off-policy reinforcement learning empowered by a Sequence-to-Sequence (S2S) neural network, where the dependent tasks are represented by a Directed Acyclic Graph (DAG). To improve the training efficiency, we combine a specific off-policy policy gradient algorithm with a clipped surrogate objective. We then conduct extensive simulation experiments using heterogeneous applications modelled by synthetic DAGs. The results demonstrate that: 1) our method converges fast and steadily in training; 2) it outperforms the existing methods and approximates the optimal solution in latency and energy consumption under various scenarios.
Keyword:
Task analysis
Neural networks
Wireless communication
Energy consumption
Training
Reinforcement learning
Solid modeling
Multi-access edge computing
task offloading
deep reinforcement learning
sequence to sequence neural networks

期刊

IEEE Transactions on Computers 封面图
IEEE Transactions on Computers
IF:
3.8
论文数:
5.4K
被引数:
9.8K

机构

U
University of Sydney
学者数:
6.5W
论文数: 6.2W
被引数: 90
B
british telecom (bt)
学者数:
112
论文数: 101
被引数: 0
U
University of Exeter
学者数:
2.0W
论文数: 2.1W
被引数: 3.6W
学者 查看更多机构
引用论文

引用论文

S1-Leitlinie Post-COVID/Long-COVIDS1-Leitlinie后COVID/Long-COVID
err2021-09-02
err0
errOAAI
errAndreas Rembert Koczulla; Tobias Ankermann; Uta Behrends; Peter Berlit; Sebastian Böing; Folke Brinkmann; Christian Franke; Rainer Glöckl; Christian Gogoll; Thomas Hummel; Juliane Kronsbein; Thomas Maibaum; Eva M. J. Peters; Michael Pfeifer; Thomas Platz; Matthias Pletz; Georg Pongratz; Frank Powitz; Klaus F. Rabe; Carmen Scheibenbogen; Andreas Stallmach; Michael Stegbauer; Hans Otto Wagner; Christiane Waller; Hubert Wirtz; Andreas Zeiher; Ralf Harun Zwick
err分享
err收藏
Offloading in Mobile Edge Computing: Task Allocation and Computational Frequency Scaling
err2017-01-01
err754
PREAI
errThinh Quang Dinh; Tang, Jianhua; La, Quang Duy; Quek, Tony Q. S.
err分享
err收藏
Learning for Computation Offloading in Mobile Edge Computing
err2018-12-01
err156
PREAI
errDinh, Thinh Quang; La, Quang Duy; Quek, Tony Q. S.; Shin, Hyundong
err分享
err收藏
ULOOF: A User Level Online Offloading Framework for Mobile Edge Computing
err2018-11-01
err98
PREAI
errNeto, Jose Leal D.; Yu, Se-Young; Macedo, Daniel F.; Nogueira, Jose Marcos S.; Langar, Rami; Secci, Stefano
err分享
err收藏
Optimized Computation Offloading Performance in Virtual Edge Computing Systems via Deep Reinforcement Learning
err2019-06-01
err529
errOAAI
errChen, Xianfu; Zhang, Honggang; Wu, Celimuge; Mao, Shiwen; Ji, Yusheng; Bennis, Mehdi
err分享
err收藏
学者 查看更多内容