arrow
Return

DeepEdge: A Deep Reinforcement Learning Based Task Orchestrator for Edge Computing

delete2023-01-01
delete14
delete
OA
AI
B
Baris Yamansavascilar *
A
Ahmet Cihat Baktır
C
Cagatay Sonmez
A
Atay Özgövde
C
Cem Ersoy
DOI:10.1109/TNSE.2022.3217311delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The improvements in the edge computing technology pave the road for diversified applications that demand real-time interaction. However, due to the mobility of the end-users and the dynamic edge environment, it becomes challenging to handle the task offloading with high performance. Moreover, since each application in mobile devices has different characteristics, a task orchestrator must be adaptive and have the ability to learn the dynamics of the environment. For this purpose, we develop a deep reinforcement learning based task orchestrator, DeepEdge, which learns to meet different task requirements without needing human interaction even under the heavily-loaded stochastic network conditions in terms of mobile users and applications. Given the dynamic offloading requests and time-varying communication conditions, we successfully model the problem as a Markov process and then apply the Double Deep Q-Network (DDQN) algorithm to implement DeepEdge. To evaluate the robustness of DeepEdge, we experiment with four different applications including image rendering, infotainment, pervasive health, and augmented reality in the network under various loads. Furthermore, we compare the performance of our agent with the four different task offloading approaches in the literature. Our results show that DeepEdge outperforms its competitors in terms of the percentage of satisfactorily completed tasks.
Keywords:
Task analysis
Edge computing
Servers
Costs
Performance evaluation
Computational modeling
Cloud computing
Deep learning
deep reinforcement learning
edge computing
reinforcement learning
task offloading

Journal

I
IEEE Transactions on Network Science and Engineering
IF:
7.9
Papers:
2.6K
Citations:
10.0K

Organization

B
Bogazici University
Scholars:
4.1K
Papers: 3.9K
Citations: 27
Cited Papers

Cited Papers

Resource Management at the Network Edge: A Deep Reinforcement Learning Approach
err2019-05-01
err110
PREAI
errZeng, Deze; Gu, Lin; Pan, Shengli; Cai, Jingjing; Guo, Song
errShare
errSave
An Intelligent Edge-Chain-Enabled Access Control Mechanism for IoV
err2021-08-01
err22
PREAI
errLiu, Yuanni; Xiao, Man; Chen, Shanzhi; Bai, Fan; Pan, Jianli; Zhang, Di
errShare
errSave
Deep Reinforcement Learning for Vehicular Edge Computing: An Intelligent Offloading System
err2019-10-18
err243
errOAAI
errNing, Zhaolong; Dong, Peiran; Wang, Xiaojie; Rodrigues, Joel J. P. C.; Xia, Feng
errShare
errSave
Optimized Computation Offloading Performance in Virtual Edge Computing Systems via Deep Reinforcement Learning
err2019-06-01
err529
errOAAI
errChen, Xianfu; Zhang, Honggang; Wu, Celimuge; Mao, Shiwen; Ji, Yusheng; Bennis, Mehdi
errShare
errSave
Task Offloading and Resource Allocation for Mobile Edge Computing by Deep Reinforcement Learning Based on SARSA
err2020-01-01
err215
errOAAI
errAlfakih, Taha; Hassan, Mohammad Mehedi; Gumaei, Abdu; Savaglio, Claudio; Fortino, Giancarlo
errShare
errSave
researcher View more