arrow
Return

Deep Meta Q-Learning Based Multi-Task Offloading in Edge-Cloud Systems

delete2024-04-01
delete5
PRE
AI
N
Nelson Sharma
A
Aswini Ghosh *
R
Rajiv Misra
S
Sajal K. Das
DOI:10.1109/TMC.2023.3264901delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Resource-constrained edge devices can not efficiently handle the explosive growth of mobile data and the increasing computational demand of modern-day user applications. Task offloading allows the migration of complex tasks from user devices to the remote edge-cloud servers thereby reducing their computational burden and energy consumption while also improving the efficiency of task processing. However, obtaining the optimal offloading strategy in a multi-task offloading decision-making process is an NP-hard problem. Existing Deep learning techniques with slow learning rates and weak adaptability are not suitable for dynamic multi-user scenarios. In this article, we propose a novel deep meta-reinforcement learning-based approach to the multi-task offloading problem using a combination of first-order meta-learning and deep Q-learning methods. We establish the meta-generalization bounds for the proposed algorithm and demonstrate that it can reduce the time and energy consumption of IoT applications by up to 15%. Through rigorous simulations, we show that our method achieves near-optimal offloading solutions while also being able to adapt to dynamic edge-cloud environments.
Keywords:
Task analysis
Heuristic algorithms
Computational modeling
Servers
Internet of Things
Multitasking
Energy consumption
Deep q-learning
directed acyclic graph
edge-cloud computing
meta-learning
multi-task offloading

Journal

IEEE Transactions on Mobile Computing cover
IEEE Transactions on Mobile Computing
IF:
9.2
Papers:
5.9K
Citations:
1.8W

Organization

I
indian institute of technology system (iit system)
Scholars:
9.5W
Papers: 9.9W
Citations: 93
I
indian institute of technology (iit) - patna
Scholars:
1.8K
Papers: 1.6K
Citations: 0
Cited Papers

Cited Papers

Convergence of Edge Computing and Deep Learning: A Comprehensive Survey
err2020-01-01
err812
errOAAI
errWang, Xiaofei; Han, Yiwen; Leung, Victor C. M.; Niyato, Dusit; Yan, Xueqiang; Chen, Xu
errShare
errSave
Intelligent Edge: Leveraging Deep Imitation Learning for Mobile Edge Computation Offloading
err2020-02-01
err76
errOAAI
errYu, Shuai; Chen, Xu; Yang, Lei; Wu, Di; Bennis, Mehdi; Zhang, Junshan
errShare
errSave
errShare
errSave
Learning for Computation Offloading in Mobile Edge Computing
err2018-12-01
err156
PREAI
errDinh, Thinh Quang; La, Quang Duy; Quek, Tony Q. S.; Shin, Hyundong
errShare
errSave
errShare
errSave
Optimized Computation Offloading Performance in Virtual Edge Computing Systems via Deep Reinforcement Learning
err2019-06-01
err529
errOAAI
errChen, Xianfu; Zhang, Honggang; Wu, Celimuge; Mao, Shiwen; Ji, Yusheng; Bennis, Mehdi
errShare
errSave
Multi-User Offloading for Edge Computing Networks: A Dependency-Aware and Latency-Optimal Approach
err2020-03-01
err155
PREAI
errShu, Chang; Zhao, Zhiwei; Han, Yunpeng; Min, Geyong; Duan, Hancong
errShare
errSave
researcher View more