arrow
返回

A dynamic queuing model based distributed task offloading algorithm using deep reinforcement learning in mobile edge computing

delete2023-10-17
delete6
PRE
AI
Z
Zhengyi Chai
H
Haole Hou
Y
Ya-Lun Li *
DOI:10.1007/s10489-023-05065-7delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In mobile edge computing (MEC), offloading computing tasks from edge clients to edge nodes can reduce the burden on edge clients, especially for delay-sensitive tasks, they must be completed within the deadline. However, when the edge nodes receive a large number of tasks, the waiting time of the tasks may be too long, and some tasks may even be dropped due to timeout. To address these problems, we model task offloading as a long-term optimization problem based on Markov decision process (MDP), we consider task queuing models on edge clients and edge nodes to optimize distributed task offloading schemes, and the current workload of edge nodes prediction model for dynamic task scheduling to avoid excessive workload of edge nodes. A distributed dynamic task offloading algorithm based on deep reinforcement learning is proposed, and a recurrent neural network controlled by Gated Recurrent Unit (GRU) and Dueling-DQN and Double-DQN (DDQN) techniques enable each client to make its own offloading decisions without knowing other information. In order to improve the training efficiency and the stability of the strategy, a queue selection algorithm is proposed to reduce the action space. Experimental results show that, compared with some existing algorithms, the proposed algorithm can effectively predict the workload of edge nodes and make reasonable offloading decisions, significantly reducing the average energy consumption and delay of edge clients, as well as the ratio of dropped tasks.
Keyword:
Computing offloading
Dynamic queuing model
Energy consumption
Delay
Deep reinforcement learning

期刊

Applied Intelligence 封面图
Applied Intelligence
IF:
3.5
论文数:
7.6K
被引数:
1.7W

机构

T
Tiangong University
学者数:
1.2W
论文数: 7.7K
被引数: 1.1W
引用论文

引用论文

Online Edge Learning Offloading and Resource Management for UAV-Assisted MEC Secure Communications
err2023-01-01
err66
PREAI
errDing, Yu; Feng, Yunqi; Lu, Weidang; Zheng, Shilian; Zhao, Nan; Meng, Limin; Nallanathan, Arumugam; Yang, Xiaoniu
err分享
err收藏
Computation offloading in mobile edge computing networks: A survey
err2022-06-01
err123
PREAI
errFeng, Chuan; Han, Pengchao; Zhang, Xu; Yang, Bowen; Liu, Yejun; Guo, Lei
err分享
err收藏
Price and Risk Awareness for Data Offloading Decision-Making in Edge Computing Systems
err2022-12-01
err91
errOAAI
errMitsis, Giorgos; Tsiropoulou, Eirini Eleni; Papavassiliou, Symeon
err分享
err收藏
Magnetic Properties of Mn Doped NiO
err2008-08-01
err0
PREAI
errEkaphan Swatsitang; A. Pimsawat
err分享
err收藏
A Survey on the Edge Computing for the Internet of Things
err2018-01-01
err895
PREAI
errYu, Wei; Liang, Fan; He, Xiaofei; Hatcher, William Grant; Lu, Chao; Lin, Jie; Yang, Xinyu
err分享
err收藏
学者 查看更多内容