arrow
返回

Deadline-Aware Task Offloading With Partially-Observable Deep Reinforcement Learning for Multi-Access Edge Computing

delete2022-11-01
delete23
PRE
AI
H
Hui Huang
Q
Qiang Ye *
Y
Yi-Tong Zhou
DOI:10.1109/TNSE.2021.3115054delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Over the past years, computationally-intensive mobile applications, such as interactive games and augmented reality, have gained enormous popularity. This phenomenon has placed a serious burden on mobile devices with limited computation resources and constrained battery capacity. Multi-access Edge Computing (MEC) is proposed to solve the problem by offloading part of the computation tasks from mobile devices to edge servers. The fundamental challenge in MEC is how to effectively select a subset of computation tasks to be offloaded so that the application requirements are satisfied and the total energy consumption is minimized. The existing Deep Reinforcement Learning (DRL) based offloading schemes focus on either non-real-time tasks or real-time tasks with soft deadlines. In addition, the existing schemes do not work well when the information of the system environment is not complete. In this paper, we propose an innovative DRL-based task offloading method, PDMO, which guarantees that the deadlines of real-time tasks are met even when the system environment is only partially observable. Technically, the offloading problem is formulated as a Partially Observable Markov Decision Process (POMDP). To tackle the offloading problem, we devise a Deep Deterministic Policy Gradient (DDPG) based algorithm, POTD3. Our experimental results indicate that PDMO works well in partially observable environments. In addition, it outperforms the existing offloading schemes in terms of energy consumption, deadline miss number and completion rate of non-real-time tasks.
Keyword:
Deep learning
Servers
Mobile handsets
Real-time systems
Energy consumption
Computational modeling
Cloud computing
Reinforcement learning
Markov processes
Cyber-physical systems
Social factors
Edge computing
deep reinforcement learning
real-time task
computation offloading
partially-observable markov decision process

期刊

I
IEEE Transactions on Network Science and Engineering
IF:
7.9
论文数:
2.6K
被引数:
10.0K

机构

D
Dalhousie University
学者数:
2.0W
论文数: 1.8W
被引数: 2.3W
引用论文

引用论文

4. Stat Proteins and Cancer
err2017-08-30
err0
errOAAI
errTammy Bowman; Richard Jove
err分享
err收藏
Convergence of Edge Computing and Deep Learning: A Comprehensive Survey边缘计算和深度学习的融合: 综合综述
err2020-01-01
err812
errOAAI
errWang, Xiaofei; Han, Yiwen; Leung, Victor C. M.; Niyato, Dusit; Yan, Xueqiang; Chen, Xu
err分享
err收藏
DeepWear: Adaptive Local Offloading for On-Wearable Deep Learning
err2020-02-01
err79
errOAAI
errXu, Mengwei; Qian, Feng; Zhu, Mengze; Huang, Feifan; Pushp, Saumay; Liu, Xuanzhe
err分享
err收藏
Deep Reinforcement Learning for Vehicular Edge Computing: An Intelligent Offloading System
err2019-10-18
err243
errOAAI
errNing, Zhaolong; Dong, Peiran; Wang, Xiaojie; Rodrigues, Joel J. P. C.; Xia, Feng
err分享
err收藏
Reduced lymphomyeloid repopulating activity from adult bone marrow and fetal liver of mice lacking expression of STAT5
err2002-01-15
err0
errOAAI
errKevin D. Bunting; Heath L. Bradley; Teresa S. Hawley; Richard Moriggl; Brian P. Sorrentino; James N. Ihle
err分享
err收藏
学者 查看更多内容