arrow
返回

Deep-Reinforcement-Learning-Based Offloading Scheduling for Vehicular Edge Computing

delete2020-06-01
delete216
PRE
AI
C
Chunbo Luo *
J
Jin Wang
C
Chao Wang
G
Geyong Min
H
Hancong Duan
Q
Qingxin Zhu
DOI:10.1109/JIOT.2020.2978830delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Vehicular edge computing (VEC) is a new computing paradigm that has great potential to enhance the capability of vehicle terminals (VTs) to support resource-hungry in-vehicle applications with low latency and high energy efficiency. In this article, we investigate an important computation offloading scheduling problem in a typical VEC scenario, where a VT traveling along an expressway intends to schedule its tasks waiting in the queue to minimize the long-term cost in terms of a tradeoff between task latency and energy consumption. Due to diverse task characteristics, dynamic wireless environment, and frequent handover events caused by vehicle movements, an optimal solution should take into account both where to schedule (i.e., local computation or offloading) and when to schedule (i.e., the order and time for execution) each task. To solve such a complicated stochastic optimization problem, we model it by a carefully designed Markov decision process (MDP) and resort to deep reinforcement learning (DRL) to deal with the enormous state space. Our DRL implementation is designed based on the state-of-the-art proximal policy optimization (PPO) algorithm. A parameter-shared network architecture combined with a convolutional neural network (CNN) is utilized to approximate both policy and value function, which can effectively extract representative features. A series of adjustments to the state and reward representations are taken to further improve the training efficiency. Extensive simulation experiments and comprehensive comparisons with six known baseline algorithms and their heuristic combinations clearly demonstrate the advantages of the proposed DRL-based offloading scheduling method.
Keyword:
Task analysis
Servers
Processor scheduling
Schedules
Internet of Things
Edge computing
Wireless communication
Computation offloading
deep reinforcement learning (DRL)
mobile-edge computing (MEC)
task scheduling
vehicular edge computing (VEC)
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Internet of Things Journal 封面图
IEEE Internet of Things Journal
IF:
8.9
论文数:
1.4W
被引数:
7.8W

机构

U
University of Exeter
学者数:
2.0W
论文数: 2.1W
被引数: 3.6W
引用论文

引用论文

Mobile-Edge Computing: Partial Computation Offloading Using Dynamic Voltage Scaling
err2016-01-01
err867
PREAI
errWang, Yanting; Sheng, Min; Wang, Xijun; Wang, Liang; Li, Jiandong
err分享
err收藏
Offloading in Mobile Edge Computing: Task Allocation and Computational Frequency Scaling
err2017-01-01
err754
PREAI
errThinh Quang Dinh; Tang, Jianhua; La, Quang Duy; Quek, Tony Q. S.
err分享
err收藏
Mobile Edge Computing: A Survey移动边缘计算: 一项调查
err2018-02-01
err2.0K
errOAAI
errAbbas, Nasir; Zhang, Yan; Taherkordi, Amir; Skeie, Tor
err分享
err收藏
err分享
err收藏
Optimized Computation Offloading Performance in Virtual Edge Computing Systems via Deep Reinforcement Learning
err2019-06-01
err529
errOAAI
errChen, Xianfu; Zhang, Honggang; Wu, Celimuge; Mao, Shiwen; Ji, Yusheng; Bennis, Mehdi
err分享
err收藏
err分享
err收藏
学者 查看更多内容