arrow
返回

DRL-Based Resource Allocation for Computation Offloading in IoV Networks

delete2022-11-01
delete55
PRE
AI
B
Bishmita Hazarika
K
Keshav Singh *
S
Sudip Biswas
M
Mumtaz, Shahid
L
Li, Chih-Peng
DOI:10.1109/TII.2022.3168292delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Due to the dynamic nature of a vehicular fog computing environment, efficient real-time resource allocation in an Internet of Vehicles (IoV) network without affecting the quality of service of any of the onboard vehicles can be challenging. This article proposes a priority-sensitive task offloading and resource allocation scheme in an IoV network, where vehicles periodically exchange beacon messages to inquire about available services and other important information necessary for making the offloading decisions. In the proposed methodology, the vehicles are stimulated to share their idle computation resources with the task vehicles, whereby a deep reinforcement learning algorithm based on soft actor-critic is designed to classify the tasks based on priority and computation size of each task for optimally allocating the power. Furthermore, we also design deep deterministic policy gradient (DDPG) and twin delayed DDPG (TD3) algorithms for the considered framework. In particular, the algorithms work toward achieving the optimal policy for task offloading by maximizing the mean utility of the considered network. Extensive numerical results under different network conditions, along with comparison among the three algorithms, are presented to validate the feasibility of distributed reinforcement learning for task offloading in future IoV networks.
Keyword:
Task analysis
TV
Delays
Resource management
Reinforcement learning
Computational modeling
Vehicular ad hoc networks
Deep deterministic policy gradient (DDPG)
deep reinforcement learning (DRL)
Internet of Vehicles (IoV)
soft actor-critic (SAC)
twin delayed deep deterministic policy gradient (TD3)
vehicular fog computing (VFC)

期刊

IEEE Transactions on Industrial Informatics 封面图
IEEE Transactions on Industrial Informatics
IF:
9.9
论文数:
8.6K
被引数:
6.0W

机构

N
national sun yat sen university
学者数:
7.6K
论文数: 7.7K
被引数: 3
引用论文

引用论文

Analytical Models and Performance Evaluation of Drive-thru Internet Systems
err2011-01-01
err95
PREAI
errTan, Wee Lum; Lau, Wing Cheong; Yue, OnChing; Hui, Tan Hing
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容