arrow
返回

Deep Reinforcement Learning Algorithm for Latency-Oriented IIoT Resource Orchestration

delete2023-04-15
delete13
PRE
AI
张培颖 封面图
张培颖 (Peiying Zhang) *
Y
Yi Zhang
N
Neeraj Kumar *
C
Ching‐Hsien Hsu
DOI:10.1109/JIOT.2022.3229270delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Due to geographical factors and resource constraints, the traditional Internet architecture cannot meet the needs of the space-air-ground-integrated network (SAGIN) resource layout in the Industrial Internet of Things (IIoT) service. How to arrange network resources in SAGIN quickly and efficiently to meet the quality of service requirements of users has become a hot research topic in the industry. Based on the characteristics of SAGIN with multiple network segments, we convert the resource scheduling problem of SAGIN into a multidomain virtual network embedding (VNE) problem. This article proposes a latency-sensitive VNE algorithm based on deep reinforcement learning (DDRL-VNE) in the SAGIN environment. Unlike traditional latency optimization algorithms, we consider the effect of traffic size and hop count on latency when evaluating latency. We constructed a learning agent composed of a five-layer policy network and extracted a feature matrix as its training environment based on the network attributes of SAGIN. The node embedding is completed according to the probability that each node is embedded in the training, and then the breadth-first search strategy is used to complete the link embedding. The experimental results effectively illustrate the effectiveness of the algorithm in the SAGIN resource allocation problem.
Keyword:
Space-air-ground integrated networks
Industrial Internet of Things
Internet of Things
Resource management
Reinforcement learning
Quality of service
Security
Deep reinforcement learning (DRL)
Industrial Internet of Things (IIoT)
latency
space-air-ground-integrated network (SAGIN)

期刊

IEEE Internet of Things Journal 封面图
IEEE Internet of Things Journal
IF:
8.9
论文数:
1.4W
被引数:
7.8W

机构

A
asia university taiwan
学者数:
2.0K
论文数: 2.8K
被引数: 5
C
china university of petroleum
学者数:
4.1W
论文数: 2.7W
被引数: 30
引用论文

引用论文

Resource Management and Security Scheme of ICPSs and IoT Based on VNE Algorithm
err2022-11-15
err25
errOAAI
errZhang, Peiying; Wang, Chao; Jiang, Chunxiao; Kumar, Neeraj; Lu, Qinghua
err分享
err收藏
Distributed Virtual Network Embedding System With Historical Archives and Set-Based Particle Swarm Optimization
err2021-02-01
err49
errOAAI
errSong, An; Chen, Wei-Neng; Gu, Tianlong; Yuan, Huaqiang; Kwong, Sam; Zhang, Jun
err分享
err收藏
err分享
err收藏
Thirty Years of Machine Learning: The Road to Pareto-Optimal Wireless Networks
err2020-01-01
err376
errOAAI
errWang, Jingjing; Jiang, Chunxiao; Zhang, Haijun; Ren, Yong; Chen, Kwang-Cheng; Hanzo, Lajos
err分享
err收藏
err分享
err收藏
A Highly Selective and Colorimetric Fluorescent Probe for Hydrazine Detection in Water Samples
err2018-07-27
err0
errOAAI
errHao Wang; Xiaoming Wu; Feiyan Tao; Shaoxiang Yang; Hongyu Tian; Yongguo Liu; Baoguo Sun
err分享
err收藏
学者 查看更多内容