arrow
Return

Deep Reinforcement Learning Algorithm for Latency-Oriented IIoT Resource Orchestration

delete2023-04-15
delete13
PRE
AI
张培颖 cover
张培颖 (Peiying Zhang) *
Y
Yi Zhang
N
Neeraj Kumar *
C
Ching‐Hsien Hsu
DOI:10.1109/JIOT.2022.3229270delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Due to geographical factors and resource constraints, the traditional Internet architecture cannot meet the needs of the space-air-ground-integrated network (SAGIN) resource layout in the Industrial Internet of Things (IIoT) service. How to arrange network resources in SAGIN quickly and efficiently to meet the quality of service requirements of users has become a hot research topic in the industry. Based on the characteristics of SAGIN with multiple network segments, we convert the resource scheduling problem of SAGIN into a multidomain virtual network embedding (VNE) problem. This article proposes a latency-sensitive VNE algorithm based on deep reinforcement learning (DDRL-VNE) in the SAGIN environment. Unlike traditional latency optimization algorithms, we consider the effect of traffic size and hop count on latency when evaluating latency. We constructed a learning agent composed of a five-layer policy network and extracted a feature matrix as its training environment based on the network attributes of SAGIN. The node embedding is completed according to the probability that each node is embedded in the training, and then the breadth-first search strategy is used to complete the link embedding. The experimental results effectively illustrate the effectiveness of the algorithm in the SAGIN resource allocation problem.
Keywords:
Space-air-ground integrated networks
Industrial Internet of Things
Internet of Things
Resource management
Reinforcement learning
Quality of service
Security
Deep reinforcement learning (DRL)
Industrial Internet of Things (IIoT)
latency
space-air-ground-integrated network (SAGIN)

Journal

IEEE Internet of Things Journal cover
IEEE Internet of Things Journal
IF:
8.9
Papers:
1.4W
Citations:
7.8W

Organization

A
asia university taiwan
Scholars:
2.0K
Papers: 2.8K
Citations: 5
C
china university of petroleum
Scholars:
4.1W
Papers: 2.7W
Citations: 30
Cited Papers

Cited Papers

Resource Management and Security Scheme of ICPSs and IoT Based on VNE Algorithm
err2022-11-15
err25
errOAAI
errZhang, Peiying; Wang, Chao; Jiang, Chunxiao; Kumar, Neeraj; Lu, Qinghua
errShare
errSave
Distributed Virtual Network Embedding System With Historical Archives and Set-Based Particle Swarm Optimization
err2021-02-01
err49
errOAAI
errSong, An; Chen, Wei-Neng; Gu, Tianlong; Yuan, Huaqiang; Kwong, Sam; Zhang, Jun
errShare
errSave
errShare
errSave
Thirty Years of Machine Learning: The Road to Pareto-Optimal Wireless Networks
err2020-01-01
err376
errOAAI
errWang, Jingjing; Jiang, Chunxiao; Zhang, Haijun; Ren, Yong; Chen, Kwang-Cheng; Hanzo, Lajos
errShare
errSave
errShare
errSave
A Highly Selective and Colorimetric Fluorescent Probe for Hydrazine Detection in Water Samples
err2018-07-27
err0
errOAAI
errHao Wang; Xiaoming Wu; Feiyan Tao; Shaoxiang Yang; Hongyu Tian; Yongguo Liu; Baoguo Sun
errShare
errSave
researcher View more