arrow
返回

Dynamic Service Function Chain Deployment and Readjustment Method Based on Deep Reinforcement Learning

delete2023-03-12
delete4
delete
OA
AI
R
Ran Jing
W
Wenkai Wang *
H
Hefei Hu
DOI:10.3390/s23063054delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
With the advent of Software Defined Network (SDN) and Network Functions Virtualization (NFV), network operators can offer Service Function Chain (SFC) flexibly to accommodate the diverse network function (NF) requirements of their users. However, deploying SFCs efficiently on the underlying network in response to dynamic SFC requests poses significant challenges and complexities. This paper proposes a dynamic SFC deployment and readjustment method based on deep Q network (DQN) and M Shortest Path Algorithm (MQDR) to address this problem. We develop a model of the dynamic deployment and readjustment of the SFC problem on the basis of the NFV/SFC network to maximize the request acceptance rate. We transform the problem into a Markov Decision Process (MDP) and further apply Reinforcement Learning (RL) to achieve this goal. In our proposed method (MQDR), we employ two agents that dynamically deploy and readjust SFCs collaboratively to enhance the service request acceptance rate. We reduce the action space for dynamic deployment by applying the M Shortest Path Algorithm (MSPA) and decrease the action space for readjustment from two dimensions to one. By reducing the action space, we decrease the training difficulty and improve the actual training effect of our proposed algorithm. The simulation experiments show that MDQR improves the request acceptance rate by approximately 25% compared with the original DQN algorithm and 9.3% compared with the Load Balancing Shortest Path (LBSP) algorithm.
Keyword:
network function virtualization
service function chain
dynamic deployment
resource allocation
deep reinforcement learning
deep Q-networks
network readjustment
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Sensors 封面图
Sensors
IF:
3.5
论文数:
7.2W
被引数:
20.9W

机构

B
beijing university of posts & telecommunications
学者数:
1.4W
论文数: 1.2W
被引数: 9
引用论文

引用论文

err分享
err收藏
Virtual Network Function Migration Based on Dynamic Resource Requirements Prediction
err2019-01-01
err51
errOAAI
errTang, Lun; He, Xiaoyu; Zhao, Peipei; Zhao, Guofan; Zhou, Yu; Chen, Qianbin
err分享
err收藏
On Dynamic Service Function Chain Reconfiguration in IoT Networks
err2020-11-01
err27
PREAI
errLiu, Yicen; Lu, Yu; Li, Xi; Yao, Zhigang; Zhao, Donghao
err分享
err收藏
A survey on service function chaining
err2016-11-01
err252
PREAI
errBhamare, Deval; Jain, Raj; Samaka, Mohammed; Erbad, Aiman
err分享
err收藏
学者 查看更多内容