arrow
返回

Fault Tolerance Oriented SFC Optimization in SDN/NFV-Enabled Cloud Environment Based on Deep Reinforcement Learning

delete2024-01-01
delete0
PRE
AI
J
Jing Chen *
陈
陈佳 (Jia Chen) *
K
Kuo Guo
R
Renkun Hu
T
Tao Zou
J
Jun Zhu
H
Hongke Zhang
J
Jingjing Liu
DOI:10.1109/TCC.2024.3357061delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In software defined network/network function virtualization (SDN/NFV)-enabled cloud environment, cloud services can be implemented as service function chains (SFCs), which consist of a series of ordered virtual network functions. However, due to fluctuations of cloud traffic and without knowledge of cloud computing network configuration, designing SFC optimization approach to obtain flexible cloud services in dynamic cloud environment is a pivotal challenge. In this paper, we propose a fault tolerance oriented SFC optimization approach based on deep reinforcement learning. We model fault tolerance oriented SFC elastic optimization problem as a Markov decision process, in which the reward is modeled as a weighted function, including minimizing energy consumption and migration cost, maximizing revenue benefit and load balancing. Then, taking binary integer programming model as constraints of quality of cloud services, we design optimization approaches for single-agent double deep Q-network (SADDQN) and multi-agent DDQN (MADDQN). Among them, MADDQN decentralizes training tasks from control plane to data plane to reduce the probability of single point of failure for the centralized controller. Experimental results show that the designed approaches have better performance. MADDQN can almost reach the upper bound of theoretical solution obtained by assuming a prior knowledge of the dynamics of cloud traffic.
Keyword:
Service function chain
fault-tolerant
quality of service
elastic optimization
deep reinforcement learning

期刊

I
IEEE Transactions on Cloud Computing
IF:
5
论文数:
1.9K
被引数:
4.3K

机构

B
Beijing Jiaotong University
学者数:
2.2W
论文数: 1.7W
被引数: 1.2W
T
tsinghua university
学者数:
11.9W
论文数: 10.0W
被引数: 137
C
China Mobile
学者数:
939
论文数: 701
被引数: 2
学者 查看更多机构
引用论文

引用论文

Dynamic Flow Migration for Embedded Services in SDN/NFV-Enabled 5G Core Networks
err2020-04-01
err75
PREAI
errQu, Kaige; Zhuang, Weihua; Ye, Qiang; Shen, Xuemin; Li, Xu; Rao, Jaya
err分享
err收藏
Resource Management at the Network Edge: A Deep Reinforcement Learning Approach
err2019-05-01
err110
PREAI
errZeng, Deze; Gu, Lin; Pan, Shengli; Cai, Jingjing; Guo, Song
err分享
err收藏
Virtual Network Function Migration Based on Dynamic Resource Requirements Prediction
err2019-01-01
err51
errOAAI
errTang, Lun; He, Xiaoyu; Zhao, Peipei; Zhao, Guofan; Zhou, Yu; Chen, Qianbin
err分享
err收藏
学者 查看更多内容