arrow
返回

An efficient data evacuation strategy using multi-objective reinforcement learning

delete2021-09-30
delete6
PRE
AI
X
Xiaole Li *
DOI:10.1007/s10489-021-02640-8delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
When a disaster occurs, utilizing residual network resources as much as possible and allocating a reasonable bandwidth ratio for concurrent evacuation transfers are two key factors to improve the efficiency of data evacuation. However, because the evacuation activity is often implemented in a large-scale network of high complexity, these two factors are likely to be conflicting in some cases. Therefore, it is difficult to achieve or approximate the optimal evacuation solution only by single objective optimization. To achieve better utilization of network transmission capability in data evacuation, we leverage multi-objective reinforcement learning to simultaneously maximize the total evacuation flow and allocate proportional bandwidth to concurrent evacuation transfers. We design the vector of rewards for the two objectives and update Pareto approximate set by multiple state steps to approach the optimal solution. In every step, we leverage marked evacuation routing search based on heuristic information to construct action space. To improve the quality of candidate action, we search one available evacuation path for every evacuation transfer, and adjust bandwidth allocation to reduce the deviation between bandwidth ratio and data amount ratio. For action selection, we propose a roulette-based Chebyshev scalarization function to optimize the weight selection process for multi-objectives and enforce exploration to avoid falling into the local optimum. The simulation results demonstrates that our new strategy solves the weight selection problem successfully and achieves better performance with higher transmission efficiency.
Keyword:
Evacuation flow
Bandwidth allocation ratio
Multi-objective optimization
Reinforcement learning
Chebyshev scalarization function

期刊

Applied Intelligence 封面图
Applied Intelligence
IF:
3.5
论文数:
7.6K
被引数:
1.7W

机构

L
linyi university
学者数:
4.4K
论文数: 3.2K
被引数: 62
引用论文

引用论文

Network Adaptability from Disaster Disruptions and Cascading Failures
err2014-05-01
err123
PREAI
errMukherjee, Biswanath; Habib, M. Farhan; Dikbiyik, Ferhat
err分享
err收藏
err分享
err收藏
Nonalcoholic Fatty Liver Disease in Children and Adolescents Taking Atypical Antipsychotic Medications: Protocol for a Systematic Review and Meta-analysis
err2022-03-21
err0
errOAAI
errReem Hatem; Faisal A Nawaz; Ghadah A Al-Sharif; Mohammad Almoosa; Wid Kattan; Christos Tzivinikos; E Lila Amirali; Ammar Albanna
err分享
err收藏
Adaptive Multimodal Continuous Ant Colony Optimization
err2017-04-01
err220
errOAAI
errYang, Qiang; Chen, Wei-Neng; Yu, Zhengtao; Gu, Tianlong; Li, Yun; Zhang, Huaxiang; Zhang, Jun
err分享
err收藏
Rapid Data Evacuation for Large-Scale Disasters in Optical Cloud Networks
err2015-11-05
err30
PREAI
errFerdousi, Sifat; Tornatore, Massimo; Habib, M. Farhan; Mukherjee, Biswanath
err分享
err收藏
Cloudde: A Heterogeneous Differential Evolution Algorithm and Its Distributed Cloud Version
err2017-03-01
err134
PREAI
errZhan, Zhi-Hui; Liu, Xiao-Fang; Zhang, Huaxiang; Yu, Zhengtao; Weng, Jian; Li, Yun; Gu, Tianlong; Zhang, Jun
err分享
err收藏
学者 查看更多内容