.png){kind=icon}
返回
Efficient evolutionary optimization using predictive auto-scaling in containerized environment
.png){kind=icon}
PRE
AI
DOI：10.1016/j.asoc.2022.109610.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Solving complex real-world optimization problems is a computationally demanding task. To solve it efficiently and effectively, one must possess expert knowledge in various fields (problem domain knowledge, optimization, parallel and distributed computing) and appropriate expensive software and hardware resources. In this regard, we present a cloud-native, container-based distributed optimization framework that enables efficient and cost-effective optimization over platforms such as Amazon ECS/EKS, Azure AKS, and on-premise Kubernetes. The solution consists of dozens of microservices scaled out using a specially developed PETAS Auto-scaler based on predictive analytics. Existing schedulers, whether Kubernetes or commercial, do not take into account the specifics of optimization based on evolutionary algorithms. Therefore, their performance is not optimal in terms of results' delivery time and cloud infrastructure costs. The proposed PETAS Auto-scaler elastically maintains an adequate number of worker pods following the exact pace dictated by the demands of the optimization process. We evaluate the proposed framework's performance using two real-world computationally demanding optimizations. The first use case belongs to the manufacturing domain and involves optimization of the transportation pallets for train parts. The second use case belongs to the field of automated machine learning and includes neural architecture search and hyperparameter optimization. The results indicate an IaaS cost savings of up to 49% can be achieved, with almost unchanged result delivery time. (C) 2022 Elsevier B.V. All rights reserved.
Keyword:
Parallel metaheuristics based optimization framework
Auto-scaling cloud resources
Machine learning
Resource usage prediction
期刊
IF:
6.6
论文数:
1.4W
被引数:
4.8W
机构
引用论文
.png){kind=icon}
Distributed evolutionary algorithms and their models: A survey of the state-of-the-art分布式进化算法及其模型: 最新技术综述
OAAI
OAAI分享收藏FLAS: A combination of proactive and reactive auto-scaling architecture for distributed services
PREAI
分享收藏
Application deployment using containers with auto-scaling for microservices in cloud environment
PREAI
分享收藏Optimizing the performance of optimization in the cloud environment-An intelligent auto-scaling approach优化云环境中的优化性能-一种智能自动扩展方法
PREAI
分享收藏
查看更多内容