arrow
Return

Enhancing Machine Learning-Based Autoscaling for Cloud Resource Orchestration

delete2024-10-19
delete0
delete
OA
AI
I
István Pintye *
J
József Kovács
R
Róbert Lovas
DOI:10.1007/s10723-024-09783-1delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Performance and cost-effectiveness are sustained by efficient management of resources in cloud computing. Current autoscaling approaches, when trying to balance between the consumption of resources and QoS requirements, usually fall short and end up being inefficient and leading to service disruptions. The existing literature has primarily focuses on static metrics and/or proactive scaling approaches which do not align with dynamically changing tasks, jobs or service calls. The key concept of our approach is the use of statistical analysis to select the most relevant metrics for the specific application being scaled. We demonstrated that different applications require different metrics to accurately estimate the necessary resources, highlighting that what is critical for an application may not be for the other. The proper metrics selection for control mechanism which regulates the requried recources of application are described in this study. Introduced selection mechanism enables us to improve previously designed autoscaler by allowing them to react more quickly to sudden load changes, use fewer resources, and maintain more stable service QoS due to the more accurate machine learning models. We compared our method with previous approaches through a carefully designed series of experiments, and the results showed that this approach brings significant improvements, such as reducing QoS violations by up to 80% and reducing VM usage by 3% to 50%. Testing and measurements were conducted on the Hungarian Research Network (HUN-REN) Cloud, which supports the operation of over 300 scientific projects.
Keywords:
Cloud computing
Orchestration
Autoscaling
Machine learning
Proactive control
Metric selection
Resource optimization
Quality of Service (QoS)

Journal

Journal of Grid Computing cover
Journal of Grid Computing
IF:
2.9
Papers:
759
Citations:
1.2K

Organization

H
hun-ren
Scholars:
1.2W
Papers: 9.4K
Citations: 14