arrow
Return

Mitigating cold start problem in serverless computing using predictive pre-warming with machine learning

delete2024-12-14
delete0
PRE
AI
Q
Q. Hu *
H
Hongwei Li
E
Elaheh Nikougoftar *
DOI:10.1007/s00607-024-01382-ydelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The cold start problem in serverless computing leads to increased latency when functions are invoked after being idle. This paper proposes a predictive pre-warming strategy that leverages machine learning and historical data analysis to mitigate the cold start problem. By using a Recurrent Neural Network (RNN) to predict future invocations and a pre-warming scheduler to determine the number of instances to pre-warm, our approach aims to optimize resource utilization and reduce latency. Results show that the proposed method adapts idle-container times efficiently, reducing cold starts and idle periods. The proposed method outperforms OpenWhisk by executing more invocations, demonstrating a 49.52% improvement and enhancing container resource allocation optimization.
Keywords:
Serverless computing
Cold start
Machine learning
Predictive pre-warming
Recurrent neural network

Journal

C
Computing
IF:
2.8
Papers:
2.3K
Citations:
3.5K

Organization

B
Beijing Normal University
Scholars:
3.3W
Papers: 2.7W
Citations: 4.2W