.png){kind=icon}
返回
Incendio: Priority-Based Scheduling for Alleviating Cold Start in Serverless Computing
.png){kind=icon}
PRE
AI
DOI：10.1109/TC.2024.3386063.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In serverless computing, cold start results in long response latency. Existing approaches strive to alleviate the issue by reducing the number of cold starts. However, our measurement based on real-world production traces shows that the minimum number of cold starts does not equate to the minimum response latency, and solely focusing on optimizing the number of cold starts will lead to sub-optimal performance. The root cause is that functions have different priorities in terms of latency benefits by transferring a cold start to a warm start. In this paper, we propose Incendio, a serverless computing framework exploiting priority-based scheduling to minimize the overall response latency from the perspective of cloud providers. We reveal the priority of a function is correlated to multiple factors and design a priority model based on Spearman's rank correlation coefficient. We integrate a hybrid Prophet-LightGBM prediction model to dynamically manage runtime pools, which enables the system to prewarm containers in advance and terminate containers at the appropriate time. Furthermore, to satisfy the low-cost and high-accuracy requirements in serverless computing, we propose a Clustered Reinforcement Learning-based function scheduling strategy. The evaluations show that Incendio speeds up the native system by 1.4x, and achieves 23% and 14.8% latency reductions compared to two state-of-the-art approaches.
Keyword:
Containers
Serverless computing
Processor scheduling
Computers
Costs
Payloads
Service level agreements
cold start
priority
prediction
scheduling
in-memory computing
distributed systems
期刊
IF:
3.8
论文数:
5.4K
被引数:
9.8K
机构
引用论文
Study of bi-directional buck-boost converter topologies for application in electrical vehicle motor drives应用于电动汽车电机驱动的双向buck-boost变换器拓扑研究
PREAI
分享收藏Absence of Gamma-Interferon-Inducible Lysosomal Thiol Reductase (GILT) Is Associated with Poor Disease-Free Survival in Breast Cancer Patients.png)
PLoS ONE
OAAI
PLoS ONEIF0
OAAI分享收藏
查看更多内容