arrow
返回

FaaSLight: General Application-level Cold-start Latency Optimization for Function-as-a-Service in Serverless Computing

delete2023-07-22
delete19
PRE
AI
X
Xuanzhe Liu *
J
Jinfeng Wen
陈
陈震鹏 (Zhenpeng Chen)
李
李丁 (Ding Li)
J
Junkai Chen
Y
Yi Liu
H
Haoyu Wang
X
Xin Jin
DOI:10.1145/3585007delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Serverless computing is a popular cloud computing paradigm that frees developers from server management. Function-as-a-Service (FaaS) is the most popular implementation of serverless computing, representing applications as event-driven and stateless functions. However, existing studies report that functions of FaaS applications severely suffer from cold-start latency. In this article, we propose an approach, namely, FaaSLight, to accelerating the cold start for FaaS applications through application-level optimization. We first conduct a measurement study to investigate the possible root cause of the cold-start problem of FaaS. The result shows that application code loading latency is a significant overhead. Therefore, loading only indispensable code from FaaS applications can be an adequate solution. Based on this insight, we identify code related to application functionalities by constructing the function-level call graph and separate other code (i.e., optional code) from FaaS applications. The separated optional code can be loaded on demand to avoid the inaccurate identification of indispensable code causing application failure. In particular, a key principle guiding the design of FaaSLight is inherently general, i.e., platform- and language-agnostic. In practice, FaaSLight can be effectively applied to FaaS applications developed in different programming languages (Python and JavaScript), and can be seamlessly deployed on popular serverless platforms such as AWS Lambda and Google Cloud Functions, without having to modify the underlying OSes or hypervisors, nor introducing any additional manual engineering efforts to developers. The evaluation results on real-world FaaS applications show that FaaSLight can significantly reduce the code loading latency (up to 78.95%, 28.78% on average), thereby reducing the cold-start latency. As a result, the total response latency of functions can be decreased by up to 42.05% (19.21% on average). Compared with the state-of-the-art, FaaSLight achieves a 21.25x improvement in reducing the average total response latency.
Keyword:
Serverless computing
cold start
performance optimization
optional function elimination

期刊

A
ACM Transactions on Software Engineering and Methodology
IF:
6.2
论文数:
1.2K
被引数:
3.4K

机构

U
University College London
学者数:
7.9W
论文数: 6.2W
被引数: 15.7W
U
university of london
学者数:
21.5W
论文数: 19.7W
被引数: 305
P
peking university
学者数:
11.9W
论文数: 8.7W
被引数: 146
学者 查看更多机构
引用论文

引用论文

Towards holographic renormalization of fake supergravity
err2009-07-01
err0
errOAAI
errNatalia Borodatchenkova; Michael Haack; Wolfgang Mück
err分享
err收藏
Dysfunction of a 21-mm aortic bioprosthesis treated with percutaneous implantation of a CoreValve prosthesis
err2013-07-01
err0
PREAI
errCristina Giannini; Marco De Carlo; Fabio Guarracino; Maria G.D. Donne; Giovanni Benedetti; Francesco Verunelli; Anna S. Petronio
err分享
err收藏
Novel κ light-chain gene rearrangements in mouse λ light chain-producing B lymphocytes
err1984-02-01
err0
PREAI
errJeannine Durdik; Mark W. Moore; Erik Selsing
err分享
err收藏
Serverless Computing-Where Are We Now, and Where Are We Heading?
err2021-01-01
err26
errOAAI
errTaibi, Davide; Spillner, Josef; Wawruch, Konrad
err分享
err收藏
Fabrication of High Contact-Density, Flat-Interface Nerve Electrodes for Recording and Stimulation Applications
err2016-10-04
err0
errOAAI
errYazan M. Dweiri; Matthew A. Stone; Dustin J. Tyler; Grant A. McCallum; Dominique M. Durand
err分享
err收藏
TASK-3 as a potential antidepressant target
err2011-10-01
err0
errOAAI
errAnthony L. Gotter; Vincent P. Santarelli; Scott M. Doran; Pamela L. Tannenbaum; Richard L. Kraus; Thomas W. Rosahl; Hamid Meziane; Marina Montial; Duane R. Reiss; Keith Wessner; Alexander McCampbell; Joanne Stevens; Joseph I. Brunner; Steven V. Fox; Victor N. Uebele; Douglas A. Bayliss; Christopher J. Winrow; John J. Renger
err分享
err收藏
学者 查看更多内容