arrow
Return

FaaSLight: General Application-level Cold-start Latency Optimization for Function-as-a-Service in Serverless Computing

delete2023-07-22
delete19
PRE
AI
X
Xuanzhe Liu *
J
Jinfeng Wen
陈
陈震鹏 (Zhenpeng Chen)
李
李丁 (Ding Li)
J
Junkai Chen
Y
Yi Liu
H
Haoyu Wang
X
Xin Jin
DOI:10.1145/3585007delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Serverless computing is a popular cloud computing paradigm that frees developers from server management. Function-as-a-Service (FaaS) is the most popular implementation of serverless computing, representing applications as event-driven and stateless functions. However, existing studies report that functions of FaaS applications severely suffer from cold-start latency. In this article, we propose an approach, namely, FaaSLight, to accelerating the cold start for FaaS applications through application-level optimization. We first conduct a measurement study to investigate the possible root cause of the cold-start problem of FaaS. The result shows that application code loading latency is a significant overhead. Therefore, loading only indispensable code from FaaS applications can be an adequate solution. Based on this insight, we identify code related to application functionalities by constructing the function-level call graph and separate other code (i.e., optional code) from FaaS applications. The separated optional code can be loaded on demand to avoid the inaccurate identification of indispensable code causing application failure. In particular, a key principle guiding the design of FaaSLight is inherently general, i.e., platform- and language-agnostic. In practice, FaaSLight can be effectively applied to FaaS applications developed in different programming languages (Python and JavaScript), and can be seamlessly deployed on popular serverless platforms such as AWS Lambda and Google Cloud Functions, without having to modify the underlying OSes or hypervisors, nor introducing any additional manual engineering efforts to developers. The evaluation results on real-world FaaS applications show that FaaSLight can significantly reduce the code loading latency (up to 78.95%, 28.78% on average), thereby reducing the cold-start latency. As a result, the total response latency of functions can be decreased by up to 42.05% (19.21% on average). Compared with the state-of-the-art, FaaSLight achieves a 21.25x improvement in reducing the average total response latency.
Keywords:
Serverless computing
cold start
performance optimization
optional function elimination

Journal

A
ACM Transactions on Software Engineering and Methodology
IF:
6.2
Papers:
1.2K
Citations:
3.4K

Organization

U
University College London
Scholars:
7.9W
Papers: 6.2W
Citations: 15.7W
U
university of london
Scholars:
21.5W
Papers: 19.7W
Citations: 305
P
peking university
Scholars:
11.9W
Papers: 8.7W
Citations: 146
researcher View more organizations
Cited Papers

Cited Papers

Towards holographic renormalization of fake supergravity
err2009-07-01
err0
errOAAI
errNatalia Borodatchenkova; Michael Haack; Wolfgang Mück
errShare
errSave
Dysfunction of a 21-mm aortic bioprosthesis treated with percutaneous implantation of a CoreValve prosthesis
err2013-07-01
err0
PREAI
errCristina Giannini; Marco De Carlo; Fabio Guarracino; Maria G.D. Donne; Giovanni Benedetti; Francesco Verunelli; Anna S. Petronio
errShare
errSave
Novel κ light-chain gene rearrangements in mouse λ light chain-producing B lymphocytes
err1984-02-01
err0
PREAI
errJeannine Durdik; Mark W. Moore; Erik Selsing
errShare
errSave
Serverless Computing-Where Are We Now, and Where Are We Heading?
err2021-01-01
err26
errOAAI
errTaibi, Davide; Spillner, Josef; Wawruch, Konrad
errShare
errSave
Fabrication of High Contact-Density, Flat-Interface Nerve Electrodes for Recording and Stimulation Applications
err2016-10-04
err0
errOAAI
errYazan M. Dweiri; Matthew A. Stone; Dustin J. Tyler; Grant A. McCallum; Dominique M. Durand
errShare
errSave
TASK-3 as a potential antidepressant target
err2011-10-01
err0
errOAAI
errAnthony L. Gotter; Vincent P. Santarelli; Scott M. Doran; Pamela L. Tannenbaum; Richard L. Kraus; Thomas W. Rosahl; Hamid Meziane; Marina Montial; Duane R. Reiss; Keith Wessner; Alexander McCampbell; Joanne Stevens; Joseph I. Brunner; Steven V. Fox; Victor N. Uebele; Douglas A. Bayliss; Christopher J. Winrow; John J. Renger
errShare
errSave
researcher View more