arrow
返回

Unveiling overlooked performance variance in serverless computing

delete2025-01-21
delete0
PRE
AI
J
Jinfeng Wen
陈
陈震鹏 (Zhenpeng Chen) *
F
Federica Sarro
S
Shangguang Wang
DOI:10.1007/s10664-025-10615-3delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Serverless computing is an emerging cloud computing paradigm for developing applications at the function level, known as serverless functions. Due to the highly dynamic execution environment, multiple identical runs of the same serverless function can yield different performance, specifically in terms of end-to-end response latency. However, surprisingly, our analysis of serverless computing-related papers published in top-tier conferences highlights that the research community lacks awareness of the performance variance problem, with only 38.38% of these papers employing multiple runs for quantifying it. To further investigate, we analyze the performance of 72 serverless functions collected from these papers. Our findings reveal that the performance of these serverless functions can differ by up to 338.76% (44.28% on average) across different runs. Moreover, 61.11% of these functions produce unreliable performance results, with a low number of repetitions commonly employed in the serverless computing literature. Our study highlights a lack of awareness in the serverless computing community regarding the well-known performance variance problem in software engineering. The empirical results illustrate the substantial magnitude of this variance, emphasizing that ignoring the variance can affect research reproducibility and result reliability.
Keyword:
Serverless computing
Performance variance
Empirical study
Cloud computing

期刊

Empirical Software Engineering 封面图
Empirical Software Engineering
IF:
3.6
论文数:
2.0K
被引数:
5.3K

机构

B
beijing university of posts & telecommunications
学者数:
1.4W
论文数: 1.2W
被引数: 9
U
University College London
学者数:
7.9W
论文数: 6.2W
被引数: 15.7W
U
university of london
学者数:
21.5W
论文数: 19.7W
被引数: 305
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
学者 查看更多内容