arrow
返回

Joint Optimization of Parallelism and Resource Configuration for Serverless Function Steps

delete2024-04-01
delete1
PRE
AI
Z
Zhaojie Wen
Q
Qiong Chen
Y
Yipei Niu
Z
Zhen Song
Q
Quanfeng Deng
F
Fangming Liu *
DOI:10.1109/TPDS.2024.3365134delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Function-as-a-Service (FaaS) offers a fine-grained resource provision model, enabling developers to build highly elastic cloud applications. User requests are handled by a series of serverless functions step by step, which forms a multi-step workflow. The developers are required to set proper configurations for functions to meet service level objectives (SLOs) and save costs. However, developing the configuration strategy is challenging. This is mainly because the execution of serverless functions often suffers from cold starts and performance fluctuation, which requires a dynamic configuration strategy to guarantee the SLOs. In this article, we present StepConf, a framework that automates the configuration as the workflow runs. StepConf optimizes memory size for each function step in the workflow and takes inter and intra-function parallelism into consideration, which has been overlooked by existing work. StepConf intelligently predicts the potential configurations for subsequent function steps, and proactively prewarms function instances in a configuration-aware manner to reduce the cold start overheads. We evaluate StepConf on AWS and Knative. Compared to existing work, StepConf improves performance by up to 5.6x under the same cost budget and achieves up to a 40% cost reduction while maintaining the same level of performance.
Keyword:
Parallel processing
Delays
Costs
Optimization
Resource management
Fluctuations
Engines
Serverless computing
resource management
resource configuration
function workflow

期刊

IEEE Transactions on Parallel and Distributed Systems 封面图
IEEE Transactions on Parallel and Distributed Systems
IF:
6
论文数:
5.2K
被引数:
1.1W

机构

H
huawei technologies
学者数:
3.3K
论文数: 2.9K
被引数: 1
P
Peng Cheng Laboratory
学者数:
1.7K
论文数: 1.8K
被引数: 2.0K
引用论文

引用论文

err分享
err收藏
Thymic dependence of invariant Vα14+ Natural Killer-T cell development
err1999-10-01
err0
PREAI
errFlorence Tilloy; James P. Di Santo; Albert Bendelac; Olivier Lantz
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
TASK-3 as a potential antidepressant target
err2011-10-01
err0
errOAAI
errAnthony L. Gotter; Vincent P. Santarelli; Scott M. Doran; Pamela L. Tannenbaum; Richard L. Kraus; Thomas W. Rosahl; Hamid Meziane; Marina Montial; Duane R. Reiss; Keith Wessner; Alexander McCampbell; Joanne Stevens; Joseph I. Brunner; Steven V. Fox; Victor N. Uebele; Douglas A. Bayliss; Christopher J. Winrow; John J. Renger
err分享
err收藏
err分享
err收藏
λDNN: Achieving Predictable Distributed DNN Training With Serverless Architectures
err2022-02-01
err40
PREAI
errXu, Fei; Qin, Yiling; Chen, Li; Zhou, Zhi; Liu, Fangming
err分享
err收藏
学者 查看更多内容