arrow
Return

FaaSPR: Latency-Oriented Placement and Routing Optimization for Serverless Workflow Processing

delete
delete0
PRE
AI
Y
Yunshan Jia
C
Chao Jin
Q
Qing Li
X
Xuanzhe Liu
X
Xin Jin
DOI:10.1109/TON.2025.3552407delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Workflow processing enhances the applicability of serverless computing while retaining the characteristics of fine-grained resource management and elastic scalability. However, current serverless platforms lack targeted optimization of placement and routing strategies for workflow processing, leading to high overheads due to inter-server data transmission, instance cold starts, and function request queuing. We propose FaaSPR, a serverless scheduling system that exploits placement and routing optimizations to minimize workflow processing latency. FaaSPR groups instances with potential data transmission and proportionally distributes groups with heterogeneous instances across multiple servers, taking into account resource constraints and historical placement traces. This method addresses the issues of poor scalability and frequent instance migrations in existing solutions. Utilizing a routing algorithm based on multi-stage linear programming, FaaSPR minimizes cross-server data transmission within and between instance groups while ensuring load balancing among instances. Experiments show that, compared to the state-of-the-art solution FaaSFlow, FaaSPR decreases the average and 99th percentile tail latency by up to 68.03% and 93.46%, respectively. Additionally, reducing workflow processing latency leads to up to 46.18% decrease in resource consumption for FaaS users.
Keywords:
Serverless
scheduling
placement and routing

Journal

I
IEEE Transactions on Networking
IF:
0
Papers:
551
Citations:
0

Organization

B
Beijing University of Posts and Telecommunications
Scholars:
2.6K
Papers: 1.2K
Citations: 4.2K
P
peking university
Scholars:
11.9W
Papers: 8.7W
Citations: 146
Cited Papers

Cited Papers

Xanadu
err2020-12-11
err0
PREAI
errNilanjan Daw; Umesh Bellur; Purushottam Kulkarni
errShare
errSave
Wukong
err2020-10-12
err0
errOAAI
errBenjamin Carver; Jingyuan Zhang; Ao Wang; Ali Anwar; Panruo Wu; Yue Cheng
errShare
errSave
Fireworks
err2022-03-28
err0
PREAI
errShin,Wonseok; Kim,Wook-Hee; Min,Changwoo
errShare
errSave
Joint Service Placement and Request Routing in Multi-cell Mobile Edge Computing Networks
err2019-04-01
err0
errOAAI
errKonstantinos Poularakis; Jaime Llorca; Antonia M. Tulino; Ian Taylor; Leandros Tassiulas
errShare
errSave
Placement and Routing in 3D Integrated Circuits
err2005-06-01
err0
errOAAI
errC. Ababei; Yan Feng; B. Goplen; H. Mogal; Tianpei Zhang; K. Bazargan; S. Sapatnekar
errShare
errSave
Palette Load Balancing: Locality Hints for Serverless Functions
err2023-05-08
err0
PREAI
errMania Abdi; Samuel Ginzburg; Xiayue Charles Lin; Jose Faleiro; Gohar Irfan Chaudhry; Inigo Goiri; Ricardo Bianchini; Daniel S Berger; Rodrigo Fonseca
errShare
errSave
Cost-Efficient VNF Placement and Scheduling in Public Cloud Networks
err2020-08-01
err50
errOAAI
errGao, Tao; Li, Xin; Wu, Yu; Zou, Weixia; Huang, Shanguo; Tornatore, Massimo; Mukherjee, Biswanath
errShare
errSave
researcher View more