arrow
Return

Scale Interoperable Composite Backend Services With AFCL Workflows in Serverless Sky Computing

delete
delete0
delete
OA
AI
P
Philipp Gritsch
M
Marco Cotrotzo
S
Sasko Ristov
DOI:10.1109/TNSM.2025.3592700delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Cloud providers offer serverless, pre-trained ML-based Backend-as-a-Service (BaaS) services, for tasks like translation or speech conversion via single API calls. However, for more complex conversions, users compose multiple BaaS services into serverless workflows to overcome individual limitations. This paper investigates the scalability and interoperability of such composite BaaS services within Sky Computing, focusing on dynamic provider selection between AWS and GCP. We develop two scalable composite BaaS services and propose a novel approach to federate BaaS services, offering two interoperability mechanisms: (1) through-workflow and (2) through-function, enabling seamless integration and dynamic selection of cloud providers. Experiments reveal significant runtime variability in Sky Computing, with extreme outliers of up to $12.9 \times $ , making naive averaging strategies unsuitable to determine the optimal configuration. In addition to the well-known cold and warm start effects in FaaS performance models, we identify four additional categories of anomalies that, when FaaS and BaaS are combined, generate extreme outliers far beyond baseline performance instability. Finally, we propose a theoretical framework to explain these behaviors and mitigate their impact, paving the way for reliable and scalable composite BaaS workflows.
Keywords:
Backend-as-a-Service
interoperability
serverless
workflows

Journal

IEEE Transactions on Network and Service Management cover
IEEE Transactions on Network and Service Management
IF:
5.4
Papers:
528
Citations:
9.2K

Organization

U
University of Innsbruck
Scholars:
9.8K
Papers: 8.6K
Citations: 8