arrow
Return

Pheromone: Restructuring Serverless Computing With Data-Centric Function Orchestration

delete2025-02-01
delete0
PRE
AI
M
Minchen Yu *
T
Tingjia Cao
W
Wei Wang
R
Ruichuan Chen
DOI:10.1109/TNET.2024.3480031delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Serverless applications are typically composed of function workflows in which multiple short-lived functions are triggered to exchange data in response to events or state changes. Current serverless platforms coordinate and trigger functions by following high-level invocation dependencies but are oblivious to the underlying data exchanges between functions. This design is neither efficient nor easy to use in orchestrating complex workflows - developers often have to manage complex function interactions by themselves, with customized implementation and unsatisfactory performance. Therefore, we argue that function orchestration should follow a data-centric approach. In our design, the platform provides a data bucket abstraction to hold the intermediate data generated by functions. Developers can use a rich set of data trigger primitives to control when and how the output of each function should be passed to the next functions in a workflow. By making data consumption explicit and allowing it to trigger functions and drive the workflow, complex function interactions can be easily and efficiently supported. We present Pheromone - a scalable, low-latency serverless platform following this data-centric design. Compared to well-established commercial and open-source platforms, Pheromonecuts the latencies of function interactions and data exchanges by orders of magnitude, scales to large workflows, and enables easy implementation of complex applications.
Keywords:
Serverless computing
function workflow
data sharing
function workflow
data sharing

Journal

I
IEEE-ACM Transactions on Networking
IF:
3.6
Papers:
4.4K
Citations:
9.5K

Organization

U
university of wisconsin madison
Scholars:
3.8W
Papers: 2.9W
Citations: 53
T
The Chinese University of Hong Kong, Shenzhen
Scholars:
4.3K
Papers: 4.0K
Citations: 7
University of Wisconsin System cover
University of Wisconsin System
Scholars:
6.7W
Papers: 5.8W
Citations: 382
researcher View more organizations