.png){kind=icon}
.png){kind=icon}
Return
Scalable and Cost-Efficient ML Inference: Parallel Batch Processing with Serverless Functions
.png){kind=icon}
PRE
AI
DOI：10.1007/978-981-96-7423-7_27.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
As data-intensive applications grow, batch processing in limited-resource environments faces scalability and resource management challenges. Serverless computing offers a flexible alternative, enabling dynamic resource allocation and automatic scaling. This paper explores how serverless architectures can make large-scale ML inference tasks faster and cost-effective by decomposing monolithic processes into parallel functions. Through a case study on sentiment analysis using the DistilBERT model and the IMDb dataset, we demonstrate that serverless parallel processing can reduce execution time by over 95% compared to monolithic approaches, at the same cost.
Keywords:
Serverless Computing
Function Decomposition
Batch Processing
Scalability
Cost Efficiency