.png){kind=icon}
返回
SPSC: Stream Processing Framework Atop Serverless Computing for Industrial Big Data
.png){kind=icon}
PRE
AI
DOI：10.1109/TCYB.2024.3407886.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
With the advance of smart manufacturing and information technologies, the volume of data to process is increasing accordingly. Current solutions for big data processing resort to distributed stream processing systems, such as Apache Flink and Spark. However, such frameworks face challenges of resource underutilization and high latency in big data application scenarios. In this article, we propose SPSC, a serverless-based stream computing framework where events are discretized into the atomic stream and stateless Lambda functions are taken as context-irrelevant operators, achieving task parallelism and inherent data parallelism in processing. Also, we implement a prototype of the framework on Amazon Web service (AWS) using AWS Lambda, AWS simple queue service, and AWS DynamoDB. The evaluation shows that compared with Alibaba's real-time computing Flink version, SPSC outperforms by 10.12% when the overhead is close.
Keyword:
Big data
cloud computing
intelligent industry
serverless computing
stream processing
期刊
IF:
10.5
论文数:
1.1W
被引数:
5.0W
机构
引用论文
分享收藏Multivariate examination of brain abnormality using both structural and functional MRI.png)
NeuroImage
NeuroImageIF0
PREAI
分享收藏
查看更多内容