.png){kind=icon}
Return
A Survey of Distributed Data Stream Processing Frameworks
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2019.2946884.png)
.png){kind=icon}
.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Big data processing systems are evolving to be more stream oriented where each data record is processed as it arrives by distributed and low-latency computational frameworks on a continuous basis. As the stream processing technology matures and more organizations invest in digital transformations, new applications of stream analytics will be identified and implemented across a wide spectrum of industries. One of the challenges in developing a streaming analytics infrastructure is the difficulty in selecting the right stream processing framework for the different use cases. With a view to addressing this issue, in this paper we present a taxonomy, a comparative study of distributed data stream processing and analytics frameworks, and a critical review of representative open source (Storm, Spark Streaming, Flink, Kafka Streams) and commercial (IBM Streams) distributed data stream processing frameworks. The study also reports our ongoing study on a multilevel streaming analytics architecture that can serve as a guide for organizations and individuals planning to implement a real-time data stream processing and analytics framework.
Keywords:
Dataflow architectures
data stream architectures
distributed processing systems comparison
survey
taxonomy
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
IF:
3.6
Papers:
9.8W
Citations:
29.4W
Organization
Cited Papers
ShareSaveShareSavePrimary structure of the two (4 Fe-4 S) clusters ferredoxin from Desulfovibrio desulfuricans (strain Norway 4).png)
Biochimie
BiochimieIF0
PREAI
ShareSaveAFLP markers reveal high clonal diversity and extreme longevity in four key arctic‐alpine species
PREAI
ShareSaveMultiple-mouse magnetic resonance imaging with cryogenic radiofrequency probes for evaluation of brain developmentNeuroImageOAAI
NeuroImageIF0
OAAIShareSave
View more