arrow
Return

Scalable join operators over data streams with shared-nothing parallelism

delete2026-09-29
delete0
PRE
AI
G
Gabriele Mencagli *
R
Rymarchuk, Yuriy
D
Dalvan Griebler
DOI:10.1016/j.is.2026.102749delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Stream joins are among the most computationally demanding stateful operators in stream processing. Tuples arriving from different streams must be analyzed on-the-fly to identify pairs that satisfy specific user-defined conditions. Since buffering all tuples from the input streams is infeasible due to memory constraints, stream joins are typically computed over a subset of the received tuples. This subset is often organized either by a specific time interval (online interval joins) or by fixed-length temporal windows with a defined slide (window joins). In this paper, we present various parallel patterns for stream join computation, aimed at effectively increasing overall query throughput. Our focus is on leveraging shared-nothing parallelism to provide portable parallelization strategies that can be efficiently executed on modern scale-in and scale-out Stream Processing Engines. Among the proposed patterns, the one exhibiting hybrid parallelism emerges as the most promising in terms of performance and load balancing. The experimental evaluation highlights the performance characteristics of the proposed patterns using real-world datasets and diverse key distributions, and compares them with state-of-the-art solutions, confirming the effectiveness of the parallel pattern with hybrid parallelism against the main competitors.
Keywords:
Data stream processing
Online interval join
Parallel processing
Shared-nothing parallelism

Journal

I
Information Systems
IF:
3.4
Papers:
134
Citations:
0

Organization

U
University of Pisa
Scholars:
622
Papers: 218
Citations: 0
Cited Papers

Cited Papers

No cited papers available