arrow
Return

Harnessing sliding-window execution semantics for parallel stream processing

delete2018-06-01
delete10
delete
OA
AI
G
Gabriele Mencagli *
M
Massimo Torquati
F
Fabio Lucattini
S
Salvatore Cuomo
M
Marco Aldinucci
DOI:10.1016/j.jpdc.2017.10.021delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
According to the recent trend in data acquisition and processing technology, big data are increasingly available in the form of unbounded streams of elementary data items to be processed in real-time. In this paper we study in detail the paradigm of sliding windows, a well-known technique for approximated queries that update their results continuously as new fresh data arrive from the stream. In this work we focus on the relationship between the various existing sliding window semantics and the way the query processing is performed from the parallelism perspective. From this study two alternative parallel models are identified, each covering semantics with very precise properties. Each model is described in terms of its pros and cons, and parallel implementations in the FastFlow framework are analyzed by discussing the layout of the concurrent data structures used for the efficient windows representation in each model. (C) 2017 Elsevier Inc. All rights reserved.
Keywords:
Data stream processing
Internet of Things
Continuous queries
Sliding windows
Parallel computing
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Journal of Parallel and Distributed Computing cover
Journal of Parallel and Distributed Computing
IF:
4
Papers:
3.8K
Citations:
4.8K

Organization

U
University of Turin
Scholars:
3.7W
Papers: 2.8W
Citations: 3.2W
U
University of Naples Federico II
Scholars:
4.7W
Papers: 3.6W
Citations: 51
U
University of Pisa
Scholars:
3.1W
Papers: 2.4W
Citations: 2.4W
researcher View more organizations