arrow
Return

D2IA: User-defined interval analytics on distributed streams

delete2022-02-01
delete5
delete
OA
AI
A
Ahmed Awad *
R
Riccardo Tommasini
S
Samuele Langhi
M
Mahmoud Kamel
E
Emanuele Della Valle
S
Sherif Sakr
DOI:10.1016/j.is.2020.101679delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Nowadays, modern Big Stream Processing Solutions (e.g. Spark, Flink) are working towards being the ultimate framework for streaming analytics. In order to achieve this goal, they started to offer extensions of SQL that incorporate stream-oriented primitives such as windowing and Complex Event Processing (CEP). The former enables stateful computation on infinite sequences of data items while the latter focuses on the detection of events pattern. In most of the cases, data items and events are considered instantaneous, i.e., they are single time points in a discrete temporal domain. Nevertheless, a point-based time semantics does not satisfy the requirements of a number of use-cases. For instance, it is not possible to detect the interval during which the temperature increases until the temperature begins to decrease, nor for all the relations this interval subsumes. To tackle this challenge, we present D2IA; a set of novel abstract operators to define analytics on user-defined event intervals based on raw events and to efficiently reason about temporal relationships between intervals and/or point events. We realize the implementation of the concepts of D(2)IA on top of Flink, a distributed stream processing engine for big data. (C) 2020 Elsevier Ltd. All rights reserved.
Keywords:
Big Stream Processing
Complex Event Processing
User-defined event intervals
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Enterprise Information Systems cover
Enterprise Information Systems
IF:
3.9
Papers:
2.8K
Citations:
1.8K

Organization

N
Nile University
Scholars:
345
Papers: 293
Citations: 5
U
University of Tartu
Scholars:
1.1W
Papers: 7.5K
Citations: 1.5W