arrow
Return

Efficient multi-query evaluation for distributed CEP through predicate-based push-pull plans

delete2024-02-01
delete0
PRE
AI
S
Steven Purtzel
S
Samira Akili *
M
Matthias Weidlich
DOI:10.1016/j.is.2023.102250delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Complex Event Processing (CEP) evaluates queries over event streams. However, once events are generated by nodes in a network, query evaluation requires the transmission of events between the nodes. Commonly, this is realized by sending events immediately upon their generation. Yet, to reduce network communication, query evaluation may incorporate pull-based communication, where events are buffered locally until they are requested by another node. Existing approaches for push-pull communication in distributed CEP, however, are limited in the expressiveness of pull requests and leverage solely the temporal constraints imposed by a query.In this paper, we propose a new evaluation model for distributed CEP, coined predicate-based push-pull (PrePP) plans. It includes pull requests that enable fine-granular filtering of events at their sources based on query predicates, thereby reducing event transmission. We formulate the problem of constructing PrePP plans with minimal transmission cost that also exploit opportunities for sharing of intermediate results among the queries of workload. However, the construction of optimal PrePP plans turns out to be NP-hard. We therefore propose algorithms to speed up the construction of PrePP plans, while producing near-optimal results. We illustrate the benefits of PrePP plans for distributed CEP in comprehensive experiments with synthetic as well as real-world data. Specifically, PrePP plans can reduce event transmission by up to three orders of magnitude over baseline techniques.
Keywords:
Complex event processing
Distributed query evaluation
Push-pull communication

Journal

Enterprise Information Systems cover
Enterprise Information Systems
IF:
3.9
Papers:
2.8K
Citations:
1.8K

Organization

H
Humboldt University of Berlin
Scholars:
3.2W
Papers: 2.7W
Citations: 47
Cited Papers

Cited Papers

Local tests, local contexts
err2022-07-18
err0
PREAI
errSlobodanka Dimova; Xun Yan; April Ginther
errShare
errSave
errShare
errSave
Network-wide complex event processing over geographically distributed data sources
err2020-02-01
err7
PREAI
errFlouris, Ioannis; Giatrakos, Nikos; Deligiannakis, Antonios; Garofalakis, Minos
errShare
errSave
Portable fire evacuation guide robot system
err2009-10-01
err0
PREAI
errYoung-Duk Kim; Yoon-Gu Kim; Seung-Hyun Lee; Jeong-Ho Kang; Jinung An
errShare
errSave
Optimizing Event Pattern Matching Using Business Process Models
err2014-11-01
err28
PREAI
errWeidlich, Matthias; Ziekow, Holger; Gal, Avigdor; Mendling, Jan; Weske, Mathias
errShare
errSave
no more