arrow
Return

Timestamped State Sharing for Stream Analytics

delete2021-11-01
delete3
PRE
AI
Y
Yunjian Zhao
刘智 (Zhi Liu)
G
Guanxian Jiang
J
James Cheng *
K
Kunlong Liu
X
Xiao Yan
DOI:10.1109/TPDS.2021.3073253delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
State access in existing distributed stream processing systems is restricted locally within each operator. However, in advanced stream analytics such as online learning and dynamic graph analytics, enabling state sharing across different operators makes application development easier and stream processing more efficient. In addition, when stream records are timestamped, proper time semantics should be defined for both state updates and fetches. We propose a new state abstraction to address the limitations of existing systems and develop a distributed stream processing system, Nova, with native support for timestamped state sharing. We validate the expressiveness and efficiency of Nova with extensive experiments.
Keywords:
Semantics
Pattern matching
Throughput
Sparks
Real-time systems
Industries
Storms
State sharing
distributed stream processing
online learning
dynamic graph analytics
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Parallel and Distributed Systems cover
IEEE Transactions on Parallel and Distributed Systems
IF:
6
Papers:
5.2K
Citations:
1.1W

Organization

C
Chinese University of Hong Kong
Scholars:
3.4W
Papers: 3.2W
Citations: 5.6W