arrow
Return

Patterns for Distributed Real-Time Stream Processing

delete2017-11-01
delete18
delete
OA
AI
P
Pablo Basanta Val *
N
Norberto Fernández
J
Jesús Arias Fisteus
DOI:10.1109/TPDS.2017.2716929delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
In recent years, big data systems have become an active area of research and development. Stream processing is one of the potential application scenarios of big data systems where the goal is to process a continuous, high velocity flow of information items. High frequency trading (HFT) in stock markets or trending topic detection in Twitter are some examples of stream processing applications. In some cases (like, for instance, in HFT), these applications have end-to-end quality-of-service requirements and may benefit from the usage of real-time techniques. Taking this into account, the present article analyzes, from the point of view of real-time systems, a set of patterns that can be used when implementing a stream processing application. For each pattern, we discuss its advantages and disadvantages, as well as its impact in application performance, measured as response time, maximum input frequency and changes in utilization demands due to the pattern.
Keywords:
Real-time patterns
stream processing
big data
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Parallel and Distributed Systems cover
IEEE Transactions on Parallel and Distributed Systems
IF:
6
Papers:
5.2K
Citations:
1.1W

Organization

U
Universidad Carlos III de Madrid
Scholars:
5.5K
Papers: 5.7K
Citations: 4.5K
U
Universidade de Vigo
Scholars:
7.7K
Papers: 8.3K
Citations: 13