arrow
Return

Patterns for Distributed Real-Time Stream Processing

delete2017-11-01
delete18
delete
OA
AI
P
Pablo Basanta Val *
N
Norberto Fernández
J
Jesús Arias Fisteus
DOI:10.1109/TPDS.2017.2716929delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
In recent years, big data systems have become an active area of research and development. Stream processing is one of the potential application scenarios of big data systems where the goal is to process a continuous, high velocity flow of information items. High frequency trading (HFT) in stock markets or trending topic detection in Twitter are some examples of stream processing applications. In some cases (like, for instance, in HFT), these applications have end-to-end quality-of-service requirements and may benefit from the usage of real-time techniques. Taking this into account, the present article analyzes, from the point of view of real-time systems, a set of patterns that can be used when implementing a stream processing application. For each pattern, we discuss its advantages and disadvantages, as well as its impact in application performance, measured as response time, maximum input frequency and changes in utilization demands due to the pattern.
Keywords:
Real-time patterns
stream processing
big data

Journal

IEEE Transactions on Parallel and Distributed Systems cover
IEEE Transactions on Parallel and Distributed Systems
IF:
6
Papers:
5.2K
Citations:
1.1W

Organization

No organization information available
Cited Papers

Cited Papers

Single nuclei RNAseq analysis of HD mouse models and human brain reveals impaired oligodendrocyte maturation and potential role for thiamine metabolism
err
IF0
err2022-06-30
err0
errOAAI
errRyan G. Lim; Osama Al-Dalahmah; Jie Wu; Maxwell P. Gold; Jack C. Reidling; Guomei Tang; Miriam Adam; David Dansu; Hye-Jin Park; Patricia Casaccia; Ricardo Miramontes; Andrea M. Reyes-Ortiz; Alice Lau; Fatima Khan; Fahad Paryani; Alice Tang; Kenneth Ofori; Emily Miyoshi; Neethu Michael; Nicolette Geller; Xena E. Flowers; Jean Paul Vonsattel; Shawn Davidson; Vilas Menon; Vivek Swarup; Ernest Fraenkel; James E. Goldman; Leslie M. Thompson
errShare
errSave
A Catalog of Stream Processing Optimizations
err2014-03-01
err203
errOAAI
errHirzel, Martin; Soule, Robert; Schneider, Scott; Gedik, Bugra; Grimm, Robert
errShare
errSave
errShare
errSave
Multiple-mouse magnetic resonance imaging with cryogenic radiofrequency probes for evaluation of brain development
err2022-05-01
err0
errOAAI
errA. Arbabi; L. Spencer Noakes; D. Vousden; J. Dazai; S. Spring; O. Botelho; T. Keshavarzian; M. Mattingly; J.E. Ellegood; L.M.J. Nutter; R. Wissmann; J.G. Sled; J.P. Lerch; R.M. Henkelman; B.J. Nieman
errShare
errSave
researcher View more