arrow
Return

A Catalog of Stream Processing Optimizations

delete2014-03-01
delete203
delete
OA
AI
M
Martin Hirzel *
R
Robert Soulé
S
Scott Schneider
B
Buğra Gedik
R
Robert Grimm
DOI:10.1145/2528412delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Various research communities have independently arrived at stream processing as a programming model for efficient and parallel computing. These communities include digital signal processing, databases, operating systems, and complex event processing. Since each community faces applications with challenging performance requirements, each of them has developed some of the same optimizations, but often with conflicting terminology and unstated assumptions. This article presents a survey of optimizations for stream processing. It is aimed both at users who need to understand and guide the system's optimizer and at implementers who need to make engineering tradeoffs. To consolidate terminology, this article is organized as a catalog, in a style similar to catalogs of design patterns or refactorings. To make assumptions explicit and help understand tradeoffs, each optimization is presented with its safety constraints (when does it preserve correctness?) and a profitability experiment (when does it improve performance?). We hope that this survey will help future streaming system builders to stand on the shoulders of giants from not just their own community.
Keywords:
Languages
Stream processing
optimizations

Journal

ACM Computing Surveys cover
ACM Computing Surveys
IF:
28
Papers:
2.5K
Citations:
3.5W

Organization

I
ihsan dogramaci bilkent university
Scholars:
3.6K
Papers: 3.6K
Citations: 8
I
international business machines (ibm)
Scholars:
5.7K
Papers: 4.5K
Citations: 4
U
universita della svizzera italiana
Scholars:
55
Papers: 29
Citations: 0
N
New York University
Scholars:
552
Papers: 290
Citations: 0
researcher View more organizations
Cited Papers

Cited Papers

Latitude and Weather Influences on Sun Light Quality and the Relationship to Tree Growth
err2019-07-24
err0
errOAAI
errCamilo Chiang; Jorunn E. Olsen; David Basler; Daniel Bånkestad; Günter Hoch
errShare
errSave
errShare
errSave
Clinical, immunological and microbial gingival profile of juvenile systemic lupus erythematosus patients
err2018-12-18
err0
PREAI
errM R C Sete; J C Carlos; R Lira-Junior; E A Boström; F R Sztajnbok; C M Figueredo
errShare
errSave
Assessment of the long‐term impact of deer on understory vegetation in mixed temperate forests
err2019-02-14
err0
PREAI
errTina Simončič; Andrej Bončina; Kristjan Jarni; Matija Klopčič
errShare
errSave
AFLP markers reveal high clonal diversity and extreme longevity in four key arctic‐alpine species
err2011-11-10
err0
PREAI
errLUCIENNE C. De WITTE; GEORG F. J. ARMBRUSTER; LUDOVIC GIELLY; PIERRE TABERLET; JÜRG STÖCKLIN
errShare
errSave
researcher View more