arrow
Return

Trigger-Based Incremental Data Processing with Unified Sync and Async Model

delete2021-01-01
delete4
delete
OA
AI
D
Dong Dai *
Y
Yong Chen
R
Robert Ross
DOI:10.1109/TCC.2018.2830348delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
In recent years, more and more applications in the cloud have needs to process large-scale on-line datasets, which evolve over time as new entries are added and existing entries are modified. Several programming frameworks, such as Percolator and Oolong, are proposed for such incremental data processing and can achieve efficient processing with an event-driven abstraction. However, these frameworks are inherently asynchronous, leaving the heavy burden of managing synchronization to applications' developers, which further significantly restricts their usabilities. In this study, we propose a trigger-based incremental computing framework in the cloud, called Domino, with both synchronous and asynchronous mechanisms to coordinate parallel triggers. With this new framework, both synchronous and asynchronous applications can be seamlessly developed. Use cases and extensive evaluation results confirm that it can deliver sufficient performance, and also is easy to use for incremental applications in large-scale distributed computing.
Keywords:
Programming framework
cloud
incremental computing
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

I
IEEE Transactions on Cloud Computing
IF:
5
Papers:
1.9K
Citations:
4.3K

Organization

Texas Tech University System cover
Texas Tech University System
Scholars:
1.5W
Papers: 1.3W
Citations: 15
T
Texas Tech University
Scholars:
7.0K
Papers: 5.8K
Citations: 1.5W
Cited Papers

Cited Papers

Classifying hand sensorimotor functions of the chronic kidney disease patients using novel manual tactile test and pinch-holding-up activity
err2019-07-11
err0
errOAAI
errI-Te Tu; Yu-Shiuan Cheng; Pu-Chun Mo; Hsiu-Yun Hsu; Li-Chieh Kuo; I-Ming Jou; Fong-Chin Su
errShare
errSave
Broadband Rectenna Arrays for Randomly Polarized Incident Waves
err2000-10-01
err0
PREAI
errJoseph A. Hagerty; Nestor D. Lopez; Branko Popovic; Zoya Popovic
errShare
errSave
Effect of trap density on the dielectric response of varistor ceramics
err1999-12-01
err0
PREAI
errG. Garcia-Belmonte; J. Bisquert; F. Fabregat-Santiago
errShare
errSave
errShare
errSave
Etiologies and Characteristics of Choroidal Neovascularization in Young Chinese Patients
err2018-08-28
err0
PREAI
errBing Liu; Xiongze Zhang; Yuting Peng; Lan Mi; Feng Wen
errShare
errSave
Parameters that Affect the Color of Direct Restorative Resins
err1978-09-01
err0
errOAAI
errJohn M. Powers; Joseph B. Dennison; Patrick J. Lepeak
errShare
errSave
Crystallization of glutathione S-transferase from human placenta
err1990-05-01
err0
PREAI
errMichael W. Parker; Mario Lo Bello; Giorgio Federici
errShare
errSave
errShare
errSave
researcher View more