arrow
返回

StreamGen: Model-driven Development of Distributed Streaming Applications

delete2021-01-20
delete4
PRE
AI
M
Michele Guerriero *
D
Damian A. Tamburri
E
Elisabetta Di Nitto
DOI:10.1145/3408895delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Distributed streaming applications, i.e., applications that process massive streams of data in a distributed fashion, are becoming increasingly popular to tame the velocity and the volume of Big Data. Nevertheless, the widespread adoption of data-intensive processing is still limited by the non-trivial design paradigms involved, which deal with the unboundedness and volume of involved data streams and by the many distributed streaming platforms, each with its own characteristics and APIs. In this article, we present StreamGen, a Model-Driven Engineering tool to simplify the design of such streaming applications and automatically generate the corresponding code. StreamGen is able to automatically generate fully working and processing-ready code for different target platforms (e.g., Apache Spark, Apache Plink). Evaluation shows that (i) StreamGen is general enough to model and generate the code, offering comparable performance against a preexisting similar and well-known application; (ii) the tool is fully compliant with streaming concepts defined as part of the Google Dataflow Model; and (iii) users with little computer science background and limited experience with big data have been able to work with StreamGen and create/refactor an application in a matter of minutes.
Keyword:
Model-driven engineering
streaming applications
big data architectures
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

A
ACM Transactions on Software Engineering and Methodology
IF:
6.2
论文数:
1.2K
被引数:
3.4K

机构

P
Polytechnic University of Milan
学者数:
2.0W
论文数: 1.8W
被引数: 24
引用论文

引用论文

Metallocarboxypeptidases
err1960-02-01
err0
errOAAI
errJoseph E. Coleman; Bert L. Vallee
err分享
err收藏
Dose of human menopausal gonadotropin influences the outcome of an in vitro fertilization program
err1987-12-01
err0
PREAI
errZion Ben-Rafael; Claudio A. Benadiva; Militza Ausmanas; Brenda Barber; Luis Blasco; George L. Flickinger; Luigi Mastroianni
err分享
err收藏
Location of deuterium inα-yttrium
err1981-01-15
err0
PREAI
errD. Khatamian; C. Stassis; B. J. Beaudry
err分享
err收藏
A Gβγ inhibitor reduces intimal hyperplasia in aortocoronary saphenous vein grafts
err2005-12-01
err0
errOAAI
errJason A. Petrofski; Jonathan A. Hata; Matthew L. Williams; Cyrus J. Parsa; Richard B. Thompson; Steven I. Hanish; Thomas R. Gehrig; Walter J. Koch; Carmelo A. Milano
err分享
err收藏
A fast and robust method to clone and functionally validate T-cell receptors
err2009-07-01
err0
PREAI
errKatrin Birkholz; Christian Hofmann; Stefanie Hoyer; Birgit Schulz; Thomas Harrer; Eckhart Kämpgen; Gerold Schuler; Jan Dörrie; Niels Schaft
err分享
err收藏
Reduced White Matter Fiber Density in Autism Spectrum Disorder
err2019-01-21
err0
errOAAI
errDennis Dimond; Manuela Schuetze; Robert E Smith; Thijs Dhollander; Ivy Cho; Sarah Vinette; Kayla Ten Eycke; Catherine Lebel; Adam McCrimmon; Deborah Dewey; Alan Connelly; Signe Bray
err分享
err收藏
学者 查看更多内容