arrow
返回

Composing high-level stream processing pipelines

delete2020-09-29
delete5
delete
OA
AI
T
Tanmaya Mahapatra *
DOI:10.1186/s40537-020-00353-2delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
The growing number of Internet of Things (IoT) devices provide a massive pool of sensing data. However, turning data into actionable insights is not a trivial task, especially in the context of IoT, where application development itself is complex. The process entails working with heterogeneous devices via various communication protocols to co-ordinate and fetch datasets, followed by a series of data transformations. Graphical mashup tools, based on the principles of flow-based programming paradigm, operating at a higher-level of abstraction are in widespread use to support rapid prototyping of IoT applications. Nevertheless, the current state-of-the-art mashup tools suffer from several architectural limitations which prevent composing in-flow data analytics pipelines. In response to this, the paper contributes by (i) designing novel flow-based programming concepts based on the actor model to support data analytics pipelines in mashup tools, prototyping the ideas in a new mashup tool called aFlux and providing a detailed comparison with the existing state-of-the-art and (ii) enabling easy prototyping of streaming applications in mashup tools by abstracting the behavioural configurations of stream processing via graphical flows and validating the ease as well as the effectiveness of composing stream processing pipelines from an end-user perspective in a traffic simulation scenario.
Keyword:
Flow-based programming
Graphical pipelines
Mashup tools
Graphical stream processing
Stream analytics
End-user programming
Data Analytics as a Service (DAaaS)
Data Analytics Applications (DAAs)
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Journal of Big Data 封面图
Journal of Big Data
IF:
6.4
论文数:
1.5K
被引数:
1.1W

机构

T
Technical University of Munich
学者数:
5.2W
论文数: 3.9W
被引数: 6.2W
引用论文

引用论文

Graphical Flow-based Spark Programming
err2020-01-08
err3
errOAAI
errMahapatra, Tanmaya; Prehofer, Christian
err分享
err收藏
Herbivore impacts on two morphologically similar bloom-forming Ulva species in a eutrophic bay
err2015-02-07
err0
errOAAI
errMichele Guidone; Carol S. Thornber; Kathryn L. Van Alstyne
err分享
err收藏
Pharmacokinetics of methysergide and its metabolite methylergometrine in man
err1986-01-01
err0
PREAI
errU. Bredberg; G. S. Eyjolfsdottir; L. Paalzow; P. Tfelt-Hansen; V. Tfelt-Hansen
err分享
err收藏
High-quality plant DNA extraction for PCR: an easy approach
err2009-06-01
err0
PREAI
errI. Ahmed; M. Islam; W. Arshad; A. Mannan; W. Ahmad; B. Mirza
err分享
err收藏
Faunal changes in Waitemata Harbour sediments, 1930s‐1990s
err1997-03-01
err0
errOAAI
errBruce W. Hayward; A. Brett Stephenson; Margaret Morley; Jenny L. Riley; Hugh R. Grenfell
err分享
err收藏
学者 查看更多内容