arrow
返回

Paving the way towards high-level parallel pattern interfaces for data stream processing

delete2018-10-01
delete7
delete
OA
AI
D
David del Rio Astorga
M
Manuel F. Dolz *
J
Javier Fernández
J
J. Daniel García
DOI:10.1016/j.future.2018.05.011delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
The emergence of the Internet of Things (IoT) data stream applications has posed a number of new challenges to existing infrastructures, processing engines, and programming models. In this sense, high-level interfaces, encapsulating algorithmic aspects in pattern-based constructions, have considerably reduced the development and parallelization efforts of this type of applications. An example of parallel pattern interface is GRPPI, a C++ generic high-level library that acts as a layer between developers and existing parallel programming frameworks, such as C++ threads, OpenMP and Intel TBB. In this paper, we complement the basic patterns supported by GRPPI with the new stream operators Split-Join and Window, and the advanced parallel patterns Stream-Pool, Windowed-Farm and Stream-Iterator for the aforementioned back ends. Thanks to these new stream operators, complex compositions among streaming patterns can be expressed. On the other hand, the collection of advanced patterns allows users to tackle some domain-specific applications, ranging from the evolutionary to the real-time computing areas, where compositions of basic patterns are not capable of fully mimicking the algorithmic behavior of their original sequential codes. The experimental evaluation of the new advanced patterns and the stream operators on a set of domain-specific use-cases, using different back ends and pattern-specific parameters, reports considerable performance gains with respect to the sequential versions. Additionally, we demonstrate the benefits of the GRPPI pattern interface from the usability, flexibility and readability points of view. (C) 2018 Elsevier B.V. All rights reserved.
Keyword:
Data stream processing
Parallel programming framework
Stream operator
Domain-specific parallel pattern
High-level API
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

F
Future Generation Computer Systems-The International Journal of eScience
IF:
6.1
论文数:
6.8K
被引数:
2.3W

机构

U
Universidad Carlos III de Madrid
学者数:
5.5K
论文数: 5.7K
被引数: 4.5K
引用论文

引用论文

err
IF0
err
err0
PREAI
err
err分享
err收藏
Apache Spark: A Unified Engine for Big Data ProcessingApache Spark: 用于大数据处理的统一引擎
err2016-10-28
err1.7K
PREAI
errZaharia, Matei; Xin, Reynold S.; Wendell, Patrick; Das, Tathagata; Armbrust, Michael; Dave, Ankur; Meng, Xiangrui; Rosen, Josh; Venkataraman, Shivaram; Franklin, Michael J.; Ghodsi, Ali; Gonzalez, Joseph; Shenker, Scott; Stoica, Ion
err分享
err收藏
Vision-Targeted Health-Related Quality of Life in Adult Survivors of Retinoblastoma
err2018-06-01
err0
errOAAI
errDanielle Novetsky Friedman; Joanne F. Chou; Jasmine H. Francis; Charles A. Sklar; Yuelin Li; Mary McCabe; Leslie L. Robison; Ruth A. Kleinerman; Kevin C. Oeffinger; David H. Abramson; Ira J. Dunkel; Jennifer S. Ford
err分享
err收藏
没有更多内容