arrow
返回

GPU-Accelerated High-Throughput Online Stream Data Processing

delete2018-06-01
delete20
PRE
AI
Z
Zhenhua Chen *
J
Jielong Xu
唐
唐建 (Jian Tang)
K
Kevin A. Kwiat
C
Chonggang Wang
DOI:10.1109/TBDATA.2016.2616116delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The Single Instruction Multiple Data (SIMD) architecture of Graphic Processing Units (GPUs) makes them perfect for parallel processing of big data. In this paper, we present the design, implementation and evaluation of G-Storm, a GPU-enabled parallel system based on Storm, which harnesses the massively parallel computing power of GPUs for high-throughput online stream data processing. G-Storm has the following desirable features: 1) G-Storm is designed to be a general data processing platform as Storm, which can handle various applications and data types. 2) G-Storm exposes GPUs to Storm applications while preserving its easy-to-use programming model. 3) G-Storm achieves high-throughput and low-overhead data processing with GPUs. 4) G-Storm accelerates data processing further by enabling Direct Data Transfer (DDT), between two executors that process data at a common GPU. We implemented G-Storm based on Storm 0.9.2 and tested it using three different applications, including continuous query, matrix multiplication and image resizing. Extensive experimental results show that 1) Compared to Storm, G-Storm achieves over 7x improvement on throughput for continuous query, while maintaining reasonable average tuple processing time. It also leads to 2.3x and 1.3x throughput improvements on the other two applications, respectively. 2) DDT significantly reduces data processing time.
Keyword:
Stream data processing
GPU
parallel computing
big data infrastructure
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

I
IEEE Transactions on Big Data
IF:
5.7
论文数:
887
被引数:
3.0K

机构

I
interdigital
学者数:
145
论文数: 169
被引数: 0
S
Syracuse University
学者数:
5.4K
论文数: 5.2K
被引数: 8.3K
引用论文

引用论文

Follistatin inhibits activin-induced differentiation of rat follicular granulosa cells in vitro
err1992-04-01
err0
PREAI
errTakanori Nakamura; Yoshihisa Hasegawa; Koshiko Sugino; Kyoko Kogawa; Koiti Titani; Hiromu Sugino
err分享
err收藏
Accuracy of Rapid Antigen Testing across SARS-CoV-2 Variants
err
IF0
err2022-03-23
err0
errOAAI
errPaul K. Drain; Meagan Bemer; Jennifer F. Morton; Ronit Dalmat; Hussein Abdille; Katherine Thomas; Timsy Uppal; Derrick Hau; Heather R. Green; Marcellene A. Gates-Hollingworth; David P. AuCoin; Subhash C. Verma
err分享
err收藏
Effect of laser power on microstructure and tensile properties of pulsed Nd:YAG laser beam welded AISI 301 austenitic stainless steel joints
err2021-01-01
err0
PREAI
errS. Gnanasekaran; S. Senthil Kumar; Narasimharaj Venugopal; Makarand Upadhyaya; T.C. Manjunath; Samson Jerold Samuel Chelladurai; G. Padmanaban
err分享
err收藏
The Mechanical Properties of Limestones Distributed in Jecheon
err2012-10-31
err0
errOAAI
errJong Woo Kim; Min Sik Kim; Pyoung Gi Kim; Seung Jae Nor; Chan Park; Young Do Jo; Sam Gyu Park
err分享
err收藏
err分享
err收藏
Deviation from symmetrically self‐similar branching in trees predicts altered hydraulics, mechanics, light interception and metabolic scaling
err2013-09-17
err0
PREAI
errDuncan D. Smith; John S. Sperry; Brian J. Enquist; Van M. Savage; Katherine A. McCulloh; Lisa P. Bentley
err分享
err收藏
The Role of Ubiquitination and SUMOylation in Telomere Biology
err2020-01-01
err0
errOAAI
errMichal Zalzman; W. Alex Meltzer; Benjamin A. Portney; Robert A. Brown; Aditi Gupta
err分享
err收藏
Surface-micromachined RF MEMs switches on GaAs substrates
err1999-07-01
err0
errOAAI
errDaniel Hyman; Juan Lam; Brett Warneke; Adele Schmitz; T. Y. Hsu; Julia Brown; James Schaffner; Andy Walston; Robert Y. Loo; Mehran Mehregany; Jae Lee
err分享
err收藏
Does the Sum-Frequency Generation Signal of Aromatic C–H Vibrations Reflect Molecular Orientation?
err2023-06-07
err0
errOAAI
errFumiki Matsumura; Chun-Chieh Yu; Xiaoqing Yu; Kuo-Yang Chiang; Takakazu Seki; Mischa Bonn; Yuki Nagata
err分享
err收藏
学者 查看更多内容