arrow
返回

Spotting Code Optimizations in Data-Parallel Pipelines through PeriSCOPE

delete2015-06-01
delete2
PRE
AI
X
Xuepeng Fan *
Z
Zhenyu Guo
金
金海 (Hai Jin)
X
Xiaofei Liao
J
Jiaxing Zhang
H
Hucheng Zhou
W
Wei Lin
J
Jingren Zhou
L
Lidong Zhou
DOI:10.1109/TPDS.2014.2326416delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
To minimize the amount of data-shuffling I/O that occurs between the pipeline stages of a distributed data-parallel program, its procedural code must be optimized with full awareness of the pipeline that it executes in. Unfortunately, neither pipeline optimizers nor traditional compilers examine both the pipeline and procedural code of a data-parallel program so programmers must either hand-optimize their program across pipeline stages or live with poor performance. To resolve this tension between performance and programmability, this paper describes PeriSCOPE, which automatically optimizes a data-parallel program's procedural code in the context of data flow that is reconstructed from the program's pipeline topology. Such optimizations eliminate unnecessary code and data, perform early data filtering, and calculate small derived values (e.g., predicates) earlier in the pipeline, so that less data-sometimes much less data-is transferred between pipeline stages. PeriSCOPE further leverages symbolic execution to enlarge the scope of such optimizations by eliminating dead code. We describe how PeriSCOPE is implemented and evaluate its effectiveness on real production jobs.
Keyword:
Data-parallel
data-shuffling I/O
optimization
static analysis
symbolic execution
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Parallel and Distributed Systems 封面图
IEEE Transactions on Parallel and Distributed Systems
IF:
6
论文数:
5.2K
被引数:
1.1W

机构

暂无机构信息
引用论文

引用论文

Clinical, immunological and microbial gingival profile of juvenile systemic lupus erythematosus patients
err2018-12-18
err0
PREAI
errM R C Sete; J C Carlos; R Lira-Junior; E A Boström; F R Sztajnbok; C M Figueredo
err分享
err收藏
Comparison of short-term heart rate variability indexes evaluated through electrocardiographic and continuous blood pressure monitoring
err2019-02-07
err0
PREAI
errRiccardo Pernice; Michal Javorka; Jana Krohova; Barbora Czippelova; Zuzana Turianikova; Alessandro Busacca; Luca Faes
err分享
err收藏
Deviation from symmetrically self‐similar branching in trees predicts altered hydraulics, mechanics, light interception and metabolic scaling
err2013-09-17
err0
PREAI
errDuncan D. Smith; John S. Sperry; Brian J. Enquist; Van M. Savage; Katherine A. McCulloh; Lisa P. Bentley
err分享
err收藏
A Formal Asymmetric Synthesis of Calabar Bean Alkaloids.
err1996-01-01
err0
errOAAI
errManabu NODE; Xiao-jiang HAO; Kiyoharu NISHIDE; Kaoru FUJI
err分享
err收藏
学者 查看更多内容