arrow
返回

Transparent runtime parallelization of the R scripting language

delete2011-02-01
delete7
PRE
AI
J
Jiangtian Li *
X
Xiaosong Ma
S
Srikanth B. Yoginath
G
Guruprasad Kora
N
Nagiza F. Samatova
DOI:10.1016/j.jpdc.2010.08.013delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Scripting languages such as R and Matlab are widely used in scientific data processing. As the data volume and the complexity of analysis tasks both grow, sequential data processing using these tools often becomes the bottleneck in scientific workflows. We describe pR, a runtime framework for automatic and transparent parallelization of the popular R language used in statistical computing. Recognizing scripting languages' interpreted nature and data analysis codes' use pattern, we propose several novel techniques: (1) applying parallelizing compiler technology to runtime, whole-program dependence analysis of scripting languages, (2) incremental code analysis assisted with evaluation results, and (3) runtime parallelization of file accesses. Our framework does not require any modification to either the source code or the underlying R implementation. Experimental results demonstrate that pR can exploit both task and data parallelism transparently and overall has better performance as well as scalability compared to an existing parallel R package that requires code modification. (C) 2010 Elsevier Inc. All rights reserved.
Keyword:
Runtime parallelization
Incremental analysis
Scripting languages
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Journal of Parallel and Distributed Computing 封面图
Journal of Parallel and Distributed Computing
IF:
4
论文数:
3.8K
被引数:
4.8K

机构

U
united states department of energy (doe)
学者数:
11.3W
论文数: 9.6W
被引数: 246
M
Microsoft
学者数:
3.0K
论文数: 2.7K
被引数: 7
N
North Carolina State University
学者数:
2.6W
论文数: 2.3W
被引数: 3.7W
学者 查看更多机构
引用论文

引用论文

AUTOMATIC PROGRAM PARALLELIZATION
err1993-01-01
err166
PREAI
errBANERJEE, U; EIGENMANN, R; NICOLAU, A; PADUA, DA
err分享
err收藏
Assessment of neglect reveals dissociable behavioral but not neuroanatomical subtypes
err2009-02-26
err0
PREAI
errRegina McGlinchey-Berroth; David P. Bullis; William P. Milberg; Mieke Verfaellie; Michael Alexander; Mark D'Esposito
err分享
err收藏
err分享
err收藏
Incorporation of a chiral gem-disubstituted nitrogen heterocycle yields an oxazolidinone antibiotic with reduced mitochondrial toxicity
err2019-09-01
err0
errOAAI
errAlexander W. Sun; Philip L. Bulterys; Michael D. Bartberger; Peter A. Jorth; Brendan M. O'Boyle; Scott C. Virgil; Jeff F. Miller; Brian M. Stoltz
err分享
err收藏
Eisenmenger ductus arteriosus with prolonged survival
err1984-08-01
err0
PREAI
errBruce M. McManus; Peter F. Hahn; John A. Smith; William C. Roberts; James H. Jackson
err分享
err收藏
The dual charge compensation effect of Na+ ions on the luminescence behavior of red phosphor NaMgPO4:Eu3+
err2015-12-01
err0
PREAI
errQiwei Long; Yong Gao; Yingheng Huang; Sen Liao; Baoling Song; Wenwei Wu; Jiajia Cai
err分享
err收藏
学者 查看更多内容