arrow
返回

Enhance parallel input/output with cross-bundle aggregation

delete2015-12-03
delete4
PRE
AI
T
Teng Wang
K
Kevin Vasko
Z
Zhuo Liu
H
Hui Chen
W
Weikuan Yu *
DOI:10.1177/1094342015618017delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The exponential growth of computing power on leadership scale computing platforms imposes grand challenge to scientific applications' input/output (I/O) performance. To bridge the performance gap between computation and I/O, various parallel I/O libraries have been developed and adopted by computer scientists. These libraries enhance the I/O parallelism by allowing multiple processes to concurrently access the shared data set. Meanwhile, they are integrated with a set of I/O optimization strategies such as data sieving and two-phase I/O to better exploit the supplied bandwidth of the underlying parallel file system. Most of these techniques are optimized for the access on a single bundle of variables generated by the scientific applications during the I/O phase, which is stored in the form of file. Few of these techniques focus on cross-bundle I/O optimizations. In this article, we investigate the potential benefit from cross-bundle I/O aggregation. Based on the analysis of the I/O patterns of a mission-critical scientific application named the Goddard Earth Observing System, version 5 (GEOS-5), we propose a Bundle-based PARallel Aggregation (BPAR) framework with three partitioning schemes to improve its I/O performance as well as the I/O performance of a broad range of other scientific applications. Our experiment result reveals that BPAR can deliver 2.1x I/O performance improvement over the baseline GEOS-5, and it is very promising in accelerating scientific applications' I/O performance on various computing platforms.
Keyword:
Aggregation
GEOS-5
high-performance computing
parallel I
O
scientific application
storage system
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

International Journal of High Performance Computing Applications 封面图
International Journal of High Performance Computing Applications
IF:
2.5
论文数:
1.1K
被引数:
1.3K

机构

State University System of Florida 封面图
State University System of Florida
学者数:
12.7W
论文数: 10.9W
被引数: 130
F
Florida State University
学者数:
1.1W
论文数: 8.6K
被引数: 2.0W
引用论文

引用论文

Putting Plural Self-Awareness into Practice: The Phenomenology of Expert Musicianship
err2017-01-23
err0
errOAAI
errAlessandro Salice; Simon Høffding; Shaun Gallagher
err分享
err收藏
Mössbauer investigations on Np3S5
err1981-12-01
err0
PREAI
errT. Thévenin; J. Jové; M. Pagès; D. Damien
err分享
err收藏
Blockade of 5‐HT2 receptors with sarpogrelate uncovers 5‐HT7 receptors inhibiting the tachycardic sympathetic drive in pithed rats
err2019-12-25
err0
PREAI
errOswaldo I. Hernández‐Abreu; José Á. García‐Pedraza; Eduardo Rivera‐Mancilla; Belinda Villanueva‐Castillo; Asunción Morán; Mónica García‐Domingo; Guadalupe Manrique‐Maldonado; Alain H. Altamirano‐Espinoza; Carlos M. Villalón
err分享
err收藏
err分享
err收藏
err2003-01-01
err0
errOAAI
errPatrick S Moore; Stefania Beghelli; Giuseppe Zamboni; Aldo Scarpa
err分享
err收藏
err分享
err收藏
A possible Fourier transform infrared‐based plasma fingerprint of angiotensin‐converting enzyme inhibitor‐induced reversal of endothelial dysfunction in diabetic mice
err2017-07-31
err0
PREAI
errEmilia Staniszewska‐Slezak; Ewelina Wiercigroch; Andrzej Fedorowicz; Elżbieta Buczek; Lukasz Mateuszuk; Malgorzata Baranska; Stefan Chlopicki; Kamilla Malek
err分享
err收藏
学者 查看更多内容