arrow
返回

Optimizing Parallel I/O Accesses through Pattern-Directed and Layout-Aware Replication

delete2020-02-01
delete5
PRE
AI
S
Shuibing He *
Y
Yanlong Yin
X
Xian‐He Sun
X
Xuechen Zhang
李
李宗鹏 (Zongpeng Li)
DOI:10.1109/TC.2019.2946135delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
As the performance gap between processors and storage devices keeps increasing, I/O performance becomes a critical bottleneck of modern high-performance computing systems. In this paper, we propose a pattern-directed and layout-aware data replication design, named PDLA, to improve the performance of parallel I/O systems. PDLA includes an HDD-based scheme H-PDLA and an SSD-based scheme S-PDLA. For applications with relatively low I/O concurrency, H-PDLA identifies access patterns of applications and makes a reorganized data replica for each access pattern on HDD-based servers with an optimized data layout. Moreover, to accommodate applications with high I/O concurrency, S-PDLA replicates critical access patterns that can bring performance benefits on SSD-based servers or on HDD-based and SSD-based servers. We have implemented the proposed replication scheme under MPICH2 library on top of OrangeFS file system. Experimental results show that H-PDLA can significantly improve the original parallel I/O system performance and demonstrate the advantages of S-PDLA over H-PDLA.
Keyword:
Parallel I/O
I/O optimization
data replication
data reorganization
data access pattern
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Computers 封面图
IEEE Transactions on Computers
IF:
3.8
论文数:
5.4K
被引数:
9.8K

机构

I
Illinois Institute of Technology
学者数:
3.8K
论文数: 3.9K
被引数: 4.2K
Z
Zhejiang Laboratory
学者数:
1.8K
论文数: 1.7K
被引数: 0
W
wuhan university
学者数:
8.1W
论文数: 5.8W
被引数: 70
W
washington state university
学者数:
1.8W
论文数: 1.6W
被引数: 114
Z
zhejiang university
学者数:
17.7W
论文数: 12.1W
被引数: 152
学者 查看更多机构
引用论文

引用论文

Creating 2D Occupancy Plots Using plot2DO
err2020-01-21
err0
PREAI
errPaula Beati; Răzvan V. Chereji
err分享
err收藏
The mean platelet volume in gestational diabetes
err2006-08-01
err0
PREAI
errNuray Bozkurt; Ercan Yılmaz; Aydan Biri; Zeki Taner; Özdemir Himmetoğlu
err分享
err收藏
Type-dependent differential expression of neuropeptide Y in chicken hypothalamus (Gallus domesticus)
err2007-10-01
err0
errOAAI
errGui-qian Chen; Xiu-fang Hu; Kunio Sugahara; Ji-shuang Chen; Xue-mei Song; Hui-chao Zheng; Yong-qing Jiang; Xin Huang; Jun-fang Jiang; Wei-dong Zhou
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容