返回
Optimizing Parallel I/O Accesses through Pattern-Directed and Layout-Aware Replication
DOI:10.1109/TC.2019.2946135.png)
摘要
En 中文
As the performance gap between processors and storage devices keeps increasing, I/O performance becomes a critical bottleneck of modern high-performance computing systems. In this paper, we propose a pattern-directed and layout-aware data replication design, named PDLA, to improve the performance of parallel I/O systems. PDLA includes an HDD-based scheme H-PDLA and an SSD-based scheme S-PDLA. For applications with relatively low I/O concurrency, H-PDLA identifies access patterns of applications and makes a reorganized data replica for each access pattern on HDD-based servers with an optimized data layout. Moreover, to accommodate applications with high I/O concurrency, S-PDLA replicates critical access patterns that can bring performance benefits on SSD-based servers or on HDD-based and SSD-based servers. We have implemented the proposed replication scheme under MPICH2 library on top of OrangeFS file system. Experimental results show that H-PDLA can significantly improve the original parallel I/O system performance and demonstrate the advantages of S-PDLA over H-PDLA.
Keyword:
Parallel I/O
I/O optimization
data replication
data reorganization
data access pattern
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
3.8
论文数:
5.4K
被引数:
9.8K
机构
引用论文
A Cost-Effective Distribution-Aware Data Replication Scheme for Parallel I/O Systems用于并行I/O系统的经济高效的分布式感知数据复制方案
Type-dependent differential expression of neuropeptide Y in chicken hypothalamus (Gallus domesticus)
Improving Performance of Parallel I/O Systems through Selective and Layout-Aware SSD Cache通过选择性和布局感知的固态硬盘高速缓存提高并行I/O系统的性能

