arrow
返回

Processing MPI Derived Datatypes on Noncontiguous GPU-Resident Data

delete2014-10-01
delete17
PRE
AI
J
James Dinan
T
Tom Peterka
N
Nagiza F. Samatova
R
Rajeev Thakur
DOI:10.1109/TPDS.2013.234delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Driven by the goals of efficient and generic communication of noncontiguous data layouts in GPU memory, for which solutions do not currently exist, we present a parallel, noncontiguous data-processing methodology through the MPI datatypes specification. Our processing algorithm utilizes a kernel on the GPU to pack arbitrary noncontiguous GPU data by enriching the datatypes encoding to expose a fine-grained, data-point level of parallelism. Additionally, the typically tree-based datatype encoding is preprocessed to enable efficient, cached access across GPU threads. Using CUDA, we show that the computational method outperforms DMA-based alternatives for several common data layouts as well as more complex data layouts for which reasonable DMA-based processing does not exist. Our method incurs low overhead for data layouts that closely match best-case DMA usage or that can be processed by layout-specific implementations. We additionally investigate usage scenarios for data packing that incur resource contention, identifying potential pitfalls for various packing strategies. We also demonstrate the efficacy of kernel-based packing in various communication scenarios, showing multifold improvement in point-to-point communication and evaluating packing within the context of the SHOC stencil benchmark and HACC mesh analysis.
Keyword:
MPI
graphics processing unit
CUDA
datatype
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Parallel and Distributed Systems 封面图
IEEE Transactions on Parallel and Distributed Systems
IF:
6
论文数:
5.2K
被引数:
1.1W

机构

U
united states department of energy (doe)
学者数:
11.3W
论文数: 9.6W
被引数: 246
N
North Carolina State University
学者数:
2.6W
论文数: 2.3W
被引数: 3.7W
引用论文

引用论文

Complement-dependent synapse loss and microgliosis in a mouse model of multiple sclerosis
err
IF0
err2019-07-31
err0
errOAAI
errJennetta W. Hammond; Matthew J. Bellizzi; Caroline Ware; Wen Q. Qiu; Priyanka Saminathan; Herman Li; Shaopeiwen Luo; Yuanhao Li; Harris A. Gelbard
err分享
err收藏
Case Report: Further Delineation of Neurological Symptoms in Young Children Caused by Compound Heterozygous Mutation in the PIEZO2 Gene
err2021-04-28
err0
errOAAI
errMagdalena Klaniewska; Maria Jedrzejowska; Malgorzata Rydzanicz; Justyna Paprocka; Mateusz Biela; Ewelina Wolanska; Agnieszka Pollak; Emilia Debek; Maria Sasiadek; Rafal Ploski; Monika Gos; Robert Smigiel
err分享
err收藏
Impact of Gln94Glu mutation on the structure and function of protection of telomere 1, a cause of cutaneous familial melanoma
err2019-05-07
err0
PREAI
errMohd. Amir; Shahnawaz Ahmad; Shahzaib Ahamad; Vijay Kumar; Taj Mohammad; Ravins Dohare; Mohamed F. Alajmi; Tabish Rehman; Afzal Hussain; Asimul Islam; Faizan Ahmad; Md. Imtaiyaz Hassan
err分享
err收藏
Fault Accommodation Using Fuzzy Predictive Control
err2006-01-01
err0
PREAI
errL.F. Mendonca; S.M. Vieira; J.M.C. Sousa; J.M.G. Sa da Costa
err分享
err收藏
err分享
err收藏
Mössbauer study on Fe-doped TiO2 by high-energy ball milling
err2006-04-01
err0
PREAI
errDong-mei Jiang; Xiao-yan Pan; Wang-zhou Shi; Xue-ming Ma
err分享
err收藏
err2001-10-01
err0
PREAI
errAndrew N. Shipway; Itamar Willner
err分享
err收藏
学者 查看更多内容