arrow
返回

Efficient Data Redistribution Algorithms From Irregular to Block Cyclic Data Distribution

delete2022-12-01
delete1
PRE
AI
S
Shengguo Li
H
Hao Jiang
D
Dezun Dong
C
Chun Huang
J
Jie Liu
X
Xia Liao
X
Xuguang Chen *
DOI:10.1109/TPDS.2022.3166484delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In this paper, we propose some efficient data redistribution algorithms for redistributing matrices from 1D or 2D irregular format to block cyclic data distribution (BCDD) format, which can be much faster than the BLACS routine PXGEMR2D. These algorithms can be used to combine direct methods with iterative methods. The proposed algorithms divide the communication into two phases: one for processes in the same column and the other for processes in the same row, and the whole data redistribution task is divided into several independent sub-communications. The communication time can be reduced a lot compared with BLACS. Performance results show that our algorithms can be 2x-5x faster than the BLACS routine PXGEMR2D when using 4096 processes and the experiments are performed on Tianhe-2A supercomputer.
Keyword:
BLACS
data redistribution
irregular data
scalapack
BCDD
exascale computing

期刊

IEEE Transactions on Parallel and Distributed Systems 封面图
IEEE Transactions on Parallel and Distributed Systems
IF:
6
论文数:
5.2K
被引数:
1.1W

机构

N
national university of defense technology - china
学者数:
1.8W
论文数: 1.4W
被引数: 9
引用论文

引用论文

A Novel Oddball Paradigm for Affective BCIs Using Emotional Faces as Stimuli
err2011-01-01
err0
PREAI
errQibin Zhao; Akinari Onishi; Yu Zhang; Jianting Cao; Liqing Zhang; Andrzej Cichocki
err分享
err收藏
Scheduling block-cyclic array redistribution
err1998-01-01
err54
errOAAI
errDesprez, F; Dongarra, J; Petitet, A; Randriamaro, C; Robert, Y
err分享
err收藏
623 Tflop/s HPCG run on Tianhe-2: Leveraging millions of hybrid cores
err2015-11-30
err25
PREAI
errLiu, Yiqun; Yang, Chao; Liu, Fangfang; Zhang, Xianyi; Lu, Yutong; Du, Yunfei; Yang, Canqun; Xie, Min; Liao, Xiangke
err分享
err收藏
A 3-Hydroxypropionate/4-Hydroxybutyrate Autotrophic Carbon Dioxide Assimilation Pathway in Archaea
err2007-12-14
err0
PREAI
errIvan A. Berg; Daniel Kockelkorn; Wolfgang Buckel; Georg Fuchs
err分享
err收藏
Etching of a-Si:H on c-Si absorber monitored by in situ photoluminescence measurements
err2011-01-01
err0
errOAAI
errStefanie M. Greil; Nicola Mingirulli; Lars Korte; Korina Hartmann; Andreas Schöpke; Jörg Rappich; Bernd Rech
err分享
err收藏
学者 查看更多内容