arrow
Return

Efficient Data Redistribution Algorithms From Irregular to Block Cyclic Data Distribution

delete2022-12-01
delete1
PRE
AI
S
Shengguo Li
H
Hao Jiang
D
Dezun Dong
C
Chun Huang
J
Jie Liu
X
Xia Liao
X
Xuguang Chen *
DOI:10.1109/TPDS.2022.3166484delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this paper, we propose some efficient data redistribution algorithms for redistributing matrices from 1D or 2D irregular format to block cyclic data distribution (BCDD) format, which can be much faster than the BLACS routine PXGEMR2D. These algorithms can be used to combine direct methods with iterative methods. The proposed algorithms divide the communication into two phases: one for processes in the same column and the other for processes in the same row, and the whole data redistribution task is divided into several independent sub-communications. The communication time can be reduced a lot compared with BLACS. Performance results show that our algorithms can be 2x-5x faster than the BLACS routine PXGEMR2D when using 4096 processes and the experiments are performed on Tianhe-2A supercomputer.
Keywords:
BLACS
data redistribution
irregular data
scalapack
BCDD
exascale computing

Journal

IEEE Transactions on Parallel and Distributed Systems cover
IEEE Transactions on Parallel and Distributed Systems
IF:
6
Papers:
5.2K
Citations:
1.1W

Organization

N
national university of defense technology - china
Scholars:
1.8W
Papers: 1.4W
Citations: 9