arrow
返回

Preparing MPICH for exascale

delete2025-01-09
delete0
PRE
AI
Y
Yanfei Guo *
K
Ken Raffenetti
H
Hui Zhou
M
Min Si
A
Abdelhalim Amer
S
Shintaro Iwasaki
S
Sangmin Seo
G
Giuseppe Congiu
R
Robert Latham
L
Lena Oden
T
Thomas Gillis
R
Rohit Zambre
K
Kaiming Ouyang
C
Charles J Archer
W
Wesley Bland
J
Jithin Jose
S
Sayantan Sur
H
Hajime Fujita
D
Dmitry Durnov
M
Michael Chuvelev
S
Sagar Thapaliya
T
Taru Doodi
M
Maria Garazan
S
Steve Oyanagi
M
Marc Snir
R
Rajeev Thakur
DOI:10.1177/10943420241311608delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The advent of exascale supercomputers heralds a new era of scientific discovery, yet it introduces significant architectural challenges that must be overcome for MPI applications to fully exploit its potential. Among these challenges is the adoption of heterogeneous architectures, particularly the integration of GPUs to accelerate computation. Additionally, the complexity of multithreaded programming models has also become a critical factor in achieving performance at scale. The efficient utilization of hardware acceleration for communication, provided by modern NICs, is also essential for achieving low latency and high throughput communication in such complex systems. In response to these challenges, the MPICH library, a high-performance and widely used Message Passing Interface (MPI) implementation, has undergone significant enhancements. This paper presents four major contributions that prepare MPICH for the exascale transition. First, we describe a lightweight communication stack that leverages the advanced features of modern NICs to maximize hardware acceleration. Second, our work showcases a highly scalable multithreaded communication model that addresses the complexities of concurrent environments. Third, we introduce GPU-aware communication capabilities that optimize data movement in GPU-integrated systems. Finally, we present a new datatype engine aimed at accelerating the use of MPI derived datatypes on GPUs. These improvements in the MPICH library not only address the immediate needs of exascale computing architectures but also set a foundation for exploiting future innovations in high-performance computing. By embracing these new designs and approaches, MPICH-derived libraries from HPE Cray and Intel were able to achieve real exascale performance on OLCF Frontier and ALCF Aurora respectively.
Keyword:
Message passing interface
MPI
HPC communication
HPC network
exascale MPI

期刊

International Journal of High Performance Computing Applications 封面图
International Journal of High Performance Computing Applications
IF:
2.5
论文数:
1.1K
被引数:
1.3K

机构

I
intel usa
学者数:
736
论文数: 548
被引数: 1
A
Argonne National Laboratory
学者数:
1.1W
论文数: 9.2K
被引数: 3.8W
U
University of Illinois Urbana-Champaign
学者数:
2.4W
论文数: 2.0W
被引数: 35
U
united states department of energy (doe)
学者数:
11.3W
论文数: 9.6W
被引数: 246
I
Intel Corporation
学者数:
2.7K
论文数: 2.0K
被引数: 6
University of California System 封面图
University of California System
学者数:
37.7W
论文数: 33.8W
被引数: 6.6K
学者 查看更多机构
引用论文

引用论文

FALCON-X: Zero-copy MPI derived datatype processing on modern CPU and GPU architectures
err2020-10-01
err9
errOAAI
errHashmi, Jahanzeb Maqbool; Chu, Ching-Hsiang; Chakraborty, Sourav; Bayatpour, Mohammadreza; Subramoni, Hari; Panda, Dhabaleswar K.
err分享
err收藏
NWChem: A comprehensive and scalable open-source solution for large scale molecular simulationsNWChem: 大规模分子模拟的全面且可扩展的开源解决方案
err2010-09-01
err3.7K
errOAAI
errValiev, M.; Bylaska, E. J.; Govind, N.; Kowalski, K.; Straatsma, T. P.; Van Dam, H. J. J.; Wang, D.; Nieplocha, J.; Apra, E.; Windus, T. L.; de Jong, Wa.
err分享
err收藏
EACLE : Energy-Aware Clustering Scheme with Transmission Power Control for Sensor Networks
err2006-08-24
err0
PREAI
errKentaro Yanagihara; Jumpei Taketsugu; Kiyoshi Fukui; Shigeru Fukunaga; Shinsuke Hara; Ken-ichi Kitayama
err分享
err收藏
学者 查看更多内容