arrow
Return

Improving MPI communication overlap with collaborative polling

delete2013-05-09
delete10
PRE
AI
S
Sylvain Didelot *
P
Patrick Carribault
M
Marc Pérache
W
William Jalby
DOI:10.1007/s00607-013-0327-zdelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
With the rise of parallel applications complexity, the needs in term of computational power are continually growing. Recent trends in High-Performance Computing (HPC) have shown that improvements in single-core performance will not be sufficient to face the challenges of an exascale machine: we expect an enormous growth of the number of cores as well as a multiplication of the data volume exchanged across compute nodes. To scale applications up to Exascale, the communication layer has to minimize the time while waiting for network messages. This paper presents a message progression based on Collaborative Polling which allows an efficient auto-adaptive overlapping of communication phases by performing computing. This approach is new as it increases the application overlap potential without introducing overheads of a threaded message progression. We designed our approch for Infiniband into a thread-based MPI runtime called MPC. We evaluate the gain from Collaborative Polling on the NAS Parallel Benchmarks and three scientific applications, where we show significant improvements in communication times up to a factor of 2.
Keywords:
HPC
Overlap
MPI
High-speed network
Polling

Journal

C
Computing
IF:
2.8
Papers:
2.3K
Citations:
3.5K

Organization

U
Universite Paris Saclay
Scholars:
7.3W
Papers: 5.3W
Citations: 540