arrow
Return

Dynamic Adaptable Asynchronous Progress Model for MPI RMA Multiphase Applications

delete2018-09-01
delete6
delete
OA
AI
M
Min Si *
A
Antonio J. Peña
J
Jeff R. Hammond
M
Masamichi Takagi
Y
Yutaka Ishikawa
DOI:10.1109/TPDS.2018.2815568delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Casper is a process-based asynchronous progress model for MPI one-sided communication on multi-and many-core architectures. The one-sided communication is not truly one-sided in most MPI implementations: the target process still relies on software progress to complete incoming operations. Casper allows the user to specify an arbitrary number of cores dedicated to background ghost processes and transparently redirects the RMA operations to ghost processes by utilizing the PMPI redirection and MPI-3 shared-memory technologies. Although Casper benefits applications that suffer from lack of asynchronous progress, the operation redirection design might not support complex multiphase applications effectively, which often involve dynamically changing communication density and computing workloads. In this paper, we present an adaptive mechanism in Casper to address the limitation of static asynchronous progress in multiphase applications. We exploit two adaptive strategies, a user-guided strategy and a fully transparent and automatic strategy based on self-profiling and prediction, to dynamically reconfigure the asynchronous progress in Casper according to real-time performance characteristics during multiphase execution. We evaluate the adaptive approaches in both microbenchmarks and a real quantum chemistry application suite, NWChem, on the Cray XC30 supercomputer and an Intel Omni-Path cluster.
Keywords:
MPI
multiphase
one-sided
RMA
adaptation
asynchronous progress
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Parallel and Distributed Systems cover
IEEE Transactions on Parallel and Distributed Systems
IF:
6
Papers:
5.2K
Citations:
1.1W

Organization

A
Argonne National Laboratory
Scholars:
1.1W
Papers: 9.2K
Citations: 3.8W
U
united states department of energy (doe)
Scholars:
11.3W
Papers: 9.6W
Citations: 246
I
Intel Corporation
Scholars:
2.7K
Papers: 2.0K
Citations: 6
R
riken
Scholars:
2.2W
Papers: 1.9W
Citations: 24
researcher View more organizations