arrow
Return

LogSC: Model-based one-sided communication performance estimation

delete2022-07-01
delete0
PRE
AI
Z
Ziheng Wang
H
Heng Chen *
X
Xiaoshe Dong
W
Weilin Cai
X
Xingjun Zhang
DOI:10.1016/j.future.2022.02.004delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
One-sided communication (also known as remote memory access, or RMA) in the Message Passing Interface (MPI) is a communication interface that has been introduced in MPI-2 (1997) that enables new more efficient programming models. In MPI-3, some new more flexible and efficient primitives have been introduced, which makes it easier to use and more deployable. However, compared to traditional two-sided communication, little work has been performed on analyzing one-sided communication costs, which urgently requires formal analysis. The communication performance model is a formal analysis of communication and its cost. We focus on the software model, whose core idea is that the transmission can be represented as a sequence of implicit transfers and data movements. This approach is a suitable solution for concurrent communication modeling. We propose LogSC, which consists of the window cost, transmission cost, synchronization cost, and computational cost in atomic operations. In this paper, LogSC is used to model most of the operations in one-sided communication, including the put/get operation, atomic operation, and shared memory programming of MPI. We model and evaluate the parallel tests of IMB, collectives designed by combining MPI and the MPI shared memory (MPI+MPI), and the communication in the scalable universal matrix multiplication algorithm (SUMMA), which is a common matrix multiplication algorithm. Experiments show that our modeling has high accuracy, which makes up for the lack of existing models. (c) 2022 Elsevier B.V. All rights reserved.
Keywords:
Parallel performance models
MPI-3
Performance analysis
One-sided communication
Hybrid programming

Journal

F
Future Generation Computer Systems-The International Journal of eScience
IF:
6.1
Papers:
6.8K
Citations:
2.3W

Organization

X
xi'an jiaotong university
Scholars:
9.3W
Papers: 6.7W
Citations: 75
Cited Papers

Cited Papers

errShare
errSave
The International Exascale Software Project roadmap
err2011-01-06
err395
errOAAI
errDongarra, Jack; Beckman, Pete; Moore, Terry; Aerts, Patrick; Aloisio, Giovanni; Andre, Jean-Claude; Barkai, David; Berthou, Jean-Yves; Boku, Taisuke; Braunschweig, Bertrand; Cappello, Franck; Chapman, Barbara; Chi, Xuebin; Choudhary, Alok; Dosanjh, Sudip; Dunning, Thom; Fiore, Sandro; Geist, Al; Gropp, Bill; Harrison, Robert; Hereld, Mark; Heroux, Michael; Hoisie, Adolfy; Hotta, Koh; Jin, Zhong; Ishikawa, Yutaka; Johnson, Fred; Kale, Sanjay; Kenway, Richard; Keyes, David; Kramer, Bill; Labarta, Jesus; Lichnewsky, Alain; Lippert, Thomas; Lucas, Bob; Maccabe, Barney; Matsuoka, Satoshi; Messina, Paul; Michielse, Peter; Mohr, Bernd; Mueller, Matthias S.; Nagel, Wolfgang E.; Nakashima, Hiroshi; Papka, Michael E.; Reed, Dan; Sato, Mitsuhisa; Seidel, Ed; Shalf, John; Skinner, David; Snir, Marc; Sterling, Thomas; Stevens, Rick; Streitz, Fred; Sugar, Bob; Sumimoto, Shinji; Tang, William; Taylor, John; Thakur, Rajeev; Trefethen, Anne; Valero, Mateo; van der Steen, Aad; Vetter, Jeffrey; Williams, Peg; Wisniewski, Robert; Yelick, Kathy
errShare
errSave
MPI + MPI: a new hybrid approach to parallel programming with MPI plus shared memory
err2013-05-19
err61
errOAAI
errHoefler, Torsten; Dinan, James; Buntinas, Darius; Balaji, Pavan; Barrett, Brian; Brightwell, Ron; Gropp, William; Kale, Vivek; Thakur, Rajeev
errShare
errSave
Factor analysis of the Big Five Questionnaire using polychoric correlations in children
err2007-03-03
err0
PREAI
errF. Pablo Holgado-Tello; M. Ángel Carrasco-Ortiz; María Victoria del Barrio-Gándara; Salvador Chacón-Moscoso
errShare
errSave
LogP - A practice model of parallel computation
err1996-11-01
err186
errOAAI
errCuller, DE; Karp, RM; Patterson, D; Sahay, A; Santos, EE; Schauser, KE; Subramonian, R; vonEicken, T
errShare
errSave
researcher View more