arrow
Return

Layout-Agnostic MPI Abstraction for Distributed Computing in Modern

delete2026-01-01
delete0
PRE
AI
J
Jiří Klepl *
M
Martin Kruliš
M
Matyáš Brabec
DOI:10.1007/978-3-032-07194-1_3delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Message Passing Interface (MPI) has been a well-established technology in the domain of distributed high-performance computing for several decades. However, one of its greatest drawbacks is a rather ancient pure-C interface. It lacks many useful features of modern languages (namely C++), like basic type-checking or support for generic code design. In this paper, we propose a novel abstraction for MPI, which we implemented as an extension of the C++ Noarr library. It follows Noarr paradigms (first-class layout and traversal abstraction) and offers layout-agnostic design of MPI applications. We also implemented a layout-agnostic distributed GEMM kernel as a case study to demonstrate the usability and syntax of the proposed abstraction. We show that the abstraction achieves performance comparable to the state-ofthe-art MPI C++ bindings while allowing for a more flexible design of distributed applications.
Keywords:
Distributed computing
Memory layout
Layout agnosticism
Noarr
C plus
Abstraction

Journal

R
RECENT ADVANCES IN THE MESSAGE PASSING INTERFACE, EUROMPI 2025
IF:
0
Papers:
8
Citations:
0

Organization

C
Charles University Prague
Scholars:
3.0W
Papers: 2.2W
Citations: 158
Cited Papers

Cited Papers

err
IF0
err
err0
PREAI
err
errShare
errSave
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
Kokkos 3: Programming Model Extensions for the Exascale Era
err2022-04-01
err165
errOAAI
errTrott, Christian R.; Lebrun-Grandie, Damien; Arndt, Daniel; Ciesko, Jan; Dang, Vinh; Ellingwood, Nathan; Gayatri, Rahulkumar; Harvey, Evan; Hollman, Daisy S.; Ibanez, Dan; Liber, Nevin; Madsen, Jonathan; Miles, Jeff; Poliakoff, David; Powell, Amy; Rajamanickam, Sivasankaran; Simberg, Mikael; Sunderland, Dan; Turcksin, Bruno; Wilke, Jeremiah
errShare
errSave
Abstractions for C++ code optimizations in parallel high-performance applications
err2024-09-01
err0
PREAI
errKlepl,Jiří; Šmelko,Adam; Rozsypal,Lukáš; Kruliš,Martin
errShare
errSave
Astute Approach to Handling Memory Layouts of Regular Data Structures
err2023-01-01
err0
PREAI
errŠmelko,Adam; Kruliš,Martin; Kratochvíl,Miroslav; Klepl,Jiří; Mayer,Jiří; Šimůnek,Petr
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
no more