arrow
Return

Scalable Block-Sparse Matrix Multiplication Using Template Task Graphs

delete2026-01-01
delete0
PRE
AI
J
Joseph Schuchart *
A
Aurélien Bouteiller
T
Thomas Hérault
V
Valeev, Edvard
G
George Bosilca
R
Robert J. Harrison
DOI:10.1007/978-3-031-97196-9_10delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Block-sparse matrix operations are a special case of general sparse algebra where the matrix is sparsely populated with dense blocks, e.g., in sparse tensor algebra for quantum chemistry. One of the challenges of implementing distributed matrix multiplication C = A x B in general is the management of communication flows since both input matrices A and B are readily available and must be distributed to the processes computing the relevant blocks of C. In this paper, we propose an addition to the Template Task Graph programming model that allows applications to constrain the execution of tasks using a flexible API. We show that such constraints can be used in a pure dataflow model to replace artificial control flow with a more structured approach. In the context of sparse matrix multiplication, we found that constraints allow us to limit the number of concurrent communications and thus avoid creating a bottleneck in the network.
Keywords:
Template Task Graph
Sparse Matrix Multiplication
Scheduling Constraints

Journal

A
ASYNCHRONOUS MANY-TASK SYSTEMS AND APPLICATIONS, WAMTA 2025
IF:
0
Papers:
13
Citations:
0

Organization

S
stony brook university
Scholars:
1.4W
Papers: 1.0W
Citations: 20
S
state university of new york (suny) system
Scholars:
6.5W
Papers: 5.8W
Citations: 65
University of Tennessee System cover
University of Tennessee System
Scholars:
2.9W
Papers: 2.7W
Citations: 115
researcher View more organizations
Cited Papers

Cited Papers

Distributed-memory multi-GPU block-sparse tensor contraction for electronic structure
err2021-05-01
err0
errOAAI
errThomas Herault; Yves Robert; George Bosilca; Robert J. Harrison; Cannada A. Lewis; Edward F. Valeev; Jack J. Dongarra
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
StarPU: a unified platform for task scheduling on heterogeneous multicore architectures
err2010-11-04
err0
errOAAI
errCédric Augonnet; Samuel Thibault; Raymond Namyst; Pierre‐André Wacrenier
errShare
errSave
errShare
errSave
HPX
err2014-10-06
err0
PREAI
errHartmut Kaiser; Thomas Heller; Bryce Adelstein-Lelbach; Adrian Serio; Dietmar Fey
errShare
errSave
errShare
errSave
researcher View more