arrow
Return

Optimizing Sparse Tensor Compilation for Sparse Output

delete2026-01-01
delete0
PRE
AI
S
Shideh Hashemian *
M
Michael F. P. O’Boyle
A
Amir Shaikhha
DOI:10.1145/3771775.3786267delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Sparse tensor algebra plays an important role in many scientific and engineering applications, yet existing sparse libraries and compilers face challenges when the output tensor is sparse. Array-based storage formats, such as CSR, require costly memory reallocations and rely on intermediate tensors (workspaces) to handle sparse scattering into the output, which limits performance and scalability. We introduce a new approach that employs our proposed flexible map-based storage format to directly support sparse scattering into the output without requiring extra workspaces. Our system then applies code and storage-specific optimizations to maximize efficiency. Experimental results across a range of kernels and datasets demonstrate an average speedup of 8.06 Chi over a state-of-the-art compiler and 5.28 Chi over a sparse tensor library.
Keywords:
Sparse
Tensors
Sparse Data Structures
Tensor Algebra

Journal

P
PROCEEDINGS OF THE 35TH ACM SIGPLAN INTERNATIONAL CONFERENCE ON COMPILER CONSTRUCTION, CC 2026
IF:
0
Papers:
18
Citations:
0

Organization

U
University of Edinburgh
Scholars:
5.1W
Papers: 4.6W
Citations: 71