arrow
Return

Optimizing Sparse Tensor Compilation for Sparse Output

delete2026-01-01
delete0
PRE
AI
S
Shideh Hashemian *
M
Michael F. P. O’Boyle
A
Amir Shaikhha
DOI:10.1145/3771775.3786267delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Sparse tensor algebra plays an important role in many scientific and engineering applications, yet existing sparse libraries and compilers face challenges when the output tensor is sparse. Array-based storage formats, such as CSR, require costly memory reallocations and rely on intermediate tensors (workspaces) to handle sparse scattering into the output, which limits performance and scalability. We introduce a new approach that employs our proposed flexible map-based storage format to directly support sparse scattering into the output without requiring extra workspaces. Our system then applies code and storage-specific optimizations to maximize efficiency. Experimental results across a range of kernels and datasets demonstrate an average speedup of 8.06 Chi over a state-of-the-art compiler and 5.28 Chi over a sparse tensor library.
Keywords:
Sparse
Tensors
Sparse Data Structures
Tensor Algebra

Journal

P
PROCEEDINGS OF THE 35TH ACM SIGPLAN INTERNATIONAL CONFERENCE ON COMPILER CONSTRUCTION, CC 2026
IF:
0
Papers:
18
Citations:
0

Organization

U
University of Edinburgh
Scholars:
5.2W
Papers: 4.6W
Citations: 71
Cited Papers

Cited Papers

TensorIR: An Abstraction for Automatic Tensorized Program Optimization
err2023-01-30
err0
errOAAI
errSiyuan Feng; Bohan Hou; Hongyi Jin; Wuwei Lin; Junru Shao; Ruihang Lai; Zihao Ye; Lianmin Zheng; Cody Hao Yu; Yong Yu; Tianqi Chen
errShare
errSave
OpSparse: A Highly Optimized Framework for Sparse General Matrix Multiplication on GPUs
err2022-01-01
err3
errOAAI
errDu, Zhaoyang; Guan, Yijin; Guan, Tianchan; Niu, Dimin; Huang, Linyong; Zheng, Hongzhong; Xie, Yuan
errShare
errSave
Tensor Algebra Compilation with Workspaces
err2019-02-01
err0
PREAI
errFredrik Kjolstad; Willow Ahrens; Shoaib Kamil; Saman Amarasinghe
errShare
errSave
The tensor algebra compiler
err2017-10-12
err0
errOAAI
errFredrik Kjolstad; Shoaib Kamil; Stephen Chou; David Lugato; Saman Amarasinghe
errShare
errSave
errShare
errSave
UniSparse: An Intermediate Language for General Sparse Format Customization
err2024-04-29
err0
PREAI
errLiu,Jie; Zhao,Zhongyuan; Ding,Zijian; Brock,Benjamin; Rong,Hongbo; Zhang,Zhiru
errShare
errSave
errShare
errSave
SciPy 1.0: fundamental algorithms for scientific computing in Python
err2020-02-03
err2.1W
errOAAI
errVirtanen, Pauli; Gommers, Ralf; Oliphant, Travis E.; Haberland, Matt; Reddy, Tyler; Cournapeau, David; Burovski, Evgeni; Peterson, Pearu; Weckesser, Warren; Bright, Jonathan; van der Walt, Stefan J.; Brett, Matthew; Wilson, Joshua; Millman, K. Jarrod; Mayorov, Nikolay; Nelson, Andrew R. J.; Jones, Eric; Kern, Robert; Larson, Eric; Carey, C. J.; Polat, Ilhan; Feng, Yu; Moore, Eric W.; VanderPlas, Jake; Laxalde, Denis; Perktold, Josef; Cimrman, Robert; Henriksen, Ian; Quintero, E. A.; Harris, Charles R.; Archibald, Anne M.; Ribeiro, Antonio H.; Pedregosa, Fabian; van Mulbregt, Paul
errShare
errSave
researcher View more