arrow
返回

Accelerating sparse matrix-matrix multiplication with GPU Tensor Cores

delete2020-12-01
delete42
delete
OA
AI
O
Orestis Zachariadis *
S
Satpute, Nitin
J
Juan Gómez-Luna
J
Joaquín Olivares
DOI:10.1016/j.compeleceng.2020.106848delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Sparse general matrix-matrix multiplication (spGEMM) is an essential component in many scientific and data analytics applications. However, the sparsity pattern of the input matrices and the interaction of their patterns make spGEMM challenging. Modern GPUs include Tensor Core Units (TCUs), which specialize in dense matrix multiplication. Our aim is to re-purpose TCUs for sparse matrices. The key idea of our spGEMM algorithm, tSparse, is to multiply sparse rectangular blocks using the mixed precision mode of TCUs. tSparse partitions the input matrices into files and operates only on files which contain one or more elements. It creates a task list of the files, and performs matrix multiplication of these files using TCUs. To the best of our knowledge, this is the first time that TCUs are used in the context of spGEMM. We show that spGEMM, with our filing approach, benefits from TCUs. Our approach significantly improves the performance of spGEMM in comparison to cuSPARSE, CUSP, RMerge2, Nsparse, AC-SpGEMM and spECK.
Keyword:
Sparse matrix multiplication
GPU
Tensor Cores
Parallel computing
SpGEMM
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

C
Computers and Electrical Engineering
IF:
4.9
论文数:
6.7K
被引数:
1.3W

机构

S
swiss federal institutes of technology domain
学者数:
9.0W
论文数: 8.0W
被引数: 163
U
universidad de cordoba
学者数:
1.0W
论文数: 8.4K
被引数: 6
引用论文

引用论文

Magnetic properties of Tb2PdSi3
err2004-07-01
err0
PREAI
errM Frontzek; A Kreyssig; M Doerr; J.-U Hoffman; D Hohlwein; H Bitterlich; G Behr; M Loewenhaupt
err分享
err收藏
Does acute caffeine ingestion alter brain metabolism in young adults?
err2015-04-01
err0
errOAAI
errFeng Xu; Peiying Liu; James J. Pekar; Hanzhang Lu
err分享
err收藏
Decreases in Amino Acid and Acetylcholine Metabolism During Hypoxia
err2006-10-05
err0
PREAI
errGary E. Gibson; Christine Peterson; Joseph Sansone
err分享
err收藏
Gut Microbiome and Sex Bias in Autism Spectrum Disorders
err2020-01-13
err0
PREAI
errAfaf El-Ansary; Ramesa Shafi Bhat; Naima Zayed
err分享
err收藏
The measurement of acetylcholine turnover rate in brain structures
err1976-12-01
err0
PREAI
errG. Racagni; D.L. Cheney; G. Zsilla; E. Costa
err分享
err收藏
GPU-ACCELERATED SPARSE MATRIX-MATRIX MULTIPLICATION BY ITERATIVE ROW MERGING
err2015-01-01
err71
PREAI
errGremse, Felix; Hoefter, Andreas; Schwen, Lars Ole; Kiessling, Fabian; Naumann, Uwe
err分享
err收藏
学者 查看更多内容