arrow
返回

TaiChi: A Hybrid Compression Format for Binary Sparse Matrix-Vector Multiplication on GPU

delete2022-12-01
delete5
PRE
AI
J
Jianhua Gao
W
Weixing Ji *
王
王一拙 (Yizhuo Wang)
F
Feng Shi
DOI:10.1109/TPDS.2022.3170501delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Binary Sparse Matrix-Vector Multiplication (SpMV) is a heavy computational kernel in weblink analysis, integer factorization, compressed sensing, spectral graph theory, and other domains. Testing several popular GPU-based SpMV implementations on 400 sparse matrices, we observed that data transfer to GPU memory accounts for a large part of the total computation time. The transfer of constant value 1s can be easily eliminated for binary sparse matrices. However, compressing index arrays has always been a great challenge. This article proposes a new compression format TaiChi to further reduce index data copies and improve the performance of SpMV, especially for diagonally dominant binary sparse matrices. Input matrices are first partitioned into relatively dense and ultra-sparse areas. Then the dense areas are encoded inversely by marking 0s, while the ultra-sparse area is encoded by marking 1s. We also designed a new SpMV algorithm only using addition and subtraction for binary matrices based on our partition and encoding format. Evaluation results on real-world binary sparse matrices show that our hybrid encoding for binary matrix significantly reduces the data transfer and speeds up the kernel execution. It achieves the highest transfer and kernel execution speedups of 5.63x and 3.84x on GTX 1080 Ti, 3.39x and 3.91x on Tesla V100.
Keyword:
Sparse matrices
Kernel
Graphics processing units
Indexes
Arrays
Encoding
Partitioning algorithms
Binary sparse matrix
SpMV
GPU
parallel computing
mathematical morphology

期刊

IEEE Transactions on Parallel and Distributed Systems 封面图
IEEE Transactions on Parallel and Distributed Systems
IF:
6
论文数:
5.2K
被引数:
1.1W

机构

B
beijing institute of technology
学者数:
5.5W
论文数: 4.0W
被引数: 63
引用论文

引用论文

Efficacy of Severe Acute Respiratory Syndrome Vaccine Based on a Nonhuman Primate Adenovirus in the Presence of Immunity Against Human Adenovirus
err2006-05-01
err0
PREAI
errYan Zhi; Joanita Figueredo; Gary P. Kobinger; Heather Hagan; Roberto Calcedo; James R. Miller; Guangping Gao; James M. Wilson
err分享
err收藏
err分享
err收藏
Advances in Materials Processing X
err2012-04-12
err0
PREAI
errChuan Zhen Huang; Hong Tao Zhu; Jun Wang; Xiao Ping Li
err分享
err收藏
Multi-contrast submillimetric 3 Tesla hippocampal subfield segmentation protocol and dataset
err2015-11-10
err0
errOAAI
errJessie Kulaga-Yoskovitz; Boris C. Bernhardt; Seok-Jun Hong; Tommaso Mansi; Kevin E. Liang; Andre J.W. van der Kouwe; Jonathan Smallwood; Andrea Bernasconi; Neda Bernasconi
err分享
err收藏
Binary neural networks: A survey
err2020-09-01
err303
errOAAI
errQin, Haotong; Gong, Ruihao; Liu, Xianglong; Bai, Xiao; Song, Jingkuan; Sebe, Nicu
err分享
err收藏
学者 查看更多内容