arrow
返回

GAS: General-Purpose In-Memory-Computing Accelerator for Sparse Matrix Multiplication

delete2024-06-01
delete1
PRE
AI
X
Xiaoyu Zhang
Z
Zerun Li
R
Rui Liu
X
Xiaoming Chen *
Y
Yinhe Han
DOI:10.1109/TC.2024.3371790delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Sparse matrix multiplication is widely used in various practical applications. Different accelerators have been proposed to speed up sparse matrix-dense vector multiplication (SpMV), sparse matrix-sparse vector multiplication (SpMSpV), sparse matrix-dense matrix multiplication (SpMM), and sparse matrix-sparse matrix multiplication (SpMSpM). The performance of traditional sparse matrix multiplication accelerators is typically bounded by memory access due to the poor data locality and irregular memory access. In-memory computing (IMC) is a promising technique to alleviate the memory bottleneck. Previous IMC studies are mostly focused on accelerating a single sparse matrix multiplication function. In this paper, we propose GAS, a general-purpose IMC accelerator for sparse matrix multiplication. GAS integrates non-volatile memory based content-addressable memory (CAM) arrays and multiply-add computation (MAC) arrays to support sparse matrices represented in the double-precision floating-point format. Using a unified outer product based multiplication methodology, GAS supports the acceleration of SpMV, SpMSpv, SpMM, and SpMSpM. We further propose four optimization techniques to speed up the computation of GAS. GAS achieves significant speedups and energy savings over central processing unit (CPU) and graphics processing unit (GPU) implementations. Compared with state-of-the-art traditional and IMC-based accelerators, GAS not only supports more functions, but also achieves higher performance and energy efficiency.
Keyword:
Sparse matrices
FeFETs
Computer architecture
Arrays
Nonvolatile memory
Microprocessors
Vectors
Sparse matrix multiplication
in-memory computing
SpMV
SpMSpV
SpMM
SpMSpM

期刊

IEEE Transactions on Computers 封面图
IEEE Transactions on Computers
IF:
3.8
论文数:
5.4K
被引数:
9.8K

机构

C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

err分享
err收藏
Retreatment with anti‐PD‐1 antibody in non‐small cell lung cancer patients previously treated with anti‐PD‐L1 antibody
err2019-11-07
err0
errOAAI
errKohei Fujita; Yuki Yamamoto; Osamu Kanai; Misato Okamura; Masayuki Hashimoto; Koichi Nakatani; Satoru Sawai; Tadashi Mio
err分享
err收藏
err分享
err收藏
Chiral cobalt(II)-salen-catalyzed Michael addition of amines to β-substituted nitroalkenes
err2014-04-01
err0
PREAI
errTakumi Kobayashi; Tatsuki Shimura; Yuzuru Kurita; Yoshitaka Katsumata; Satoko Kezuka
err分享
err收藏
学者 查看更多内容