arrow
返回

Sparsity-Oriented MRAM-Centric Computing for Efficient Neural Network Inference

delete2024-01-01
delete0
PRE
AI
J
Jia-le Cui
Y
Yanan Guo
J
Juntong Chen
B
Bo Liu
H
Hao Cai *
DOI:10.1109/TETC.2023.3326312delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Near-memory computing (NMC) and in- memory computing (IMC) paradigms show great importance in non-von Neumann architecture. Spin-transfer torque magnetic random access memory (STT-MRAM) is considered as a promising candidate to realize both NMC and IMC for resource-constrained applications. In this work, two MRAM-centric computing frameworks are proposed: triple-skipping NMC (TS-NMC) and analog-multi-bit-sparsity IMC (AMS-IMC). The TS-NMC exploits the sparsity of activations and weights to implement a write-read-calculation triple skipping computing scheme by utilizing a sparse flag generator. The AMS-IMC with reconfigured computing bit-cell and flag generator accommodate bit-level activation sparsity in the computing. STT-MRAM array and its peripheral circuits are implemented with an industrial 28-nm CMOS design-kit and an MTJ compact model. The triple-skipping scheme can reduce memory access energy consumption by 51.5x when processing zero vectors, compared to processing non-zero vectors. The energy efficiency of AMS-IMC is improved by 5.9x and 1.5x (with 75% input sparsity) as compared to the conventional NMC framework and existing analog IMC framework. Verification results show that TS-NMC and AMS-IMC achieved 98.6% and 97.5% inference accuracy in MNIST classification, with energy consumption of 14.2 nJ/pattern and 12.7 nJ/pattern, respectively.
Keyword:
In-memory computing
near-memory computing
neural network
STT-MRAM
sparsity vector and matrix

期刊

IEEE Transactions on Emerging Topics in Computing 封面图
IEEE Transactions on Emerging Topics in Computing
IF:
5.4
论文数:
1.1K
被引数:
3.4K

机构

S
southeast university - china
学者数:
5.3W
论文数: 4.9W
被引数: 57
引用论文

引用论文

Targeting DNN Inference Via Efficient Utilization of Heterogeneous Precision DNN Accelerators通过高效利用异构精度DNN加速器来定位DNN推理
err2023-01-01
err11
errOAAI
errSpantidi, Ourania; Zervakis, Georgios; Alsalamin, Sami; Roman-Ballesteros, Isai; Henkel, Joerg; Amrouch, Hussam; Anagnostopoulos, Iraklis
err分享
err收藏
Citrate-capped iron oxide nanoparticles: ultrasound-assisted synthesis, structure and thermal properties
err2019-01-30
err0
PREAI
errMariane Brandão da Silva Assis; Izabella Helena Soares Rezende Werneck; Gabriela Nestal de Moraes; Felipe Silva Semaan; Robson Pacheco Pereira
err分享
err收藏
Dinucleus: A Doorway to Heavy-Ion Fusion
err1985-06-24
err0
errOAAI
errM. S. Hussein; B. V. Carlson; O. Civitarese; A. Szanto De Toledo
err分享
err收藏
Normal and Abnormal Middle Ear Ventilation
err1977-07-01
err0
PREAI
errErdem I. Cantekin; Charles D. Bluestone; William J. Doyle; Carlos A. Saez; David C. Phillips
err分享
err收藏
Molecular characteristics and inheritance of a chromosome segment from Psathyrostachys huashanica Keng in a wheat background
err2020-03-09
err0
PREAI
errJiachuang Li; Yang Liu; Xueni Cheng; Xiaoni Yao; Zujun Yang; Jun Wu; Qunhui Yang; Jixin Zhao; Xinhong Chen
err分享
err收藏
SRIF: Scalable and Reliable Integrate and Fire Circuit ADC for Memristor-Based CIM Architectures
err2021-05-01
err12
PREAI
errSingh, Abhairaj; Abu Lebdeh, Muath; Gebregiorgis, Anteneh; Bishnoi, Rajendra; Joshi, Rajiv, V; Hamdioui, Said
err分享
err收藏
学者 查看更多内容