arrow
Return

Sparsity-Oriented MRAM-Centric Computing for Efficient Neural Network Inference

delete2024-01-01
delete0
PRE
AI
J
Jia-le Cui
Y
Yanan Guo
J
Juntong Chen
B
Bo Liu
H
Hao Cai *
DOI:10.1109/TETC.2023.3326312delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Near-memory computing (NMC) and in- memory computing (IMC) paradigms show great importance in non-von Neumann architecture. Spin-transfer torque magnetic random access memory (STT-MRAM) is considered as a promising candidate to realize both NMC and IMC for resource-constrained applications. In this work, two MRAM-centric computing frameworks are proposed: triple-skipping NMC (TS-NMC) and analog-multi-bit-sparsity IMC (AMS-IMC). The TS-NMC exploits the sparsity of activations and weights to implement a write-read-calculation triple skipping computing scheme by utilizing a sparse flag generator. The AMS-IMC with reconfigured computing bit-cell and flag generator accommodate bit-level activation sparsity in the computing. STT-MRAM array and its peripheral circuits are implemented with an industrial 28-nm CMOS design-kit and an MTJ compact model. The triple-skipping scheme can reduce memory access energy consumption by 51.5x when processing zero vectors, compared to processing non-zero vectors. The energy efficiency of AMS-IMC is improved by 5.9x and 1.5x (with 75% input sparsity) as compared to the conventional NMC framework and existing analog IMC framework. Verification results show that TS-NMC and AMS-IMC achieved 98.6% and 97.5% inference accuracy in MNIST classification, with energy consumption of 14.2 nJ/pattern and 12.7 nJ/pattern, respectively.
Keywords:
In-memory computing
near-memory computing
neural network
STT-MRAM
sparsity vector and matrix

Journal

IEEE Transactions on Emerging Topics in Computing cover
IEEE Transactions on Emerging Topics in Computing
IF:
5.4
Papers:
1.1K
Citations:
3.4K

Organization

S
southeast university - china
Scholars:
5.3W
Papers: 4.9W
Citations: 57
Cited Papers

Cited Papers

Targeting DNN Inference Via Efficient Utilization of Heterogeneous Precision DNN Accelerators
err2023-01-01
err11
errOAAI
errSpantidi, Ourania; Zervakis, Georgios; Alsalamin, Sami; Roman-Ballesteros, Isai; Henkel, Joerg; Amrouch, Hussam; Anagnostopoulos, Iraklis
errShare
errSave
Citrate-capped iron oxide nanoparticles: ultrasound-assisted synthesis, structure and thermal properties
err2019-01-30
err0
PREAI
errMariane Brandão da Silva Assis; Izabella Helena Soares Rezende Werneck; Gabriela Nestal de Moraes; Felipe Silva Semaan; Robson Pacheco Pereira
errShare
errSave
Comparative Evaluation of Spin-Transfer-Torque and Magnetoelectric Random Access Memory
err2016-06-01
err93
PREAI
errWang, Shaodi; Lee, Hochul; Ebrahimi, Farbod; Amiri, P. Khalili; Wang, Kang L.; Gupta, Puneet
errShare
errSave
Dinucleus: A Doorway to Heavy-Ion Fusion
err1985-06-24
err0
errOAAI
errM. S. Hussein; B. V. Carlson; O. Civitarese; A. Szanto De Toledo
errShare
errSave
Normal and Abnormal Middle Ear Ventilation
err1977-07-01
err0
PREAI
errErdem I. Cantekin; Charles D. Bluestone; William J. Doyle; Carlos A. Saez; David C. Phillips
errShare
errSave
Molecular characteristics and inheritance of a chromosome segment from Psathyrostachys huashanica Keng in a wheat background
err2020-03-09
err0
PREAI
errJiachuang Li; Yang Liu; Xueni Cheng; Xiaoni Yao; Zujun Yang; Jun Wu; Qunhui Yang; Jixin Zhao; Xinhong Chen
errShare
errSave
SRIF: Scalable and Reliable Integrate and Fire Circuit ADC for Memristor-Based CIM Architectures
err2021-05-01
err12
PREAI
errSingh, Abhairaj; Abu Lebdeh, Muath; Gebregiorgis, Anteneh; Bishnoi, Rajendra; Joshi, Rajiv, V; Hamdioui, Said
errShare
errSave
researcher View more