arrow
Return

Efficient Discrete Temporal Coding Spike-Driven In-Memory Computing Macro for Deep Neural Network Based on Nonvolatile Memory

delete2022-11-01
delete8
PRE
AI
L
Lixia Han
P
Peng Huang *
Y
Yijiao Wang *
Z
Zheng Zhou
Y
Yizhou Zhang
X
Xiaoyan Liu
J
Jinfeng Kang
DOI:10.1109/TCSI.2022.3194918delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Nonvolatile memory (NVM) based neural network can directly perform in situ computation in memory to significantly reduce energy consumption resulting from the data movement. However, the energy consumption by the analog-to-digital converter (ADC) restricts the efficiency of the mixed-signal in-memory computing macro. The rate coding spike-driven in-memory computing macro can increase the energy efficiency via eliminating the ADC, but the improvement is limited because substantial energy is consumed for the coding of multiple spikes. In this work, we propose a discrete temporal coding spike-driven in-memory computing macro, including input coding scheme, weight mapping method, and improved leaky integrate-and-fire (LIF) neuron circuit, to perform the efficient forward inference of deep neural networks based on NVM array. We then optimize the designment of the proposed in-memory computing macro to mitigate the neural network accuracy loss due to the nonlinearity of the LIF neuron and voltage drop caused by interconnect resistance. Because the temporal coding scheme reduces spike numbers and the improved-LIF circuit simultaneously integrates two bit-lines current corresponding to positive and negative weight, the proposed macro achieves 46.63TOPS/W energy efficiency and 1.92TOPS throughput for 3bit temporal coding precision.
Keywords:
Encoding
In-memory computing
Capacitors
Biological neural networks
Neurons
Delays
Nonvolatile memory
In-memory computing
deep neural network
non-volatile memory
discrete temporal coding
spike-driven macro

Journal

IEEE Transactions on Circuits and Systems I-Regular Papers cover
IEEE Transactions on Circuits and Systems I-Regular Papers
IF:
5.2
Papers:
9.8K
Citations:
2.2W

Organization

B
Beihang University
Scholars:
5.2W
Papers: 4.1W
Citations: 37
P
peking university
Scholars:
11.9W
Papers: 8.7W
Citations: 146
Cited Papers

Cited Papers

Isolation and characterization of a wheat – Psathyrostachys huashanica ‘Keng’ 3Ns disomic addition line with resistance to stripe rust
err2014-01-01
err0
PREAI
errWanli Du; Jing Wang; Yuhui Pang; Liangming Wang; Jun Wu; Jixin Zhao; Qunhui Yang; Xinhong Chen
errShare
errSave
A Robust Digital RRAM-Based Convolutional Block for Low-Power Image Processing and Learning Applications
err2019-02-01
err43
PREAI
errGiacomin, Edouard; Greenberg-Toledo, Tzofnat; Kvatinsky, Shahan; Gaillardono, Pierre-Emmanuel
errShare
errSave
Recent progress of integrated circuits and optoelectronic chips
err2021-05-27
err95
PREAI
errHao, Yue; Xiang, Shuiying; Han, Genquan; Zhang, Jincheng; Ma, Xiaohua; Zhu, Zhangming; Guo, Xingxing; Zhang, Yahui; Han, Yanan; Song, Ziwei; Liu, Yan; Yang, Ling; Zhou, Hong; Shi, Jiangyi; Zhang, Wei; Xu, Min; Zhao, Weisheng; Pan, Biao; Huang, Yangqi; Liu, Qi; Cai, Yimao; Zhu, Jian; Ou, Xin; You, Tiangui; Wu, Huaqiang; Gao, Bin; Zhang, Zhiyong; Guo, Guoping; Chen, Yonghua; Liu, Yong; Chen, Xiangfei; Xue, Chunlai; Wang, Xingjun; Zhao, Lixia; Zou, Xihua; Yan, Lianshan; Li, Ming
errShare
errSave
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
researcher View more