.png){kind=icon}
返回
A ReRAM-Based Convolutional Neural Network Accelerator Using the Analog Layer Normalization Technique
.png){kind=icon}
PRE
AI
DOI：10.1109/TIE.2022.3190876.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
This article presents a resistive random access memory (ReRAM)-based convolutional neural network (CNN) accelerator with a new analog layer normalization (ALN) technique. The proposed ALN can be used to effectively reduce the effect of the conductance variation in ReRAM devices by normalizing the outputs of the vector-matrix multiplication (VMM) in the charge domain. The ALN achieves high energy and hardware efficiencies because it directly processes the normalization of the VMM outputs without storing their values in memory and is merged into the neuron circuit of the accelerator. To verify the effect of the ALN through experiments, a VMM accelerator that consists of two 25 x 25 sized ReRAM arrays and peripheral circuits with ALN is used for a convolution layer with digital signal processing in a field programmable gate array. The MNIST dataset is used to train and inference a CNN employing two VMM accelerators that work as convolution layers in a pipelined manner. Despite the conductance variation of the ReRAM devices, the ALN successfully stabilizes the output distribution of the convolution layer, which improves the classification accuracy of the network. A final classification accuracy for the MNIST and Fashion-MNIST datasets of 96.2% and 83.1% is achieved, respectively, with an energy efficiency of 9.94 tera-operations per second per Watt.
Keyword:
Virtual machine monitors
Hardware
Voltage
Convolutional neural networks
Training
Neurons
Convolution
Convolutional neural network (CNN)
hardware accelerator
layer normalization (LN)
neuromorphic hardware
nonvolatile memory
resistive random access memory (ReRAM)
期刊
IF:
7.2
论文数:
1.8W
被引数:
9.8W
机构
引用论文
Efficient and self-adaptive in-situ learning in multilayer memristor neural networks多层忆阻器神经网络的高效自适应原位学习.png)
NATURE COMMUNICATIONS
OAAI
NATURE COMMUNICATIONSIF15.7
OAAI分享收藏分享收藏TERNARY COMPLEXES OF TRANSITION METALIONS WITH ADENOSINE-5 ' -TRIPHOSPHATE AND 1,10-PHENANTHROLINE
PREAI
分享收藏
查看更多内容