1
Return

Recursive Binary Neural Network Training Model for Efficient Usage of On-Chip Memory

delete2019-07-01
delete4
PRE
AI
T
Tianchan Guan *
P
Peiye Liu
X
Xiaoyang Zeng
M
Martha Kim
M
Mingoo Seok
DOI:10.1109/TCSI.2019.2895216delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We present a novel deep learning model for a neural network that reduces both computation and data storage overhead. To do so, the proposed model proposes and combines a binary-weight neural network (BNN) training, a storage reuse technique, and an incremental training scheme. The storage requirements can be tuned to meet the desired classification accuracy, storing more parameters on an on-chip memory, and thereby reducing off-chip data storage accesses. Our experiments show 4-6x reduction in weight storage footprint when training binary deep neural network models. On the FPGA platform, this results in a reduced amount of off-chip accesses, enabling our model to train a neural network in 14x shorter latency, as compared to the conventional BNN training method.
Keywords:
Deep neural network
binary neural network
deep learning
training acceleration
data storage
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Circuits and Systems I-Regular Papers cover
IEEE Transactions on Circuits and Systems I-Regular Papers
IF:
5.2
Papers:
9.7K
Citations:
2.2W

Organization

C
Columbia University
Scholars:
7.1W
Papers: 6.4W
Citations: 263
F
fudan university
Scholars:
11.3W
Papers: 7.6W
Citations: 121
Cited Papers

Cited Papers

Citing Papers

Citing Papers