arrow
返回

eWB: Event-Based Weight Binarization Algorithm for Spiking Neural Networks

delete2021-01-01
delete5
delete
OA
AI
D
Dohun Kim
G
Guhyun Kim
C
Cheol Seong Hwang
D
Doo Seok Jeong *
DOI:10.1109/ACCESS.2021.3062405delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Learning binary weights to minimize the difference between target and actual outputs can be considered as a parameter optimization task within the given constraints, and thus, it belongs to the application domain of the Lagrange multiplier method (LMM). Based on the LMM, we propose a novel event-based weight binarization (eWB) algorithm for spiking neural networks (SNNs) with binary synaptic weights (-1, 1). The algorithm features (i) event-based asymptotic weight binarization using local data only, (ii) full compatibility with event-based end-to-end learning algorithms (e.g., event-driven random backpropagation (eRBP) algorithm), and (iii) the capability to address various constraints (including the binary weight constraint). As a proof of concept, we combine eWB with eRBP (eWB-eRBP) to obtain a single algorithm for learning binary weights to generate correct classifications. Fully connected SNNs were trained using eWB-eRBP and achieved an accuracy of 95.35% on MNIST. To the best of our knowledge, this is the first report on completely binary SNNs trained using an event-based learning algorithm. Given that eRBP with full-precision (32-bit) weights exhibited 97.20% accuracy, the binarization comes at the cost of an accuracy reduction of approximately 1.85%. The python code is available online: https://github.com/galactico7/eWB.
Keyword:
Neurons
Synapses
Classification algorithms
Approximation algorithms
Linear programming
Training
System-on-chip
Event-based weight binarization
event-driven learning algorithm
Lagrange multiplier method
spiking neural networks

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

H
hanyang university
学者数:
2.9W
论文数: 2.7W
被引数: 36
S
seoul national university (snu)
学者数:
7.2W
论文数: 6.6W
被引数: 86
引用论文

引用论文

Stochastic Synapses Enable Efficient Brain-Inspired Learning Machines
err2016-06-29
err97
errOAAI
errNeftci, Emre O.; Pedroni, Bruno U.; Joshi, Siddharth; Al-Shedivat, Maruan; Cauwenberghs, Gert
err分享
err收藏
Vision
err
IF0
err2010-07-09
err0
PREAI
errDavid Marr
err分享
err收藏
SPSNN: nth Order Sequence-Predicting Spiking Neural Network
err2020-01-01
err5
errOAAI
errKim, Dohun; Kornijcuk, Vladimir; Hwang, Cheol Seong; Jeong, Doo Seok
err分享
err收藏
Robustness of spiking Deep Belief Networks to noise and reduced bit precision of neuro-inspired hardware platforms
err2015-07-09
err76
errOAAI
errStromatias, Evangelos; Neil, Daniel; Pfeiffer, Michael; Galluppi, Francesco; Furber, Steve B.; Liu, Shih-Chii
err分享
err收藏
err分享
err收藏
学者 查看更多内容