arrow
返回

Efficient Spiking Neural Networks With Radix Encoding

delete2024-03-01
delete4
delete
OA
AI
Z
Zhehui Wang
X
Xiaozhe Gu
R
Rick Siow Mong Goh
J
Joey Tianyi Zhou
T
Tao Luo *
DOI:10.1109/TNNLS.2022.3195918delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Spiking neural networks (SNNs) have advantages in latency and energy efficiency over traditional artificial neural networks (ANNs) due to their event-driven computation mechanism and the replacement of energy-consuming weight multiplication with addition. However, to achieve high accuracy, it usually requires long spike trains to ensure accuracy, usually more than 1000 time steps. This offsets the computation efficiency brought by SNNs because a longer spike train means a larger number of operations and larger latency. In this article, we propose a radix-encoded SNN, which has ultrashort spike trains. Specifically, it is able to use less than six time steps to achieve even higher accuracy than its traditional counterpart. We also develop a method to fit our radix encoding technique into the ANN-to-SNN conversion approach so that we can train radix-encoded SNNs more efficiently on mature platforms and hardware. Experiments show that our radix encoding can achieve 25x improvement in latency and 1.7% improvement in accuracy compared to the state-of-the-art method using the VGG-16 network on the CIFAR-10 dataset.
Keyword:
Encoding
energy efficient
short spike train
speedup
spiking neural network (SNN)

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.6K
被引数:
7.2W

机构

A
a*star - institute of high performance computing (ihpc)
学者数:
1.5K
论文数: 1.3K
被引数: 3
A
agency for science technology & research (a*star)
学者数:
2.2W
论文数: 1.9W
被引数: 57
引用论文

引用论文

Deep neural networks with weighted spikes
err2018-10-01
err103
PREAI
errKim, Jaehyun; Kim, Heesu; Huh, Subin; Lee, Jinho; Choi, Kiyoung
err分享
err收藏
RANDOMIZED TRIAL OF D-CYCLOSERINE ENHANCEMENT OF COGNITIVE-BEHAVIORAL THERAPY FOR PANIC DISORDER
err2016-06-17
err0
errOAAI
errMichael W Otto; Mark H Pollack; Sheila M Dowd; Stefan G Hofmann; Godfrey Pearlson; Kristin L Szuhany; Ralitza Gueorguieva; John H Krystal; Naomi M. Simon; David F Tolin
err分享
err收藏
err分享
err收藏
err分享
err收藏
Conversion of Continuous-Valued Deep Networks to Efficient Event-Driven Networks for Image Classification
err2017-12-07
err771
errOAAI
errRueckauer, Bodo; Lungu, Iulia-Alexandra; Hu, Yuhuang; Pfeiffer, Michael; Liu, Shih-Chii
err分享
err收藏
A Patient-Specific Methodology for Prediction of Paroxysmal Atrial Fibrillation Onset
err2017-09-14
err0
errOAAI
errElisabetta De Giovanni; Amir Aminifar; Adrian Luca; Sasan Yazdani; Jean-Marc Vesin; David Atienza
err分享
err收藏
Regional colon transit in patients with dys-synergic defaecation or slow transit in patients with constipation
errGut
IF0
err2011-12-16
err0
errOAAI
errSara Nullens; Tyler Nelsen; Michael Camilleri; Duane Burton; Deborah Eckert; Johanna Iturrino; Maria Vazquez-Roque; Alan R Zinsmeister
err分享
err收藏
学者 查看更多内容