arrow
Return

Improving Multispike Learning With Plastic Synaptic Delays

delete2023-12-01
delete10
PRE
AI
Q
Qiang Yu *
J
Jialu Gao
J
Jianguo Wei
J
Jing Li
K
Kay Chen Tan
T
Tiejun Huang
DOI:10.1109/TNNLS.2022.3165527delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Emulating the spike-based processing in the brain, spiking neural networks (SNNs) are developed and act as a promising candidate for the new generation of artificial neural networks that aim to produce efficient cognitions as the brain. Due to the complex dynamics and nonlinearity of SNNs, designing efficient learning algorithms has remained a major difficulty, which attracts great research attention. Most existing ones focus on the adjustment of synaptic weights. However, other components, such as synaptic delays, are found to be adaptive and important in modulating neural behavior. How could plasticity on different components cooperate to improve the learning of SNNs remains as an interesting question. Advancing our previous multispike learning, we propose a new joint weight-delay plasticity rule, named TDP-DL, in this article. Plastic delays are integrated into the learning framework, and as a result, the performance of multispike learning is significantly improved. Simulation results highlight the effectiveness and efficiency of our TDP-DL rule compared to baseline ones. Moreover, we reveal the underlying principle of how synaptic weights and delays cooperate with each other through a synthetic task of interval selectivity and show that plastic delays can enhance the selectivity and flexibility of neurons by shifting information across time. Due to this capability, useful information distributed away in the time domain can be effectively integrated for a better accuracy performance, as highlighted in our generalization tasks of the image, speech, and event-based object recognitions. Our work is thus valuable and significant to improve the performance of spike-based neuromorphic computing.
Keywords:
Delays
Neurons
Plastics
Membrane potentials
Task analysis
Biological neural networks
Computational modeling
Multispike learning
neuromorphic computing
spiking neural networks (SNNs)
synaptic delays

Journal

IEEE Transactions on Neural Networks and Learning Systems cover
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
Papers:
7.6K
Citations:
7.2W

Organization

H
hong kong polytechnic university
Scholars:
3.0W
Papers: 4.1W
Citations: 921
T
tianjin university
Scholars:
8.0W
Papers: 5.8W
Citations: 88
P
peking university
Scholars:
11.9W
Papers: 8.7W
Citations: 146
T
Tianjin Medical University
Scholars:
2.4W
Papers: 1.5W
Citations: 1.3W
researcher View more organizations
Cited Papers

Cited Papers

Optimal Composite Nonlinear Feedback Controller for an Active Front Steering System
err2014-06-01
err0
PREAI
errLiyana Ramli; Yahya M. Sam; Zaharuddin Mohamed; Muhamad Khairi Aripin; Muhamad Fahezal Ismail
errShare
errSave
A spiking network that learns to extract spike signatures from speech signals
err2017-05-01
err47
errOAAI
errTavanaei, Amirhossein; Maida, Anthony S.
errShare
errSave
nMNSD-A Spiking Neuron-Based Classifier That Combines Weight-Adjustment and Delay-Shift
err2021-02-19
err3
errOAAI
errSusi, Gianluca; Anton-Toro, Luis F.; Maestu, Fernando; Pereda, Ernesto; Mirasso, Claudio
errShare
errSave
Delay learning and polychronization for reservoir computing
err2008-03-01
err118
errOAAI
errPaugam-Moisy, Helene; Martinez, Regis; Bengio, Samy
errShare
errSave
errShare
errSave
errShare
errSave
errShare
errSave
researcher View more