返回
Robust learning in SpikeProp
DOI:10.1016/j.neunet.2016.10.011.png)
摘要
En 中文
Training a Spiking Neural Network using SpikeProp and its derivatives faces stability issues. Surges, marked by a sudden rise in learning cost, are a common occurrence during the learning process. They disrupt the learning process and often destabilize the process resulting in failure. A proper learning rate, which is neither too small nor too big, is important to minimize surges. Furthermore, external disturbances due to imperfection in sample data as well as internal disturbances are additional destabilizing source during the learning process. In this paper, we perform error system analysis incorporating external disturbance, followed by weight convergence analysis along with detailed robust stability analysis of SpikeProp learning process to ensure error bound of the learning process. Based on these results, we propose a robust adaptive learning rate scheme that aligns with the results of theoretical analysis. The performance of the proposed method has been compared with other prevalent methods based on different benchmark datasets and the results demonstrate that our method indeed has better performance in terms of convergence and learning speed as well. (C) 2016 Elsevier Ltd. All rights reserved.
Keyword:
Spiking Neural Network
Error analysis
Weight convergence
Robust stability
Supervised learning
Adaptive learning rate
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
6.3
论文数:
8.2K
被引数:
3.0W
机构
引用论文
Networks of spiking neurons: The third generation of neural network models尖峰神经元网络: 第三代神经网络模型
NEURAL NETWORKS
IF6.3
NeuCube: A spiking neural network architecture for mapping, learning and understanding of spatio-temporal brain data
NEURAL NETWORKS
IF6.3

