arrow
返回

Robust learning in SpikeProp

delete2017-02-01
delete14
PRE
AI
S
Shrestha, Sumit Barn
Q
Qing Song *
DOI:10.1016/j.neunet.2016.10.011delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Training a Spiking Neural Network using SpikeProp and its derivatives faces stability issues. Surges, marked by a sudden rise in learning cost, are a common occurrence during the learning process. They disrupt the learning process and often destabilize the process resulting in failure. A proper learning rate, which is neither too small nor too big, is important to minimize surges. Furthermore, external disturbances due to imperfection in sample data as well as internal disturbances are additional destabilizing source during the learning process. In this paper, we perform error system analysis incorporating external disturbance, followed by weight convergence analysis along with detailed robust stability analysis of SpikeProp learning process to ensure error bound of the learning process. Based on these results, we propose a robust adaptive learning rate scheme that aligns with the results of theoretical analysis. The performance of the proposed method has been compared with other prevalent methods based on different benchmark datasets and the results demonstrate that our method indeed has better performance in terms of convergence and learning speed as well. (C) 2016 Elsevier Ltd. All rights reserved.
Keyword:
Spiking Neural Network
Error analysis
Weight convergence
Robust stability
Supervised learning
Adaptive learning rate
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Neural Networks 封面图
Neural Networks
IF:
6.3
论文数:
8.2K
被引数:
3.0W

机构

N
Nanyang Technological University
学者数:
4.9W
论文数: 4.8W
被引数: 8.1W
引用论文

引用论文

Daily physical activity and macronutrient distribution of low-calorie diets jointly affect body fat reduction in obese women
err2009-08-01
err0
errOAAI
errConstanza Matilde López-Fontana; Almudena Sánchez-Villegas; Miguel Angel Martínez-Gonzalez; José Alfredo Martinez
err分享
err收藏
‘Green’ Wine through a Responsible and Efficient Production: A Case Study of a Sustainable Sicilian Wine Producer
err2016-01-01
err0
errOAAI
errValeria Borsellino; Giuseppina Migliore; Marcello D’Acquisto; Caterina Patrizia Di Franco; Antonio Asciuto; Emanuele Schimmenti
err分享
err收藏
Breed and maternal effects on the intake of tannin-rich browse by juvenile domestic goats (Capra hircus)
err2009-06-01
err0
PREAI
errTzach Aharon Glasser; Eugene David Ungar; Serge Yan Landau; Avi Perevolotsky; Hussein Muklada; John Withers Walker
err分享
err收藏
Delay learning and polychronization for reservoir computing
err2008-03-01
err118
errOAAI
errPaugam-Moisy, Helene; Martinez, Regis; Bengio, Samy
err分享
err收藏
err分享
err收藏
A Patient-Specific Methodology for Prediction of Paroxysmal Atrial Fibrillation Onset
err2017-09-14
err0
errOAAI
errElisabetta De Giovanni; Amir Aminifar; Adrian Luca; Sasan Yazdani; Jean-Marc Vesin; David Atienza
err分享
err收藏
学者 查看更多内容