arrow
返回

Supervised Learning Based on Temporal Coding in Spiking Neural Networks

delete2017-01-01
delete178
delete
OA
AI
H
Hesham Mostafa *
DOI:10.1109/TNNLS.2017.2726060delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Gradient descent training techniques are remarkably successful in training analog-valued artificial neural networks (ANNs). Such training techniques, however, do not transfer easily to spiking networks due to the spike generation hard nonlinearity and the discrete nature of spike communication. We show that in a feedforward spiking network that uses a temporal coding scheme where information is encoded in spike times instead of spike rates, the network input-output relation is differentiable almost everywhere. Moreover, this relation is piecewise linear after a transformation of variables. Methods for training ANNs thus carry directly to the training of such spiking networks as we show when training on the permutation invariant MNIST task. In contrast to rate-based spiking networks that are often used to approximate the behavior of ANNs, the networks we present spike much more sparsely and their behavior cannot be directly approximated by conventional ANNs. Our results highlight a new approach for controlling the behavior of spiking networks with realistic temporal dynamics, opening up the potential for using these networks to process spike patterns with complex temporal information.
Keyword:
Backpropagation
spiking networks
supervised learning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.6K
被引数:
7.2W

机构

University of California System 封面图
University of California System
学者数:
37.7W
论文数: 33.8W
被引数: 6.6K
引用论文

引用论文

Antimicrobial implications of vitamin D
err2014-10-27
err0
errOAAI
errDima A. Youssef; Christopher W.T. Miller; Adel M. El-Abbassi; Della C. Cutchins; Coleman Cutchins; William B. Grant; Alan N. Peiris
err分享
err收藏
Ventricular Arrhythmias in Normal Hearts
err2008-08-01
err0
PREAI
errShuaib Latif; Sanjay Dixit; David J. Callans
err分享
err收藏
Real-time classification and sensor fusion with a spiking deep belief network
err2013-01-01
err335
errOAAI
errO'Connor, Peter; Neil, Daniel; Liu, Shih-Chii; Delbruck, Tobi; Pfeiffer, Michael
err分享
err收藏
A novel radioiodinated high affinity ligand for the D2‐dopamine receptor
err2001-11-12
err0
errOAAI
errNourdine Amlaiky; Brian F. Kilpatrick; Marc G. Caron
err分享
err收藏
Spen is required for pigment cell survival during pupal development in Drosophila
err2015-06-01
err0
errOAAI
errMatthieu Querenet; Valerie Goubard; Gilles Chatelain; Nathalie Davoust; Bertrand Mollereau
err分享
err收藏
Regional colon transit in patients with dys-synergic defaecation or slow transit in patients with constipation
errGut
IF0
err2011-12-16
err0
errOAAI
errSara Nullens; Tyler Nelsen; Michael Camilleri; Duane Burton; Deborah Eckert; Johanna Iturrino; Maria Vazquez-Roque; Alan R Zinsmeister
err分享
err收藏
学者 查看更多内容