返回
Simple framework for constructing functional spiking recurrent neural networks
DOI:10.1073/pnas.1905926116.png)
摘要
En 中文
Cortical microcircuits exhibit complex recurrent architectures that possess dynamically rich properties. The neurons that make up these microcircuits communicate mainly via discrete spikes, and it is not clear how spikes give rise to dynamics that can be used to perform computationally challenging tasks. In contrast, continuous models of rate-coding neurons can be trained to perform complex tasks. Here, we present a simple framework to construct biologically realistic spiking recurrent neural networks (RNNs) capable of learning a wide range of tasks. Our framework involves training a continuous-variable rate RNN with important biophysical constraints and transferring the learned dynamics and constraints to a spiking RNN in a one-to-one manner. The proposed framework introduces only 1 additional parameter to establish the equivalence between rate and spiking RNN models. We also study other model parameters related to the rate and spiking networks to optimize the one-to-one mapping. By establishing a close relationship between rate and spiking models, we demonstrate that spiking RNNs could be constructed to achieve similar performance as their counterpart continuous rate networks.
Keyword:
spiking neural networks
recurrent neural networks
rate neural networks
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
P
IF:
9.1
论文数:
10.8W
被引数:
73.5W
机构
引用论文
Reconciling persistent and dynamic hypotheses of working memory coding in prefrontal cortex
NATURE COMMUNICATIONS
IF15.7
Spiking Deep Convolutional Neural Networks for Energy-Efficient Object RecognitionSpiking深度卷积神经网络用于节能目标识别
Biologically plausible learning in recurrent neural networks reproduces neural dynamics observed during cognitive tasks递归神经网络中的生物学合理学习再现了认知任务期间观察到的神经动力学
ELIFE
IF0

