arrow
返回

Simple framework for constructing functional spiking recurrent neural networks

delete2019-10-21
delete50
delete
OA
AI
R
Robert Kim *
Y
Yinghao Li
T
Terrence J. Sejnowski *
DOI:10.1073/pnas.1905926116delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Cortical microcircuits exhibit complex recurrent architectures that possess dynamically rich properties. The neurons that make up these microcircuits communicate mainly via discrete spikes, and it is not clear how spikes give rise to dynamics that can be used to perform computationally challenging tasks. In contrast, continuous models of rate-coding neurons can be trained to perform complex tasks. Here, we present a simple framework to construct biologically realistic spiking recurrent neural networks (RNNs) capable of learning a wide range of tasks. Our framework involves training a continuous-variable rate RNN with important biophysical constraints and transferring the learned dynamics and constraints to a spiking RNN in a one-to-one manner. The proposed framework introduces only 1 additional parameter to establish the equivalence between rate and spiking RNN models. We also study other model parameters related to the rate and spiking networks to optimize the one-to-one mapping. By establishing a close relationship between rate and spiking models, we demonstrate that spiking RNNs could be constructed to achieve similar performance as their counterpart continuous rate networks.
Keyword:
spiking neural networks
recurrent neural networks
rate neural networks
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

P
Proceedings of the National Academy of Sciences of the United States of America
IF:
9.1
论文数:
10.8W
被引数:
73.5W

机构

S
salk institute
学者数:
3.1K
论文数: 2.2K
被引数: 8
引用论文

引用论文

Plasmapheresis in a patient with severe asthma associated with auto‐antibodies to platelets
err2006-04-27
err0
PREAI
errPH. LASSALLE; M. JOSEPH; PH. RAMON; M. DRACON; A.‐B. TONNEL; A. CAPRON
err分享
err收藏
Low-rank tensor decomposition based anomaly detection for hyperspectral imagery
err2015-09-01
err0
PREAI
errShuangjiang Li; Wei Wang; Hairong Qi; Bulent Ayhan; Chiman Kwan; Steven Vance
err分享
err收藏
Learning recurrent dynamics in spiking networks
err2018-09-20
err34
errOAAI
errKim, Christopher M.; Chow, Carson C.
err分享
err收藏
Reconciling persistent and dynamic hypotheses of working memory coding in prefrontal cortex
err2018-08-29
err91
errOAAI
errCavanagh, Sean E.; Towers, John P.; Wallis, Joni D.; Hunt, Laurence T.; Kennerley, Steven W.
err分享
err收藏
Recurrent Network Models of Sequence Generation and Memory
errNEURON
IF15
err2016-04-01
err252
errOAAI
errRajan, Kanaka; Harvey, Christopher D.; Tank, David W.
err分享
err收藏
err分享
err收藏
From fixed points to chaos: Three models of delayed discrimination
err2013-04-01
err126
errOAAI
errBarak, Omri; Sussillo, David; Romo, Ranulfo; Tsodyks, Misha; Abbott, L. F.
err分享
err收藏
学者 查看更多内容