Simple framework for constructing functional spiking recurrent neural networks

doi:10.1073/pnas.1905926116

Simple framework for constructing functional spiking recurrent neural networks

2019-10-21

50

OA

AI

Terrence J. Sejnowski *

DOI：10.1073/pnas.1905926116

Original

Save

View PDF

Abstract

En 中文

Cortical microcircuits exhibit complex recurrent architectures that possess dynamically rich properties. The neurons that make up these microcircuits communicate mainly via discrete spikes, and it is not clear how spikes give rise to dynamics that can be used to perform computationally challenging tasks. In contrast, continuous models of rate-coding neurons can be trained to perform complex tasks. Here, we present a simple framework to construct biologically realistic spiking recurrent neural networks (RNNs) capable of learning a wide range of tasks. Our framework involves training a continuous-variable rate RNN with important biophysical constraints and transferring the learned dynamics and constraints to a spiking RNN in a one-to-one manner. The proposed framework introduces only 1 additional parameter to establish the equivalence between rate and spiking RNN models. We also study other model parameters related to the rate and spiking networks to optimize the one-to-one mapping. By establishing a close relationship between rate and spiking models, we demonstrate that spiking RNNs could be constructed to achieve similar performance as their counterpart continuous rate networks.

Keywords:

spiking neural networks

recurrent neural networks

rate neural networks

Simple framework for constructing functional spiking recurrent neural networks

Abstract

AI Summary

Journal

Organization