Deterministic networks for probabilistic computing

Jakob Jordan

doi:10.1038/s41598-019-54137-7

Return

Deterministic networks for probabilistic computing

2019-12-04

DOI：10.1038/s41598-019-54137-7

Original

Save

View PDF

Abstract

En 中文

Neuronal network models of high-level brain functions such as memory recall and reasoning often rely on the presence of some form of noise. The majority of these models assumes that each neuron in the functional network is equipped with its own private source of randomness, often in the form of uncorrelated external noise. In vivo, synaptic background input has been suggested to serve as the main source of noise in biological neuronal networks. However, the finiteness of the number of such noise sources constitutes a challenge to this idea. Here, we show that shared-noise correlations resulting from a finite number of independent noise sources can substantially impair the performance of stochastic network models. We demonstrate that this problem is naturally overcome by replacing the ensemble of independent noise sources by a deterministic recurrent neuronal network. By virtue of inhibitory feedback, such networks can generate small residual spatial correlations in their activity which, counter to intuition, suppress the detrimental effect of shared input. We exploit this mechanism to show that a single recurrent network of a few hundred neurons can serve as a natural noise source for a large ensemble of functional networks performing probabilistic computations, each comprising thousands of units.

Keywords:

FIRE NEURON MODEL

SYNAPTIC-TRANSMISSION

IN-VITRO

VARIABILITY

NOISE

COMPUTATION

CONNECTIVITY

RELIABILITY

DISCHARGE

DYNAMICS

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.