.png){kind=icon}
返回
Stochastic Synapses Enable Efficient Brain-Inspired Learning Machines
.png){kind=icon}
OA
AI
DOI：10.3389/fnins.2016.00241.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Recent studies have shown that synaptic unreliability is a robust and sufficient mechanism for inducing the stochasticity observed in cortex. Here, we introduce Synaptic Sampling Machines (S2Ms), a class of neural network models that uses synaptic stochasticity as a means to Monte Carlo sampling and unsupervised learning. Similar to the original formulation of Boltzmann machines, these models can be viewed as a stochastic counterpart of Hopfield networks, but where stochasticity is induced by a random mask over the connections. Synaptic stochasticity plays the dual role of an efficient mechanism for sampling, and a regularizer during learning akin to DropConnect. A local synaptic plasticity rule implementing an event driven form of contrastive divergence enables the learning of generative models in an on-line fashion. S2Ms perform equally well using discrete-timed artificial units (as in Hopfield networks) or continuous-timed leaky integrate and fire neurons. The learned representations are remarkably sparse and robust to reductions in bit precision and synapse pruning: removal of more than 75% of the weakest connections followed by cursory re-learning causes a negligible performance loss on benchmark classification tasks. The spiking neuron-based S2Ms outperform existing spike-based unsupervised learners, while potentially offering substantial advantages in terms of power and complexity, and are thus promising models for on-line learning in brain-inspired hardware.
Keyword:
stochastic processes
spiking neural networks
synaptic plasticty
unsupervised learning
Hopfield networks
regularization
synaptic transmission
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
3.2
论文数:
1.6W
被引数:
5.3W
机构
引用论文
.png){kind=icon}
Enhanced photocatalytic removal of Cd(II) from aqueous solution using Bi/S co-doped carbon quantum dots通过Bi/S共掺杂碳量子点增强光催化去除水溶液中的Cd(II)OAAI
OAAI分享收藏
查看更多内容