返回
Representation learning using event-based STDP
DOI:10.1016/j.neunet.2018.05.018.png)
摘要
En 中文
Although representation learning methods developed within the framework of traditional neural networks are relatively mature, developing a spiking representation model remains a challenging problem. This paper proposes an event-based method to train a feedforward spiking neural network (SNN) layer for extracting visual features. The method introduces a novel spike-timing-dependent plasticity (STDP) learning rule and a threshold adjustment rule both derived from a vector quantization-like objective function subject to a sparsity constraint. The STDP rule is obtained by the gradient of a vector quantization criterion that is converted to spike-based, spatio-temporally local update rules in a spiking network of leaky, integrate-and-fire (LIF) neurons. Independence and sparsity of the model are achieved by the threshold adjustment rule and by a softmax function implementing inhibition in the representation layer consisting of WTA-thresholded spiking neurons. Together, these mechanisms implement a form of spike-based, competitive learning. Two sets of experiments are performed on the MNIST and natural image datasets. The results demonstrate a sparse spiking visual representation model with low reconstruction loss comparable with state-of-the-art visual coding approaches, yet our rule is local in both time and space, thus biologically plausible and hardware friendly. (C) 2018 Elsevier Ltd. All rights reserved.
Keyword:
Representation learning
Spiking neural networks
Quantization
STDP
Bio-inspired model
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
6.3
论文数:
8.3K
被引数:
3.0W
机构
引用论文
Destruction of toxic organophosphorus and organosulfur pollutants by perpropionic acid: the first stable, industrial liquid water-miscible peroxyacid in decontamination
New J. Chem.
IF0
Fast and adaptive network of spiking neurons for multi-view visual pattern recognition
NEUROCOMPUTING
IF6.5

