.png){kind=icon}
返回
Unsupervised learning by competing hidden units
.png){kind=icon}
OA
AI
DOI：10.1073/pnas.1820458116.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
It is widely believed that end-to-end training with the backpropagation algorithm is essential for learning good feature detectors in early layers of artificial neural networks, so that these detectors are useful for the task performed by the higher layers of that neural network. At the same time, the traditional form of backpropagation is biologically implausible. In the present paper we propose an unusual learning rule, which has a degree of biological plausibility and which is motivated by Hebb's idea that change of the synapse strength should be local-i.e., should depend only on the activities of the pre- and postsynaptic neurons. We design a learning algorithm that utilizes global inhibition in the hidden layer and is capable of learning early feature detectors in a completely unsupervised way. These learned lower-layer feature detectors can be used to train higher-layer weights in a usual supervised way so that the performance of the full network is comparable to the performance of standard feedforward networks trained end-to-end with a backpropagation algorithm on simple tasks.
Keyword:
biological deep learning
backpropagation
Hebbian-like plasticity
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
P
IF:
9.1
论文数:
10.8W
被引数:
73.5W
机构
引用论文
分享收藏HÆMOPHILUS INFLUENZÆ PRECIPITINS IN THE SERUM OF PATIENTS WITH CHRONIC BRONCHIAL DISORDERS.png)
The Lancet
The LancetIF0
PREAI
分享收藏Amiodarone management of junctional ectopic tachycardia after cardiac surgery in children.HeartOAAI
HeartIF0
OAAI分享收藏
查看更多内容