arrow
返回

Random synaptic feedback weights support error backpropagation for deep learning

delete2016-11-08
delete483
delete
OA
AI
T
Timothy Lillicrap *
D
Daniel Cownden
D
Douglas Tweed
C
Colin J. Akerman *
DOI:10.1038/ncomms13276delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
The brain processes information through multiple layers of neurons. This deep architecture is representationally powerful, but complicates learning because it is difficult to identify the responsible neurons when a mistake is made. In machine learning, the backpropagation algorithm assigns blame by multiplying error signals with all the synaptic weights on each neuron's axon and further downstream. However, this involves a precise, symmetric backward connectivity pattern, which is thought to be impossible in the brain. Here we demonstrate that this strong architectural constraint is not required for effective error propagation. We present a surprisingly simple mechanism that assigns blame by multiplying errors by even random synaptic weights. This mechanism can transmit teaching signals across multiple layers of neurons and performs as effectively as backpropagation on a variety of tasks. Our results help reopen questions about how the brain could use error signals and dispel long-held assumptions about algorithmic constraints on learning.
Keyword:
VISUAL-CORTEX
REINFORCEMENT
PLASTICITY
REPRESENTATIONS
PREDICTION
CEREBELLUM
ACTIVATION
SIGN
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Nature Communications 封面图
Nature Communications
IF:
15.7
论文数:
9.3W
被引数:
91.2W

机构

U
university of st andrews
学者数:
9.5K
论文数: 1.0W
被引数: 15
U
university of oxford
学者数:
9.8W
论文数: 8.6W
被引数: 137
U
university of toronto
学者数:
14.8W
论文数: 12.0W
被引数: 165
学者 查看更多机构
引用论文

引用论文

Multiwindow Fusion for Wearable Activity Recognition
err2015-06-06
err0
PREAI
errOresti Banos; Juan-Manuel Galvez; Miguel Damas; Alberto Guillen; Luis-Javier Herrera; Hector Pomares; Ignacio Rojas; Claudia Villalonga; Choong Seon Hong; Sungyoung Lee
err分享
err收藏
Advanced Biomedical Image Analysis
err
IF0
err2010-10-12
err0
PREAI
errMark A. Haidekker
err分享
err收藏
Top-down influences on visual processing
err2013-04-18
err818
errOAAI
errGilbert, Charles D.; Li, Wu
err分享
err收藏
err分享
err收藏
学者 查看更多内容