arrow
返回

Meta-learning biologically plausible plasticity rules with random feedback pathways

delete2023-03-31
delete5
delete
OA
AI
N
Navid Shervani-Tabar *
R
Robert Rosenbaum
DOI:10.1038/s41467-023-37562-1delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
The biological plausibility of backpropagation and its relationship with synaptic plasticity remain open questions. The authors propose a meta-learning approach to discover interpretable plasticity rules to train neural networks under biological constraints. The meta-learned rules boost the learning efficiency via bio-inspired synaptic plasticity. Backpropagation is widely used to train artificial neural networks, but its relationship to synaptic plasticity in the brain is unknown. Some biological models of backpropagation rely on feedback projections that are symmetric with feedforward connections, but experiments do not corroborate the existence of such symmetric backward connectivity. Random feedback alignment offers an alternative model in which errors are propagated backward through fixed, random backward connections. This approach successfully trains shallow models, but learns slowly and does not perform well with deeper models or online learning. In this study, we develop a meta-learning approach to discover interpretable, biologically plausible plasticity rules that improve online learning performance with fixed random feedback connections. The resulting plasticity rules show improved online training of deep models in the low data regime. Our results highlight the potential of meta-learning to discover effective, interpretable learning rules satisfying biological constraints.
Keyword:
SENSITIVITY
PATTERNS
SPIKES
MODEL
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Nature Communications 封面图
Nature Communications
IF:
15.7
论文数:
9.4W
被引数:
91.2W

机构

U
University of Notre Dame
学者数:
1.2W
论文数: 1.1W
被引数: 1.7W
引用论文

引用论文

err分享
err收藏
The dimesitylboron group in organic synthesis. 5. Hetero-atom substituted dimesitylborylmethanes.
err1983-01-01
err0
PREAI
errManchak V. Garad; Andrew Pelter; B. Singaram; John W. Wilson
err分享
err收藏
Effects of coronary bypass grafting on resting left ventricular contraction in patients studied 1 to 2 years after operation
err1979-10-01
err0
PREAI
errLeonard M. Zir; Robert Dinsmore; Michael Vexeridis; Jang B. Singh; J.Warren Harthorne; Willard M. Daggett
err分享
err收藏
The Alkaloid Compound Harmane Increases the Lifespan of Caenorhabditis elegans during Bacterial Infection, by Modulating the Nematode’s Innate Immune Response
err2013-03-27
err0
errOAAI
errHenrik Jakobsen; Martin S. Bojer; Martin G. Marinus; Tao Xu; Carsten Struve; Karen A. Krogfelt; Anders Løbner-Olesen
err分享
err收藏
Theories of Error Back-Propagation in the Brain
err2019-03-01
err238
errOAAI
errWhittington, James C. R.; Bogacz, Rafal
err分享
err收藏
学者 查看更多内容