arrow
Return

Energy efficient synaptic plasticity

delete2020-02-13
delete25
delete
OA
AI
H
Ho Ling Li
M
Mark C. W. van Rossum *
DOI:10.7554/eLife.50804delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Many aspects of the brain's design can be understood as the result of evolutionary drive toward metabolic efficiency. In addition to the energetic costs of neural computation and transmission, experimental evidence indicates that synaptic plasticity is metabolically demanding as well. As synaptic plasticity is crucial for learning, we examine how these metabolic costs enter in learning. We find that when synaptic plasticity rules are naively implemented, training neural networks requires extremely large amounts of energy when storing many patterns. We propose that this is avoided by precisely balancing labile forms of synaptic plasticity with more stable forms. This algorithm, termed synaptic caching, boosts energy efficiency manifold and can be used with any plasticity rule, including back-propagation. Our results yield a novel interpretation of the multiple forms of neural synaptic plasticity observed experimentally, including synaptic tagging and capture phenomena. Furthermore, our results are relevant for energy efficient neuromorphic designs.
Keywords:
MEMORY
GLUCOSE
PERCEPTRON
STORAGE
YOUNG
COST

Journal

eLife cover
eLife
IF:
0
Papers:
1.8W
Citations:
16

Organization

U
University of Nottingham
Scholars:
3.4W
Papers: 3.2W
Citations: 5.5W
Cited Papers

Cited Papers

errShare
errSave
The Persistence and Transience of Memory
errNEURON
IF15
err2017-06-01
err204
errOAAI
errRichards, Blake A.; Frankland, Paul W.
errShare
errSave
Unified pre- and postsynaptic long-term plasticity enables reliable and flexible learning
err2015-08-26
err46
errOAAI
errCosta, Rui Ponte; Froemke, Robert C.; Sjoestroem, P. Jesper; van Rossum, Mark C. W.
errShare
errSave
Copolymerization of ε‐caprolactone and morpholine‐2,5‐dione derivatives
err2003-03-12
err0
errOAAI
errPeter J. A. in't Veld; Ye Wei‐Ping; Richard Klap; Pieter J. Dijkstra; Jan Feijen
errShare
errSave
Pharmacokinetics of Oral Treprostinil Sustained Release Tablets During Chronic Administration to Patients with Pulmonary Arterial Hypertension
err2013-06-01
err0
PREAI
errR. James White; Fernando Torres; Roblee Allen; Carlos Jerjes; Tomas Pulido; David Yehle; Meredith Howell; Kevin Laliberte; Jean-Francois Marier; Victor F. Tapson
errShare
errSave
Location and Chemical Synthesis of a Pre-S Gene Coded Immunodominant Epitope of Hepatitis B Virus
err1984-04-27
err0
PREAI
errA. Robert Neurath; Stephen B. H. Kent; Nathan Strick
errShare
errSave
Making memories last: the synaptic tagging and capture hypothesis
err2010-12-20
err603
PREAI
errRedondo, Roger L.; Morris, Richard G. M.
errShare
errSave
researcher View more