arrow
Return

Error driven synapse augmented neurogenesis

delete2022-10-28
delete0
delete
OA
AI
A
Adam Perrett *
S
Steve Furber
O
Oliver Rhodes
DOI:10.3389/frai.2022.949707delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Capturing the learning capabilities of the brain has the potential to revolutionize artificial intelligence. Humans display an impressive ability to acquire knowledge on the fly and immediately store it in a usable format. Parametric models of learning, such as gradient descent, focus on capturing the statistical properties of a data set. Information is precipitated into a network through repeated updates of connection weights in the direction gradients dictate will lead to less error. This work presents the EDN (Error Driven Neurogenesis) algorithm which explores how neurogenesis coupled with non-linear synaptic activations enables a biologically plausible mechanism to immediately store data in a one-shot, online fashion and readily apply it to a task without the need for parameter updates. Regression (auto-mpg) test error was reduced more than 135 times faster and converged to an error around three times smaller compared to gradient descent using ADAM optimization. EDN also reached the same level of performance in wine cultivar classification 25 times faster than gradient descent and twice as fast when applied to MNIST and the inverted pendulum (reinforcement learning).
Keywords:
neurogenesis
synaptic activation
classification
regression
reinforcement learning
one-shot
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

F
Frontiers in Artificial Intelligence
IF:
4.7
Papers:
2.6K
Citations:
4.4K

Organization

U
University of Manchester
Scholars:
5.7W
Papers: 5.3W
Citations: 7.4W
Cited Papers

Cited Papers

Thermodynamics study on the generation of electricity via CO2-mineralization cell
err2015-08-23
err0
errOAAI
errHeping Xie; Wen Jiang; Yufei Wang; Tao Liu; Ruilin Wang; Bin Liang; Yang He; Jinlong Wang; Liang Tang; Jinwei Chen
errShare
errSave
errShare
errSave
Lazzaro spallanzani: A blow against spontaneous generation
err1993-12-01
err0
PREAI
errAnnalisa Ariatti; Paolo Mandrioli
errShare
errSave
errShare
errSave
Structural dynamics of dendritic spines in memory and cognition
err2010-03-01
err728
PREAI
errKasai, Haruo; Fukuda, Masahiro; Watanabe, Satoshi; Hayashi-Takagi, Akiko; Noguchi, Jun
errShare
errSave
Distance Measurement Using a Stereo Vision System
err2013-02-01
err0
PREAI
errBogdan Żak; Stanisław Hożyń
errShare
errSave
researcher View more