arrow
Return

Efficient Reward-Based Structural Plasticity on a SpiNNaker 2 Prototype

delete2019-06-01
delete24
delete
OA
AI
Y
Yexin Yan *
D
David Kappel
N
Neumaerker, Felix
J
Johannes Partzsch
B
Bernhard Vogginger
S
Sebastian Höppner
S
Steve Furber
W
Wolfgang Maass
R
Robert Legenstein
M
Mayr, Christian
DOI:10.1109/TBCAS.2019.2906401delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Advances in neuroscience uncover the mechanisms employed by the brain to efficiently solve complex learning tasks with very limited resources. However, the efficiency is often lost when one tries to port these findings to a silicon substrate, since brain-inspired algorithms often make extensive use of complex functions, such as random number generators, that are expensive to compute on standard general purpose hardware. The prototype chip of the second generation SpiNNaker system is designed to overcome this problem. Low-power advanced RISC machine (ARM) processors equipped with a random number generator and an exponential function accelerator enable the efficient execution of brain-inspired algorithms. We implement the recently introduced reward-based synaptic sampling model that employs structural plasticity to learn a function or task. The numerical simulation of the model requires to update the synapse variables in each time step including an explorative random term. To the best of our knowledge, this is the most complex synapse model implemented so far on the SpiNNaker system. By making efficient use of the hardware accelerators and numerical optimizations, the computation time of one plasticity update is reduced by a factor of 2. This, combined with fitting the model into to the local static random access memory (SRAM), leads to 62% energy reduction compared to the case without accelerators and the use of external dynamic random access memory (DRAM). The model implementation is integrated into the SpiN-Naker software framework allowing for scalability onto larger systems. The hardware-software system presented in this paper paves the way for power-efficient mobile and biomedical applications with biologically plausible brain-inspired algorithms.
Keywords:
SpiNNaker chip
random number generator
exponential function accelerator
neuromorphic computing
Bayesian reinforcement learning
synaptic sampling
structural plasticity
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Circuits and Systems I-Regular Papers cover
IEEE Transactions on Circuits and Systems I-Regular Papers
IF:
5.2
Papers:
9.7K
Citations:
2.2W

Organization

G
Graz University of Technology
Scholars:
6.7K
Papers: 6.3K
Citations: 8.5K
T
Technische Universitat Dresden
Scholars:
3.2W
Papers: 2.5W
Citations: 249
U
University of Manchester
Scholars:
5.7W
Papers: 5.2W
Citations: 7.4W
researcher View more organizations