arrow
Return

Machine learning using magnetic stochastic synapses

delete2023-06-23
delete5
delete
OA
AI
M
Matthew O. A. Ellis *
A
Alexander Welbourne
S
Stephan J. Kyle
P
P. W. Fry
D
D. A. Allwood
T
Thomas J. Hayward
E
Eleni Vasilaki
DOI:10.1088/2634-4386/acdb96delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The impressive performance of artificial neural networks has come at the cost of high energy usage and CO2 emissions. Unconventional computing architectures, with magnetic systems as a candidate, have potential as alternative energy-efficient hardware, but, still face challenges, such as stochastic behaviour, in implementation. Here, we present a methodology for exploiting the traditionally detrimental stochastic effects in magnetic domain-wall motion in nanowires. We demonstrate functional binary stochastic synapses alongside a gradient learning rule that allows their training with applicability to a range of stochastic systems. The rule, utilising the mean and variance of the neuronal output distribution, finds a trade-off between synaptic stochasticity and energy efficiency depending on the number of measurements of each synapse. For single measurements, the rule results in binary synapses with minimal stochasticity, sacrificing potential performance for robustness. For multiple measurements, synaptic distributions are broad, approximating better-performing continuous synapses. This observation allows us to choose design principles depending on the desired performance and the device's operational speed and energy cost. We verify performance on physical hardware, showing it is comparable to a standard neural network.
Keywords:
neuromorphic
magnetic nanowire
binary stochastic synapses
gradient rule
spintronics

Journal

Neuromorphic Computing and Engineering cover
Neuromorphic Computing and Engineering
IF:
6.1
Papers:
340
Citations:
920

Organization

U
University of Sheffield
Scholars:
3.0W
Papers: 2.9W
Citations: 3.9W
Cited Papers

Cited Papers

Energy Efficient Learning With Low Resolution Stochastic Domain Wall Synapse for Deep Neural Networks
err2022-01-01
err15
errOAAI
errAl Misba, Walid; Lozano, Mark; Querlioz, Damien; Atulasimha, Jayasimha
errShare
errSave
Immunoglobulin class switch from IgG to IgA in a patient with smoldering multiple myeloma
err1986-06-01
err0
errOAAI
errM Takahashi; T Tsukada; M Kojima; T Koide; T Koike; H Takahashi; C Sakai; M Kashimura; A Shibata
errShare
errSave
Ultrathin Conjugated Polymer Network Films of Carbazole Functionalized Poly(p-Phenylenes) via Electropolymerization
err2007-05-24
err0
PREAI
errRenu Ravindranath; Parayil Kumaran Ajikumar; Sheeja Bahulayan; Nurmawati Bte Muhammad Hanafiah; Akira Baba; Rigoberto C. Advincula; Wolfgang Knoll; Suresh Valiyaveettil
errShare
errSave
Gradient Descent on Multilevel Spin-Orbit Synapses with Tunable Variations
err2021-02-08
err0
errOAAI
errLan, Xiukai; Cao, Yi; Liu, Xiangyu; Xu, Kaijia; Liu, Chuan; Zheng, Houzhi; Wang, Kaiyou
errShare
errSave
Tuning a Binary Ferromagnet into a Multistate Synapse with Spin-Orbit-Torque-Induced Plasticity
err2019-03-12
err176
errOAAI
errCao, Yi; Rushforth, Andrew W.; Sheng, Yu; Zheng, Houzhi; Wang, Kaiyou
errShare
errSave
The N3XT Approach to Energy-Efficient Abundant-Data Computing
err2019-01-01
err87
errOAAI
errAly, Mohamed M. Sabry; Wu, Tony F.; Bartolo, Andrew; Malviya, Yash H.; Hwang, William; Hills, Gage; Markov, Igor; Wootters, Mary; Shulaker, Max M.; Wong, H-S Philip; Mitra, Subhasish
errShare
errSave
errShare
errSave
A generalised framework for detailed classification of swimming paths inside the Morris Water Maze
err2018-10-10
err32
errOAAI
errVouros, Avgoustinos; Gehring, Tiago, V; Szydlowska, Kinga; Janusz, Artur; Tu, Zehai; Croucher, Mike; Lukasiuk, Katarzyna; Konopka, Witold; Sandi, Carmen; Vasilaki, Eleni
errShare
errSave
Voltage-controlled superparamagnetic ensembles for low-power reservoir computing
err2021-05-17
err19
errOAAI
errWelbourne, A.; Levy, A. L. R.; Ellis, M. O. A.; Chen, H.; Thompson, M. J.; Vasilaki, E.; Allwood, D. A.; Hayward, T. J.
errShare
errSave
researcher View more