arrow
返回

A Memristor-Based Learning Engine for Synaptic Trace-Based Online Learning

delete2023-10-01
delete6
delete
OA
AI
D
Deyu Wang
J
Jiawei Xu
F
Feng Li
L
Lianhao Zhang
C
Chengwei Cao
D
Dimitrios Stathis
A
Anders Lansner
A
Ahmed Hemani
L
Li‐Rong Zheng *
Z
Zhuo Zou *
DOI:10.1109/TBCAS.2023.3291021delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The memristor has been extensively used to facilitate the synaptic online learning of brain-inspired spiking neural networks (SNNs). However, the current memristor-based work can not support the widely used yet sophisticated trace-based learning rules, including the trace-based Spike-Timing-Dependent Plasticity (STDP) and the Bayesian Confidence Propagation Neural Network (BCPNN) learning rules. This paper proposes a learning engine to implement trace-based online learning, consisting of memristor-based blocks and analog computing blocks. The memristor is used to mimic the synaptic trace dynamics by exploiting the nonlinear physical property of the device. The analog computing blocks are used for the addition, multiplication, logarithmic and integral operations. By organizing these building blocks, a reconfigurable learning engine is architected and realized to simulate the STDP and BCPNN online learning rules, using memristors and 180 nm analog CMOS technology. The results show that the proposed learning engine can achieve energy consumption of 10.61 pJ and 51.49 pJ per synaptic update for the STDP and BCPNN learning rules, respectively, with a 147.03x and 93.61x reduction compared to the 180 nm ASIC counterparts, and also a 9.39x and 5.63x reduction compared to the 40 nm ASIC counterparts. Compared with the state-of-the-art work of Loihi and eBrainII, the learning engine can reduce the energy per synaptic update by 11.31x and 13.13x for trace-based STDP and BCPNN learning rules, respectively.
Keyword:
Memristors
Engines
Neuromorphics
Voltage
Synapses
Computational modeling
Biological neural networks
Bayesian confidence propagation neural network (BCPNN)
learning engine
memristor
online learning
spiking neural network (SNN)
spike-timing-dependent plasticity (STDP)
trace dynamics

期刊

IEEE Transactions on Circuits and Systems I-Regular Papers 封面图
IEEE Transactions on Circuits and Systems I-Regular Papers
IF:
5.2
论文数:
9.9K
被引数:
2.2W

机构

F
fudan university
学者数:
11.8W
论文数: 7.7W
被引数: 121
R
Royal Institute of Technology
学者数:
1.8W
论文数: 1.8W
被引数: 25
引用论文

引用论文

err
IF0
err
err0
PREAI
err
err分享
err收藏
Research Progress on Memristor: From Synapses to Computing Systems
err2022-05-01
err103
PREAI
errYang, Xiaoxuan; Taylor, Brady; Wu, Ailong; Chen, Yiran; Chua, Leon O.
err分享
err收藏
A ferroelectric memristor
err2012-09-16
err974
PREAI
errChanthbouala, Andre; Garcia, Vincent; Cherifi, Ryan O.; Bouzehouane, Karim; Fusil, Stephane; Moya, Xavier; Xavier, Stephane; Yamada, Hiroyuki; Deranlot, Cyrile; Mathur, Neil D.; Bibes, Manuel; Barthelemy, Agnes; Grollier, Julie
err分享
err收藏
Neuromorphic computing with multi-memristive synapses具有多忆阻突触的神经形态计算
err2018-06-28
err613
errOAAI
errBoybat, Irem; Le Gallo, Manuel; Nandakumar, S. R.; Moraitis, Timoleon; Parnell, Thomas; Tuma, Tomas; Rajendran, Bipin; Leblebici, Yusuf; Sebastian, Abu; Eleftheriou, Evangelos
err分享
err收藏
A memristive deep belief neural network based on silicon synapses基于硅突触的忆阻深度信念神经网络
err2022-12-19
err33
PREAI
errWang, Wei; Danial, Loai; Li, Yang; Herbelin, Eric; Pikhay, Evgeny; Roizin, Yakov; Hoffer, Barak; Wang, Zhongrui; Kvatinsky, Shahar
err分享
err收藏
VTEAM: A General Model for Voltage-Controlled Memristors
err2015-08-01
err654
PREAI
errKvatinsky, Shahar; Ramadan, Misbah; Friedman, Eby G.; Kolodny, Avinoam
err分享
err收藏
The Rationale of Functional Bracing of Fractures
err1980-01-01
err0
PREAI
errLoren L. Latta; Augusto Sarmiento; Richard R. Tarr
err分享
err收藏
学者 查看更多内容