arrow
返回

Memristive Stochastic Computing for Deep Learning Parameter Optimization

delete2021-05-01
delete30
delete
OA
AI
C
Corey Lammie
J
Jason K. Eshraghian
卢
卢苇 (Wei Lü)
M
Mostafa Rahimi Azghadi *
DOI:10.1109/TCSII.2021.3065932delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Stochastic Computing (SC) is a computing paradigm that allows for the low-cost and low-power computation of various arithmetic operations using stochastic bit streams and digital logic. In contrast to conventional representation schemes used within the binary domain, the sequence of bit streams in the stochastic domain is inconsequential, and computation is usually non-deterministic. In this brief, we exploit the stochasticity during switching of probabilistic Conductive Bridging RAM (CBRAM) devices to efficiently generate stochastic bit streams in order to perform Deep Learning (DL) parameter optimization, reducing the size of Multiply and Accumulate (MAC) units by 5 orders of magnitude. We demonstrate that in using a 40-nm Complementary Metal Oxide Semiconductor (CMOS) process our scalable architecture occupies 1.55mm(2) and consumes approximately 167 mu W when optimizing parameters of a Convolutional Neural Network (CNN) while it is being trained for a character recognition task, observing no notable reduction in accuracy post-training.
Keyword:
Stochastic processes
Training
Switches
Optimization
Performance evaluation
Computer architecture
Deep learning
Memristors
stochastic switching
stochastic computing
deep learning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

I
IEEE Transactions on Circuits and Systems and Express Briefs
IF:
4.9
论文数:
8.8K
被引数:
2.5W

机构

J
James Cook University
学者数:
7.8K
论文数: 7.9K
被引数: 1.2W
U
university of michigan system
学者数:
9.1W
论文数: 8.6W
被引数: 133
引用论文

引用论文

Neuromemristive Circuits for Edge Computing: A Review
err2020-01-01
err182
errOAAI
errKrestinskaya, Olga; James, Alex Pappachen; Chua, Leon Ong
err分享
err收藏
Leptin
err1996-12-01
err0
PREAI
errA Meinders
err分享
err收藏
Human cytomegalovirus viraemia in HIV-1-seropositive patients at various clinical stages of infection
errAIDS
IF0
err1990-10-01
err0
PREAI
errGiuseppe Gerna; Maurizio Parea; Elena Percivalle; Donato Zipeto; Enrico Silini; Giorgio Barbarini; Gabriele Milanesi
err分享
err收藏
err分享
err收藏
Understanding memristive switching via in situ characterization and device modeling通过原位表征和器件建模了解忆阻开关
err2019-08-01
err306
errOAAI
errSun, Wen; Gao, Bin; Chi, Miaofang; Xia, Qiangfei; Yang, J. Joshua; Qian, He; Wu, Huaqiang
err分享
err收藏
学者 查看更多内容