.png){kind=icon}
返回
Streaming Batch Eigenupdates for Hardware Neural Networks
.png){kind=icon}
OA
AI
DOI：10.3389/fnins.2019.00793.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Neural networks based on nanodevices, such as metal oxide memristors, phase change memories, and flash memory cells, have generated considerable interest for their increased energy efficiency and density in comparison to graphics processing units (GPUs) and central processing units (CPUs). Though immense acceleration of the training process can be achieved by leveraging the fact that the time complexity of training does not scale with the network size, it is limited by the space complexity of stochastic gradient descent, which grows quadratically. The main objective of this work is to reduce this space complexity by using low-rank approximations of stochastic gradient descent. This low spatial complexity combined with streaming methods allows for significant reductions in memory and compute overhead, opening the door for improvements in area, time and energy efficiency of training. We refer to this algorithm and architecture to implement it as the streaming batch eigenupdate (SBE) approach.
Keyword:
neuromorphic
memristor
network training
stochastic gradient descent
back propagation
singular value decomposition
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
3.2
论文数:
1.6W
被引数:
5.3W
机构
引用论文
分享收藏分享收藏Fully memristive neural networks for pattern classification with unsupervised learning基于无监督学习的全忆阻神经网络模式分类.png)
NATURE ELECTRONICS
NATURE ELECTRONICSIF40.9
PREAI
分享收藏The Next Generation of Deep Learning Hardware: Analog Computing下一代深度学习硬件: 模拟计算PROCEEDINGS OF THE IEEE
PROCEEDINGS OF THE IEEEIF25.9
PREAI
分享收藏
查看更多内容