.png){kind=icon}
返回
SpinDrop: Dropout-Based Bayesian Binary Neural Networks With Spintronic Implementation
.png){kind=icon}
OA
AI
DOI：10.1109/JETCAS.2023.3242146.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Neural Networks (NNs) provide an effective solution in numerous application domains, including autonomous driving and medical applications. Nevertheless, NN predictions can be incorrect if the input sample is outside of the training distribution or contaminated by noise. Consequently, quantifying the uncertainty of the NN prediction allows the system to make more insightful decisions by avoiding blind predictions. Therefore, uncertainty quantification is crucial for a variety of applications, including safety-critical applications. Bayesian NN (BayNN) using Dropout-based approximation provides a systematic approach for estimating the uncertainty of predictions. Despite such merit, BayNNs are not suitable for implementation in an embedded device or able to meet high-performance demands for certain applications. Computation in-memory (CiM) architecture with emerging non-volatile memories (NVMs) is a great candidate for high-performance and low-power acceleration BayNNs in hardware. Among NVMs, Magnetic Tunnel Junction (MTJ) offer many benefits, but they also suffer from various non-idealities and limited bit-level resolution. As a result, binarizing BayNNs is an attractive option that can directly implement BayNN into a CiM architecture and able to achieve benefits of both CiM architecture and BayNNs at the same time. Conventional in-memory hardware implementations emphasize conventional NNs, which can only make predictions, and do not account for both device and input uncertainty, thus, reducing both reliability and performance. In this paper, we propose for the first time Binary Bayesian NNs (BinBayNN) with an end-to-end approach (from algorithmic level to device level) for their implementation. Our approach takes the inherent stochastic properties of MTJs as a feature to implement Dropout-based Bayesian Neural Networks. We provide an extensive evaluation of our approach from the device level up to the algorithmic level on various benchmark datasets.
Keyword:
Artificial neural networks
Neural networks
Bayes methods
Magnetic tunneling
Uncertainty
Switches
Resistance
Bayesian neural network
binary bayesian neural network
spintronic
monte carlo dropout
binary neural network
期刊
IF:
3.8
论文数:
1.4K
被引数:
2.8K
机构
引用论文
Oil–water two-phase flow measurement with combined ultrasonic transducer and electrical sensors
PREAI
分享收藏A Hierarchical Cardiac Rhythm Classification Methodology Based on Electrocardiogram Fiducial Points一种基于心电图基准点的分层心律分类方法
OAAI
OAAI分享收藏In situ learning using intrinsic memristor variability via Markov chain Monte Carlo sampling通过马尔可夫链蒙特卡罗采样使用本征忆阻器变异性进行原位学习.png)
NATURE ELECTRONICS
NATURE ELECTRONICSIF40.9
PREAI
分享收藏Thermal comfort, perceived air quality, and cognitive performance when personally controlled air movement is used by tropically acclimatized persons当热带适应的人使用个人控制的空气运动时，热舒适性，感知的空气质量和认知表现Indoor AirOAAI
Indoor AirIF0
OAAI分享收藏Distribution-Sensitive Information Retention for Accurate Binary Neural Network精确二进制神经网络的分布敏感信息保留
PREAI
分享收藏分享收藏Resistive switching materials for information processing信息处理用阻变材料NATURE REVIEWS MATERIALS
NATURE REVIEWS MATERIALSIF86.2
PREAI
分享收藏
查看更多内容