An Energy-Efficient Bayesian Neural Network Implementation Using Stochastic Computing Method

doi:10.1109/TNNLS.2023.3265533

An Energy-Efficient Bayesian Neural Network Implementation Using Stochastic Computing Method

2024-09-01

5

PRE

AI

DOI：10.1109/TNNLS.2023.3265533

Original

Original request for help

Save

Abstract

En 中文

The robustness of Bayesian neural networks (BNNs) to real-world uncertainties and incompleteness has led to their application in some safety-critical fields. However, evaluating uncertainty during BNN inference requires repeated sampling and feed-forward computing, making them challenging to deploy in low-power or embedded devices. This article proposes the use of stochastic computing (SC) to optimize the hardware performance of BNN inference in terms of energy consumption and hardware utilization. The proposed approach adopts bitstream to represent Gaussian random number and applies it in the inference phase. This allows for the omission of complex transformation computations in the central limit theorem-based Gaussian random number generating (CLT-based GRNG) method and the simplification of multipliers as and operations. Furthermore, an asynchronous parallel pipeline calculation technique is proposed in computing block to enhance operation speed. Compared with conventional binary radix-based BNN, SC-based BNN (StocBNN) realized by FPGA with 128-bit bitstream consumes much less energy consumption and hardware resources with less than 0.1% accuracy decrease when dealing with MNIST/Fashion-MNIST datasets.

Keywords:

Neural networks

Standards

Bayes methods

Hardware

Training

Uncertainty

Integrated circuit modeling

Bayesian neural network (BNN)

energy efficiency

Gaussian random number generator

stochastic computing (SC)

An Energy-Efficient Bayesian Neural Network Implementation Using Stochastic Computing Method

Abstract

Journal

Organization