arrow
Return

Stochastic computing in convolutional neural network implementation: a review

delete2020-11-09
delete11
delete
OA
AI
Y
Yang Yang Lee
Z
Zaini Abdul Halim *
DOI:10.7717/peerj-cs.309delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Stochastic computing (SC) is an alternative computing domain for ubiquitous deterministic computing whereby a single logic gate can perform the arithmetic operation by exploiting the nature of probability math. SC was proposed in the 1960s when binary computing was expensive. However, presently, SC started to regain interest after the widespread of deep learning application, specifically the convolutional neural network (CNN) algorithm due to its practicality in hardware implementation. Although not all computing functions can translate to the SC domain, several useful function blocks related to the CNN algorithm had been proposed and tested by researchers. An evolution of CNN, namely, binarised neural network, had also gained attention in the edge computing due to its compactness and computing efficiency. This study reviews various SC CNN hardware implementation methodologies. Firstly, we review the fundamental concepts of SC and the circuit structure and then compare the advantages and disadvantages amongst different SC methods. Finally, we conclude the overview of SC in CNN and make suggestions for widespread implementation.
Keywords:
Stochastic computing
Convolutional Neural Network
Deep learning
FPGA
IoT
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

PeerJ Computer Science cover
PeerJ Computer Science
IF:
2.5
Papers:
3.4K
Citations:
6.9K

Organization

U
Universiti Sains Malaysia
Scholars:
1.5W
Papers: 1.3W
Citations: 131