arrow
返回

Accurate and compact convolutional neural network based on stochastic computing

delete2022-01-01
delete25
PRE
AI
H
Hamdan Abdellatef *
M
Mohamed Khalil-Hani
N
Nasir Shaikh-Husin
S
Sayed Omid Ayat
DOI:10.1016/j.neucom.2021.10.105delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Convolutional Neural Networks (CNNs) achieve state-of-the-art performance in many recognition problems. However, CNN models are computation-intensive and require enormous resources and power, limiting their applicability in embedded systems with limited area and power budget. An alternative computing technique called Stochastic Computing (SC) can implement resource-demanding algorithms in smaller hardware that indeed reduces the power consumption. In this work, we propose SC-based forward functions for CNN layers that obtain significant area savings and high accuracy to replace the conventional binary-encoded (BE) deterministic computing counterparts. Then, we specify some training considerations to enable achieving low error rates for SC-based CNN. The experimental results show that the SC-based CNN attained 99.19% and 96.25% classification accuracy using MNIST digit classification and AT&T face recognition datasets, respectively. Moreover, the SC-based CNN of ResNet-20 model achieved 86.5% classification accuracy using the CIFAR-10 object dataset. The SC-based CNN functions have better classification accuracy compared to other SC schemes and obtained ultra-low hardware footprint compared to conventional BE counterparts. (c) 2021 Elsevier B.V. All rights reserved.
Keyword:
Stochastic computing
Convolutional neural networks

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

L
Lebanese American University
学者数:
3.0K
论文数: 3.0K
被引数: 6.9K
U
Universiti Teknologi Malaysia
学者数:
1.4W
论文数: 1.1W
被引数: 85
引用论文

引用论文

err
IF0
err
err0
PREAI
err
err分享
err收藏
err分享
err收藏
Fintech, financial inclusion and income inequality: a quantile regression approach
err2020-06-01
err0
errOAAI
errAyse Demir; Vanesa Pesqué-Cela; Yener Altunbas; Victor Murinde
err分享
err收藏
FP-BNN: Binarized neural network on FPGAFp-bnn: 基于FPGA的二值化神经网络
err2018-01-01
err222
PREAI
errLiang, Shuang; Yin, Shouyi; Liu, Leibo; Luk, Wayne; Wei, Shaojun
err分享
err收藏
学者 查看更多内容