arrow
返回

Pre-Computing Batch Normalisation Parameters for Edge Devices on a Binarized Neural Network

delete2023-06-14
delete2
delete
OA
AI
N
Nicholas Phipps
J
Jin-Jia Shang
T
Tee Hui Teo *
I
I‐Chyn Wey
DOI:10.3390/s23125556delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Binarized Neural Network (BNN) is a quantized Convolutional Neural Network (CNN), reducing the precision of network parameters for a much smaller model size. In BNNs, the Batch Normalisation (BN) layer is essential. When running BN on edge devices, floating point instructions take up a significant number of cycles to perform. This work leverages the fixed nature of a model during inference, to reduce the full-precision memory footprint by half. This was achieved by pre-computing the BN parameters prior to quantization. The proposed BNN was validated through modeling the network on the MNIST dataset. Compared to the traditional method of computation, the proposed BNN reduced the memory utilization by 63% at 860-bytes without any significant impact on accuracy. By pre-computing portions of the BN layer, the number of cycles required to compute is reduced to two cycles on an edge device.
Keyword:
batch normalisation
binarized neural networks
convolutional neural networks
inference
edge devices
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Sensors 封面图
Sensors
IF:
3.5
论文数:
7.2W
被引数:
20.9W

机构

S
singapore university of technology & design
学者数:
2.8K
论文数: 3.6K
被引数: 5
引用论文

引用论文

Ionophore antibiotic X-206 is a potent and selective inhibitor of SARS-CoV-2 infectionin vitro
err
IF0
err2020-06-14
err0
errOAAI
errEsben B. Svenningsen; Jacob Thyrsted; Julia Blay-Cadanet; Han Liu; Shaoquan Lin; Jaime Moyano Villameriel; David Olagnier; Manja Idorn; Søren R. Paludan; Christian K. Holm; Thomas B. Poulsen
err分享
err收藏
Echocardiographic mitral valve prolapse in ballet dancers: A function of leanness
err1987-02-01
err0
PREAI
errJerald L. Cohen; Stephen M. Austin; Karen R. Segal; Arthur E. Millman; Chung S. Kim
err分享
err收藏
学者 查看更多内容