General Bitwidth Assignment for Efficient Deep Convolutional Neural Network Quantization

Wen Fei

doi:10.1109/TNNLS.2021.3069886

2022-10-01

PRE

DOI：10.1109/TNNLS.2021.3069886

原文链接

原文求助

摘要

En 中文

Model quantization is essential to deploy deep convolutional neural networks (DCNNs) on resource-constrained devices. In this article, we propose a general bitwidth assignment algorithm based on theoretical analysis for efficient layerwise weight and activation quantization of DCNNs. The proposed algorithm develops a prediction model to explicitly estimate the loss of classification accuracy led by weight quantization with a geometrical approach. Consequently, dynamic programming is adopted to achieve optimal bitwidth assignment on weights based on the estimated error. Furthermore, we optimize bitwidth assignment for activations by considering the signal-to-quantization-noise ratio (SQNR) between weight and activation quantization. The proposed algorithm is general to reveal the tradeoff between classification accuracy and model size for various network architectures. Extensive experiments demonstrate the efficacy of the proposed bitwidth assignment algorithm and the error rate prediction model. Furthermore, the proposed algorithm is shown to be well extended to object detection.

Keyword:

Quantization (signal)

Prediction algorithms

Error analysis

Computational modeling

Training

Convolutional neural networks

Standards

Bitwidth assignment

deep convolutional neural networks (DCNNs)

network quantization

quantization noise

AI总结

对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Neural Networks and Learning Systems

IF:

8.9

论文数:

7.6K

被引数:

7.2W

机构

shanghai jiao tong university

学者数:

15.7W

论文数: 11.7W

被引数: 159

引用论文

Core–Shell Catalyst CuO–ZnO–Al2O3@Al2O3 for Dimethyl Ether Synthesis from Syngas

Chemistry Letters

IF0

2013-04-05

PREAI

Yan Wang; Wenli Wang; Yuexian Chen; Jinghong Ma; Jiajun Zheng; Ruifeng Li

Blastococcus capsensis sp. nov., isolated from an archaeological Roman pool and emended description of the genus Blastococcus, B. aggregatus, B. saxobsidens, B. jejuensis and B. endophyticus

International Journal of Systematic and Evolutionary Microbiology

IF0

2016-11-01

OAAI

Karima Hezbri; Moussa Louati; Imen Nouioui; Maher Gtari; Manfred Rohde; Cathrin Spröer; Peter Schumann; Hans-Peter Klenk; Faten Ghodhbane-Gtari; Maria del Carmen Montero-Calasanz

Continuous and Wireless Skin Contact and Ear Implant Temperature Measurements and Relations to the Core Body Temperature of Heat Stressed Dairy Cows

10th International Livestock Environment Symposium (ILES X)

IF0

2018-01-01

PREAI

Hanwook Chung; Jingjie Li; Younghyun Kim; Christopher Y Choi

A Hierarchical Cardiac Rhythm Classification Methodology Based on Electrocardiogram Fiducial Points 一种基于心电图基准点的分层心律分类方法

Computing in Cardiology Conference (CinC)

IF0

2017-09-14