.png){kind=icon}
返回
Hybrid Post-Training Quantization for Super-Resolution Neural Network Compression
.png){kind=icon}
PRE
AI
DOI：10.1109/LSP.2023.3264558.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Quantization is a widely adopted technique to reduce the storage cost of neural networks. However, existing methods primarily focus on minimizing the quantization error of neural network parameters without considering the correlation between the quantization error and performance of quantized neural networks. Motivated by this consideration, we propose a hybrid post-training quantization (HPTQ) method for super-resolution neural networks. Layer-wise quantization and piecewise quantization are integrated based on error sensitivity and the quantization error of parameters. In HPTQ, we utilize Taylor expansion to demonstrate that the performance distortion of quantized neural networks is a weighted average of parameter quantization errors with respect to gradients. To reduce the quantization error, we apply uniform and clustered quantization to parameters in dense and sparse regions, respectively. Furthermore, we allocate larger bit-widths to layers with higher error sensitivity indicated by gradients. Numerical experiments show that the super-resolution neural networks perform better under the proposed quantization approach compared to existing quantization methods.
Keyword:
Layer-wise quantization
neural network compression
piecewise quantization
super-resolution neural network
期刊
IF:
9.6
论文数:
1.1W
被引数:
1.7W
机构
引用论文
Inflexibility of mental planning: A characteristic disorder with prefrontal lobe lesions?心理计划的僵化: 前额叶病变的特征性障碍？
.png){kind=icon}
PREAI
分享收藏Under arrest: cytostatic factor (CSF)-mediated metaphase arrest in vertebrate eggs被捕: 脊椎动物卵中细胞生长抑制因子 (CSF) 介导的中期停滞
OAAI
OAAI分享收藏Boosting question answering over knowledge graph with reward integration and policy evaluation under weak supervision在弱监督下通过奖励整合和政策评估提升知识图谱的问题回答
PREAI
分享收藏
Research on the Efficiency of Wireless Power Transfer System Based on Multi-Auxiliary Transmitting Coils基于多辅助发射线圈的无线电能传输系统效率研究
PREAI
分享收藏
查看更多内容