.png){kind=icon}
返回
Post-training quantization for re-parameterization via coarse & fine weight splitting
.png){kind=icon}
PRE
AI
DOI：10.1016/j.sysarc.2024.103065.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Although neural networks have made remarkable advancements in various applications, they require substantial computational and memory resources. Network quantization is a powerful technique to compress neural networks, allowing for more efficient and scalable AI deployments. Recently, Re -parameterization has emerged as a promising technique to enhance model performance while simultaneously alleviating the computational burden in various computer vision tasks. However, the accuracy drops significantly when applying quantization on the re -parameterized networks. We identify that the primary challenge arises from the large variation in weight distribution across the original branches. To address this issue, we propose a coarse & fine weight splitting (CFWS) method to reduce quantization error of weight, and develop an improved KL metric to determine optimal quantization scales for activation. To the best of our knowledge, our approach is the first work that enables post -training quantization applicable on re -parameterized networks. For example, the quantized RepVGG-A1 model exhibits a mere 0.3% accuracy loss. The code is in https: //github.com/NeonHo/Coarse-Fine-Weight-Split.git
Keyword:
PTQ
CNN
Quantization
期刊
IF:
4.1
论文数:
3.0K
被引数:
4.2K
机构
查看更多机构
引用论文
Candidate .gamma.-Secretases in the Generation of the Carboxyl Terminus of the Alzheimer's Disease .beta.A4 Amyloid: Possible Involvement of Cathepsin D候选人。Γ-分泌酶在阿尔茨海默氏病羧基末端的产生。Β.A4淀粉样蛋白: 组织蛋白酶D可能参与.png)
Biochemistry
BiochemistryIF0
PREAI
分享收藏
分享收藏 没有更多内容