.png){kind=icon}
返回
Binary Weight Multibit Activation Quantization for Compute-in-Memory CNN Accelerators
.png){kind=icon}
PRE
AI
DOI：10.1109/TCAD.2025.3595830.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
compute-in-memory (CIM) accelerators have emerged as a promising way for enhancing the energy efficiency of convolutional neural networks (CNNs). Deploying CNNs on CIM platforms generally requires quantization of network weights and activations to meet hardware constraints. However, existing approaches either prioritize hardware efficiency with binary weight and activation quantization at the cost of accuracy, or utilize multibit weights and activations for greater accuracy but limited efficiency. In this article, we introduce a novel binary weight multibit activation (BWMA) method for CNNs on CIM-based accelerators. Our contributions include: deriving closed-form solutions for weight quantization in each layer, significantly improving the representational capabilities of binarized weights; and developing a differentiable function for activation quantization, approximating the ideal multibit function while bypassing the extensive search for optimal settings. Through comprehensive experiments on CIFAR-10 and ImageNet datasets, we show that BWMA achieves notable accuracy improvements over existing methods, registering gains of 1.44%–5.46% and 0.35%–5.37% on respective datasets. Moreover, hardware simulation results indicate that 4-bit activation quantization strikes the optimal balance between hardware cost and model performance.
Keyword:
compute-in-memory (CIM)
ferroelectric field-effect transistor (FeFET)
model quantization
resistive random-access memory (RRAM)
static random-access memory (SRAM)
期刊
I
IF:
2.9
论文数:
671
被引数:
9.6K
机构
引用论文
.png){kind=icon}
CiM-BNN:Computing-in-MRAM Architecture for Stochastic Computing Based Bayesian Neural NetworkCim-bnn: 基于贝叶斯神经网络的随机计算的MRAM计算体系结构
PREAI
分享收藏
分享收藏分享收藏
查看更多内容