Return
Improving data-free quantization with confidence-guided data synthesis
DOI:10.1016/j.icte.2026.03.021.png)
Abstract
En 中文
Data-Free Quantization (DFQ) enables model quantization without real data. Therefore, the accuracy of DFQ is largely affected by generated samples. However, we find that confidence distributions predicted from full-precision model over real and synthetic samples are significantly dissimilar, and this distribution discrepancy undermines quantization accuracy. To resolve this, we present an entropy regularization during synthetic data generation to make it resemble to real one much more. Furthermore, we propose Scaled Logit Alignment during quantization-aware training to bridge the representational gap between models. Our method achieves superior performance compared to the recent DFQ methods on ViT, CNN, and object detector architectures.
Keywords:
Data-free quantization
Zero-shot quantization
Model quantization
Model compression
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

