arrow
Return

Improving data-free quantization with confidence-guided data synthesis

delete2026-04-16
delete0
delete
OA
AI
D
Deok-Woong Kim
S
Seung‐Hwan Bae *
DOI:10.1016/j.icte.2026.03.021delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Data-Free Quantization (DFQ) enables model quantization without real data. Therefore, the accuracy of DFQ is largely affected by generated samples. However, we find that confidence distributions predicted from full-precision model over real and synthetic samples are significantly dissimilar, and this distribution discrepancy undermines quantization accuracy. To resolve this, we present an entropy regularization during synthetic data generation to make it resemble to real one much more. Furthermore, we propose Scaled Logit Alignment during quantization-aware training to bridge the representational gap between models. Our method achieves superior performance compared to the recent DFQ methods on ViT, CNN, and object detector architectures.
Keywords:
Data-free quantization
Zero-shot quantization
Model quantization
Model compression
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

ICT Express cover
ICT Express
IF:
4.2
Papers:
990
Citations:
2.5K

Organization

No organization information available