.png){kind=icon}
.png){kind=icon}
Return
Token-based dynamic bit-width assignment for ViT quantization
.png){kind=icon}
PRE
AI
DOI：10.1016/j.patcog.2025.112269.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
• We introduce a novel token-based dynamic bit-allocation method for ViT quantization that assigns bit-widths of individual tokens dynamically, including the class token, for each input instance. • We present a shifting quantizer, specially designed for post-GELU activations, that considers the asymmetric distribution across positive and negative values. • We demonstrate that our approach boosts the performance of the token-wise quantization scheme significantly, and show that it achieves a good compromise between efficiency and efficacy.
Keywords:
token-based dynamic bit-allocation
ViT quantization
shifting quantizer
post-GELU activations
efficiency and efficacy
Journal
IF:
7.6
Papers:
1.3W
Citations:
4.5W
Organization
No organization information available