.png){kind=icon}
返回
Easy Pruning via Coresets and Structural Re-Parameterization
.png){kind=icon}
PRE
AI
DOI：10.1109/LSP.2024.3419419.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Inference time pruning is characteristic in high construction efficiency, since it dramatically reduces the dependency on finetuning to recover precision. It is adequate to reconstruct compressed convolution kernels by optimizing the loss of feature map reconstruction. However, the accuracy decline of compressed network increases as the loss of feature map reconstruction accumulates layer by layer. To enhance layerwise convolution kernel reconstruction, this paper proposes a hybrid method via combining coresets theory and structural re-parameterization, enabling shallow transfer learning (STL) during inference time pruning. Firstly, our method achieves STL by implementing structural re-parameterization in the process of convolution kernel reconstruction, to adapt to effects of one layer's reconstruction loss on the next layers' inputs. Secondly, a channel-wise scaling process is designed on the basis of coresets theory, to enhance approximation in the mapping from drifted inputs to original feature maps. Selectively, a maximum mean discrepancy based decision-making process is built for switching in two patterns of our method. Tests are executed on image classification and arrhythmia detection. As observed on ImageNet datasets, coresets theory based scaling is more effective at filter level for DenseNet and MobileNet-v2 and resultful at unit kernel level for ResNet and SqueezeNet.
Keyword:
Channel pruning
coreset theory
structural re-parameterization
transfer learning
期刊
IF:
9.6
论文数:
1.1W
被引数:
1.7W
机构
暂无机构信息
引用论文
.png){kind=icon}
Calcium-modulating cyclophilin ligand regulates membrane trafficking of postsynaptic GABAA receptors
OAAI
OAAI分享收藏
查看更多内容