arrow
Return

Two-phase collaborative model compression training for joint pruning and quantization

delete2025-12-23
delete0
PRE
AI
C
Chunxiao Fan
J
Jintao Li
Z
Zhongqian Zhang
F
Fu Li
B
Bo Wang
DOI:10.1016/j.neunet.2025.108506delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
• We propose a unified collaborative model compression training to integrate pruning, quantization and performance objectives, balancing complexity reduction and precision loss in training. • A novel constraint function combining sparse regularization and quantization error enables automated pruning and efficient quantization, improving accuracy and hardware efficiency. • Our two-step training based on pre-trained networks jointly optimizes pruning and quantization, avoiding error accumulation and achieving better compression efficiency and model performance.

Journal

Neural Networks cover
Neural Networks
IF:
6.3
Papers:
8.2K
Citations:
3.0W

Organization

I
iflytek co. ltd.
Scholars:
1
Papers: 1
Citations: 0
X
xidian university
Scholars:
6.6K
Papers: 2.2K
Citations: 0
H
Hefei University of Technology
Scholars:
6.2K
Papers: 2.0K
Citations: 2.1W
researcher View more organizations
Cited Papers

Cited Papers

Filter Pruning Without Damaging Networks Capacity
err2020-01-01
err15
errOAAI
errZuo, Yuding; Chen, Bo; Shi, Te; Sun, Mengfan
errShare
errSave
ADFQ-ViT: Activation-Distribution-Friendly post-training Quantization for Vision Transformers
err2025-06-01
err0
PREAI
errJiang, Yanfeng; Sun, Ning; Xie, Xueshuo; Yang, Fei; Li, Tao
errShare
errSave
errShare
errSave
Cross-layer importance evaluation for neural network pruning
err2024-11-01
err1
PREAI
errLian, Youzao; Peng, Peng; Jiang, Kai; Xu, Weisheng
errShare
errSave
errShare
errSave
researcher View more