arrow
返回

AutoPruner: An end-to-end trainable filter pruning method for efficient deep model inference

delete2020-11-01
delete112
delete
OA
AI
J
Jian-Hao Luo
吴
吴建鑫 (Jianxin Wu) *
DOI:10.1016/j.patcog.2020.107461delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Channel pruning is an important method to speed up CNN model's inference. Previous filter pruning algorithms regard importance evaluation and model fine-tuning as two independent steps. This paper argues that combining them into a single end-to-end trainable system will lead to better results. We propose an efficient channel selection layer, namely AutoPruner, to find less important filters automatically in a joint training manner. Our AutoPruner takes previous activation responses as an input and generates a true binary index code for pruning. Hence, all the filters corresponding to zero index values can be removed safely after training. By gradually erasing several unimportant filters, we can prevent an excessive drop in model accuracy. Compared with previous state-of-the-art pruning algorithms (including training from scratch), AutoPruner achieves significantly better performance. Furthermore, ablation experiments show that the proposed novel mini-batch pooling and binarization operations are vital for the success of model pruning. (C) 2020 Elsevier Ltd. All rights reserved.
Keyword:
Neural network pruning
Model compression
CNN acceleration
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Pattern Recognition 封面图
Pattern Recognition
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

N
nanjing university
学者数:
7.8W
论文数: 5.6W
被引数: 87
引用论文

引用论文

err分享
err收藏
Building fast and compact convolutional neural networks for offline handwritten Chinese character recognition
err2017-12-01
err125
errOAAI
errXiao, Xuefeng; Jin, Lianwen; Yang, Yafeng; Yang, Weixin; Sun, Jun; Chang, Tianhai
err分享
err收藏
ImageNet Large Scale Visual Recognition ChallengeImageNet大规模视觉识别挑战
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
The Pascal Visual Object Classes (VOC) ChallengePascal视觉对象课程 (VOC) 挑战
err2009-09-09
err9.0K
PREAI
errEveringham, Mark; Van Gool, Luc; Williams, Christopher K. I.; Winn, John; Zisserman, Andrew
err分享
err收藏
Targeted Deletion of the Cytosolic Domain of Tissue Factor in Mice Does Not Affect Development
err2001-08-01
err0
PREAI
errEls Melis; Lieve Moons; Maria De Mol; Jean-Marc Herbert; Nigel Mackman; Désiré Collen; Peter Carmeliet; Mieke Dewerchin
err分享
err收藏
Canceling Inaudible Voice Commands Against Voice Control Systems
err2019-10-11
err0
PREAI
errYitao He; Junyu Bian; Xinyu Tong; Zihui Qian; Wei Zhu; Xiaohua Tian; Xinbing Wang
err分享
err收藏
Recent advances in radiotherapy for soft-tissue sarcoma
err2003-08-01
err0
PREAI
errBrian O’sullivan; Iain Ward; Charles Catton
err分享
err收藏
没有更多内容