arrow
返回

Filter-based deep-compression with global average pooling for convolutional networks

delete2019-05-01
delete85
PRE
AI
T
Ting-Yun Hsiao
Y
Yung-Chang Chang
H
Hsin‐Hung Chou
C
Ching‐Te Chiu *
DOI:10.1016/j.sysarc.2019.02.008delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Deep neural networks are powerful, but using these networks is both memory and time consuming due to their numerous parameters and large amounts of computation. Many studies have been conducted on compressing the models on the parameter-level as well as on the bit-level. Here, we propose an efficient strategy to compress on the layers that are computation or memory consuming. We compress the model by introducing global average pooling, performing iterative pruning on the filters with the proposed order-deciding scheme in order to prune more efficiently, applying truncated SVD to the fully-connected layer, and performing quantization. Experiments on the VGG16 model show that our approach achieves a 60.9 x compression ratio in off-line storage with about 0.848% and 0.1378% loss of accuracy in the top-1 and top-5 classification results, respectively, with the validation dataset of ILSVRC2012. Our approach also shows good compression results on AlexNet and faster R-CNN.
Keyword:
Deep convolutional model compression
Global average pooling (GAP)
Pruning
Truncated SVD
Quantization
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Journal of Systems Architecture 封面图
Journal of Systems Architecture
IF:
4.1
论文数:
3.0K
被引数:
4.2K

机构

N
National Tsing Hua University
学者数:
1.6W
论文数: 1.4W
被引数: 1.7W
引用论文

引用论文

“It was difficult to offer same day results”: evaluation of community-based point-of-care testing for sexually transmitted infections among youth using the GeneXpert platform in Zimbabwe
err2022-02-10
err0
errOAAI
errKevin Martin; Chido Dziva Chikwari; Constance R. S. Mackworth-Young; Mutsawashe Chisenga; Tsitsi Bandason; Ethel Dauya; Ioana D. Olaru; Suzanna C. Francis; Constancia Mavodza; Portia Nzombe; Rangarirayi Nyamwanza; Fadzanai Hove; Maureen Tshuma; Anna Machiha; Katharina Kranzer; Rashida A. Ferrand
err分享
err收藏
ImageNet Large Scale Visual Recognition ChallengeImageNet大规模视觉识别挑战
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
err分享
err收藏
X-ray studies of thallium chalcogenides TIS and TISe up to 37 GPa
err1988-07-16
err0
PREAI
errG. B. Demishev; S. S. Kabalkina; T. N. Kolobyanina
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏