arrow
返回

Soft independence guided filter pruning

delete2024-09-01
delete0
PRE
AI
刘
刘洋 (Yang Liu)
S
Shiqiao Gu
C
Chenyang Shen
X
Xi-Le Zhao
胡清华 封面图
胡清华 (Qinghua Hu) *
DOI:10.1016/j.patcog.2024.110488delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
Filter pruning (FP) is an effective method for reducing the computational costs of convolutional neural networks, and herein, the most critical task involves evaluating the significance of each convolutional filter and eliminating the less important ones while minimizing performance degradation. Most existing FP methods consider only local information, which may prevent them from accurately recognizing the most important filters. To address this limitation, we propose the soft filter independence (SFI) method, which leverages global information to identify the most important filters using their magnitude and correlation information in different functional layers. The SFI criterion measures the replaceability of filters from a global perspective in a network. Filters with low independence can be represented effectively by others, so their information can be accurately conveyed by other filters. In addition, we introduce a novel SFI-based asymptotic pruning ratio, which improves training and pruning stability. Compared to the most advanced FP methods, our method enables CNNs to achieve higher pruning rates and better classification performance.
Keyword:
Convolutional neural networks
Filter pruning
Filter independence

期刊

Pattern Recognition 封面图
Pattern Recognition
IF:
7.6
论文数:
1.4W
被引数:
4.9W

机构

T
Tianjin University
学者数:
6.5K
论文数: 1.8K
被引数: 4
U
university of texas system
学者数:
1.1K
论文数: 2.5K
被引数: 203
U
university of texas southwestern medical center dallas
学者数:
1.8W
论文数: 1.4W
被引数: 1.3W
学者 查看更多机构
引用论文

引用论文

Gabor filter bank with deep autoencoder based face recognition system
err2022-07-01
err51
PREAI
errHammouche, Rabah; Attia, Abdelouahab; Akhrouf, Samir; Akhtar, Zahid
err分享
err收藏
Major Adverse Limb Events and Mortality in Patients With Peripheral Artery Disease
err2018-05-01
err0
errOAAI
errSonia S. Anand; Francois Caron; John W. Eikelboom; Jackie Bosch; Leanne Dyal; Victor Aboyans; Maria Teresa Abola; Kelley R.H. Branch; Katalin Keltai; Deepak L. Bhatt; Peter Verhamme; Keith A.A. Fox; Nancy Cook-Bruns; Vivian Lanius; Stuart J. Connolly; Salim Yusuf
err分享
err收藏
Factors affecting epilepsy treatment outcomes in Nigeria
err2014-09-10
err0
errOAAI
errO. R. Obiako; T. L. Sheikh; J. A. Kehinde; E. U. Iwuozo; N. Ekele; C. C. Elonu; A. U. Amaechi; N. Hayatudeen
err分享
err收藏
A slice of π : An exploratory neuroimaging study of digit encoding and retrieval in a superior memorist
err2009-09-09
err0
errOAAI
errAmir Raz; Mark G. Packard; Gerianne M. Alexander; Jason T. Buhle; Hongtu Zhu; Shan Yu; Bradley S. Peterson
err分享
err收藏
err分享
err收藏
学者 查看更多内容