arrow
Return

Progressive Local Filter Pruning for Image Retrieval Acceleration

delete2023-01-01
delete17
delete
OA
AI
王晓栋 cover
王晓栋 (Xiaodong Wang)
Z
Zhedong Zheng
Y
Yang He
F
Fei Yan
Z
Zhiqiang Zeng *
Y
Yi Yang
DOI:10.1109/TMM.2023.3256092delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Most image retrieval works aim at learning discriminative visual features, while little attention is paid to the retrieval efficiency. The speed of feature extraction is key to the real-world system. Therefore, in this article, we focus on network pruning for image retrieval acceleration. Different from the classification models predicting discrete categories, image retrieval models usually extract continuous features for retrieval, which are more sensitive to network pruning. Such different characteristics of the retrieval and classification models make the traditional pruning method sub-optimal for image retrieval acceleration. Two points are critical for pruning image retrieval models: preserving the local geometry structure of filters and maintaining the model capacity during pruning. In view of the above considerations, we propose a Progressive Local Filter Pruning (PLFP) method. Specifically, we analyze the local geometry of filter distribution in every layer and select redundant filters according to one new criterion that the filter can be replaced locally by other similar filters. Furthermore, to preserve the model capacity of the original model, the proposed method progressively prune the filter by decreasing the scale of filter weights gradually. We evaluate our method on four scene retrieval datasets, i.e., Oxford5K, Oxford105K, Paris6K, and Paris106K, and one person re-identification dataset, i.e., Market-1501. Extensive experiments show that the proposed method (1) preserves the original model capacity while pruning (2) and achieves superior performance to other widely-used pruning methods.
Keywords:
Image retrieval
Information filters
Geometry
Computational modeling
Feature extraction
Convolutional neural networks
Training
Deep learning
image retrieval
local geometry
network pruning
person re-identification

Journal

IEEE Transactions on Multimedia cover
IEEE Transactions on Multimedia
IF:
9.7
Papers:
4.5K
Citations:
2.4W

Organization

U
university of technology sydney
Scholars:
1.6W
Papers: 2.0W
Citations: 25
A
agency for science technology & research (a*star)
Scholars:
2.2W
Papers: 1.9W
Citations: 57
X
Xiamen University of Technology
Scholars:
3.9K
Papers: 2.5K
Citations: 5.1K
researcher View more organizations
Cited Papers

Cited Papers

Proteomic analysis of ACTN4-interacting proteins reveals it’s a putative involvement in mRNA metabolism
err2010-06-01
err0
PREAI
errMikhail Khotin; Lidia Turoverova; Vasilisa Aksenova; Nikolai Barlev; Veronika Viktorija Borutinskaite; Alexander Vener; Olga Bajenova; Karl-Eric Magnusson; George P. Pinaev; Dmitri Tentler
errShare
errSave
errShare
errSave
Multi-level Similarity Perception Network for Person Re-identification
err2019-06-05
err9
PREAI
errShen, Chen; Jin, Zhongming; Chu, Wenqing; Jiang, Rongxin; Chen, Yaowu; Qi, Guo-Jun; Hua, Xian-Sheng
errShare
errSave
Calcium-modulating cyclophilin ligand regulates membrane trafficking of postsynaptic GABAA receptors
err2008-06-01
err0
errOAAI
errXu Yuan; Jun Yao; David Norris; David D. Tran; Richard J. Bram; Gong Chen; Bernhard Luscher
errShare
errSave
Living With Genetic Test Results for Hereditary Breast and Ovarian Cancer
err2009-08-28
err0
errOAAI
errRebekah Hamilton; Janet K. Williams; Heather Skirton; Barbara J. Bowers
errShare
errSave
errShare
errSave
Major Adverse Limb Events and Mortality in Patients With Peripheral Artery Disease
err2018-05-01
err0
errOAAI
errSonia S. Anand; Francois Caron; John W. Eikelboom; Jackie Bosch; Leanne Dyal; Victor Aboyans; Maria Teresa Abola; Kelley R.H. Branch; Katalin Keltai; Deepak L. Bhatt; Peter Verhamme; Keith A.A. Fox; Nancy Cook-Bruns; Vivian Lanius; Stuart J. Connolly; Salim Yusuf
errShare
errSave
researcher View more