arrow
返回

Energy-Based CNN Pruning for Remote Sensing Scene Classification

delete2023-01-01
delete13
PRE
AI
芦
芦毅衡 (Yiheng Lu)
M
Maoguo Gong *
Z
Zhuping Hu
赵
赵巍 (Wei Zhao)
Z
Ziyu Guan
M
Mingyang Zhang
DOI:10.1109/TGRS.2023.3277077delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Convolutional neural networks (CNNs) have been adopted to classify the remote sensing scene image. However, the application of these complicated networks on the satellite platform is difficult because of the limited computation resources. Therefore, we propose an energy-based filter pruning framework (EFPF) to reduce the size of the original model. The energy can be obtained through the eigenvalues of each weight tensor by singular value decomposition (SVD). Specifically, we calculate the energy of each layer by the ratio of eigenvalues that are lower than a specified truncation parameter and then remove filters from the original layer in light of the degree of energy. The EFPF is reliable, because SVD techniques can capture the covariance among all filters from the original weight tensor, and therefore, the energy from the eigenvalues can reflect the redundancy of the filters (i.e., if the distribution of eigenvalues is sharp, then the energy among filters will be lower, and the redundancy will be higher). Surprisingly, the EFPF can reduce the floating point operations (FLOPs) and parameters, as well as improve the top1 accuracy obviously when the VGG-16 and ResNet-50 are adopted to classify the AID, NWPU45, PatternNet, and WHU19 datasets. Additionally, the EFPF can achieve similar pruning results when the original model is fully trained (converge) and undertrained (In-converge), which means that we can save the training computation resources for the original model.
Keyword:
Eigenvalues and eigenfunctions
Remote sensing
Computational modeling
Tensors
Redundancy
Satellites
Computer architecture
Convolutional neural network (CNN)
energy-based
filter pruning
remote sensing scene image classification

期刊

IEEE Transactions on Geoscience and Remote Sensing 封面图
IEEE Transactions on Geoscience and Remote Sensing
IF:
8.6
论文数:
2.2W
被引数:
10.7W

机构

M
ministry of education - china
学者数:
2.5W
论文数: 1.0W
被引数: 13
引用论文

引用论文

Self-Supervised GlobalLocal Contrastive Learning for Fine-Grained Change Detection in VHR Images
err2023-01-01
err26
PREAI
errJiang, Fenlong; Gong, Maoguo; Zheng, Hanhong; Liu, Tongfei; Zhang, Mingyang; Liu, Jialu
err分享
err收藏
Searching for CNN Architectures for Remote Sensing Scene Classification
err2022-01-01
err30
PREAI
errBroni-Bediako, Clifford; Murata, Yuki; Mormille, Luiz H. B.; Atsumi, Masayasu
err分享
err收藏
err分享
err收藏
Deep Learning for Hyperspectral Image Classification: An Overview用于高光谱图像分类的深度学习: 综述
err2019-09-01
err1.3K
errOAAI
errLi, Shutao; Song, Weiwei; Fang, Leyuan; Chen, Yushi; Ghamisi, Pedram; Benediktsson, Jon Atli
err分享
err收藏
Skip-Connected Covariance Network for Remote Sensing Scene Classification
err2020-05-01
err186
PREAI
errHe, Nanjun; Fang, Leyuan; Li, Shutao; Plaza, Javier; Plaza, Antonio
err分享
err收藏
Taking the Human Out of the Loop: A Review of Bayesian Optimization将人类带出循环: 贝叶斯优化的回顾
err2016-01-01
err3.5K
PREAI
errShahriari, Bobak; Swersky, Kevin; Wang, Ziyu; Adams, Ryan P.; de Freitas, Nando
err分享
err收藏
学者 查看更多内容