arrow
返回

Frequency Regulated Channel-Spatial Attention module for improved image classification

delete2025-01-01
delete0
PRE
AI
C
Chengyuan Zhuang
袁晓辉 封面图
袁晓辉 (Xiaohui Yuan) *
谷
谷立川 (Lichuan Gu)
Z
Zhenchun Wei
樊
樊玉琦 (Yuqi Fan)
X
Xuan Guo
DOI:10.1016/j.eswa.2024.125463delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Convolutional neural networks play a vital role in image classification, with attention mechanisms enhancing discriminability on large datasets like ImageNet. However, challenges persist in optimizing performance for smaller or moderate real-world datasets due to limited data availability. There is a deficiency in effectively leveraging both channel and spatial attention for enhanced effectiveness in such scenarios. Although predefined filters offer advantages, their integration with attention mechanisms for complementary strength remains under-explored. In this paper, we propose the Frequency Regulated Channel-Spatial Attention (FReCSA) module to address this challenge by leveraging the power of channel attention and spatial attention. Four subsets and the complete ImageNet dataset, along with five additional datasets are used to evaluate FReCSA in our experiments. Integrating the FReCSA module into ResNet50 significantly enhances the top-1 accuracy, which is demonstrated by a 10.13% increase over the second-best on the ImageNet-40 dataset. On the other hand, our FReCSA module introduces minimal computational and parameter overhead to the deep network in terms of model size and computational operations, which makes FReCSA a good choice for learning tasks. The source code of this work is available at https://github.com/CoVIS-UNT/FReCSA.
Keyword:
Classification
Attention
Regularization
Filter

期刊

Expert Systems with Applications 封面图
Expert Systems with Applications
IF:
7.5
论文数:
3.0W
被引数:
10.2W

机构

A
Anhui Agricultural University
学者数:
1.2W
论文数: 5.7K
被引数: 1.0W
H
hefei university of technology
学者数:
2.5W
论文数: 1.7W
被引数: 35
U
University of North Texas System
学者数:
8.1K
论文数: 7.7K
被引数: 178
学者 查看更多机构
引用论文

引用论文

Visual attention methods in deep learning: An in-depth survey深度学习中的视觉注意方法: 深度调查
err2024-08-01
err18
errOAAI
errHassanin, Mohammed; Anwar, Saeed; Radwan, Ibrahim; Khan, Fahad Shahbaz; Mian, Ajmal
err分享
err收藏
A survey on deep learning tools dealing with data scarcity: definitions, challenges, solutions, tips, and applications关于处理数据稀缺的深度学习工具的调查: 定义,挑战,解决方案,技巧和应用
err2023-04-14
err196
errOAAI
errAlzubaidi, Laith; Bai, Jinshuai; Al-Sabaawi, Aiman; Santamaria, Jose; Albahri, A. S.; Al-dabbagh, Bashar Sami Nayyef; Fadhel, Mohammed. A. A.; Manoufali, Mohamed; Zhang, Jinglan; Al-Timemy, Ali. H. H.; Duan, Ye; Abdullah, Amjed; Farhan, Laith; Lu, Yi; Gupta, Ashish; Albu, Felix; Abbosh, Amin; Gu, Yuantong
err分享
err收藏
PCFNet: Deep neural network with predefined convolutional filters
err2020-03-01
err13
PREAI
errMa, Yangling; Luo, Yixin; Yang, Zhouwang
err分享
err收藏
ImageNet Large Scale Visual Recognition ChallengeImageNet大规模视觉识别挑战
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
err分享
err收藏
学者 查看更多内容