.png){kind=icon}
.png){kind=icon}
Return
EMCA: Efficient Multiscale Channel Attention Module
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2022.3205602.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Attention mechanisms have been explored with CNNs across the spatial and channel dimensions. However, all the existing methods devote the attention modules to capture local interactions from a uni-scale. This paper tackles the following question: can one consolidate multi-scale aggregation while learning channel attention more efficiently? To this end, we avail channel-wise attention over multiple feature scales, which empirically shows its aptitude to replace the limited local and uni-scale attention modules. EMCA is lightweight and can efficiently model the global context further; it is easily integrated into any feed-forward CNN architectures and trained in an end-to-end fashion. We validate our novel architecture through comprehensive experiments on image classification, object detection, and instance segmentation with different backbones. Our experiments show consistent gains in performances against their counterparts, where our proposed module, named EMCA, outperforms other channel attention techniques in accuracy and latency trade-off. More specifically, compared to SENet, we boost the accuracy by 0.8 %, 0.6 %, and 1 % on ImageNet benchmark for ResNet-18, 34, and 50, respectively. For detection and segmentation tasks, MS-COCO are for benchmarking, Our EMCA module boost the accuracy by 0.5 % and 0.3 %, respectively. We also conduct experiments that probe the robustness of the learned representations. Our code will be published once the paper is accepted.
Keywords:
Feature extraction
Context modeling
Computer architecture
Channel estimation
Transformers
Image segmentation
Deep learning
Machine learning
Computer vision
Image processing
Classification algorithms
Channel attention module
deep learning
machine learning
computer vision
object classification
CNN backbones
CNN encoders
CNNs
convolutions
image processing
Journal
IF:
3.6
Papers:
9.8W
Citations:
29.4W