.png){kind=icon}
返回
Second-Order Response Transform Attention Network for Image Classification
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2019.2936446.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Embedding second-order operations into deep convolutional neural networks (CNNs) has recently shown impressive performance for a number of vision tasks. Specifically, the two-branch second-order response transform (SoRT) network introduces the element-wise product transform into intermediate layers of CNNs, which facilitates the cross-branch response propagation and achieves promising classification accuracy. However, it fails to adaptively rescale responses of feature maps and largely changes the topology of the original backbone networks, leading to the limitation of generalizability. In order to overcome above problems, we propose a novel Second-order Response Transform Attention Network (SoRTA-Net) for classification tasks. The core of SoRTA-Net is the designed refined second-order response transform (RSoRT) module integrating reasonably the attention Squeeze-and-Excitation (SE) block and second-order response transform. Firstly, SoRTA-Net recalibrates adaptively feature responses by the SE block, and then the outputs are sequentially passed through the second-order response transform block, capturing approximately co-occurrence statistics and providing more nonlinearity. Finally, a shortcut branch is naturally combined with the output of the module to boost propagation. The proposed RSoRT module can be flexibly inserted into existing CNNs without any modification of network topology. Our SoRTA-Net extensively evaluated on three datasets (CIFAR-10, CIFAR-100, and SVHN). The experiments have shown that SoRTA-Net is superior to its baseline and achieves competitive performance.
Keyword:
Second-order response transform
attention mechanism
convolutional neural network
image classification
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
.png){kind=icon}
Contamination of Rivers and Water Reservoirs in and Around Addis Ababa City and Actions to Combat ItOAAI
OAAI分享收藏Exergoeconomic performance of an endoreversible Carnot heat pump with complex heat transfer law
PREAI
分享收藏Structural study of lanthanides(III) in aqueous nitrate and chloride solutions by EXAFS通过EXAFS对硝酸盐和氯化物水溶液中镧系元素 (III) 的结构研究
PREAI
分享收藏
查看更多内容