arrow
返回

TransMIN: Transformer-Guided Multi-Interaction Network for Remote Sensing Object Detection

delete2023-01-01
delete12
PRE
AI
G
Guangming Xu
T
Tiecheng Song *
X
Xia Sun
高陈强 封面图
高陈强 (Chenqiang Gao)
DOI:10.1109/LGRS.2022.3230973delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Remote sensing (RS) object detectors based on convolutional neural networks (CNNs) are hard to model global context dependencies. Transformer-based detectors can overcome this problem via global pairwise interactions, but more comprehensive information interactions are not systemically investigated to boost the detection performance. In view of this issue, we propose a transformer-guided multi-interaction network (TransMIN), which uses ResNet50-feature pyramid network (FPN) as the backbone for remote sensing object detection (RSOD). Specifically, we implement local-global feature interactions (LGFIs) by combining convolution and transformer in the residual blocks of ResNet50 to learn complementary features. We implement cross-view feature interactions (CVFIs) via transformers in the pyramid layers of FPN to capture the correlation between reference features (spatial edge priors and channel statistics) and pyramid features. This enhances edge information and suppresses background interference. In the detection head, we adopt a task-interactive sample assigner (TISA) by considering the interactions of classification and localization losses to obtain high-quality predictions. Experiments on two benchmark datasets demonstrate the superior detection performance of TransMIN over state-of-the-art methods.
Keyword:
Feature extraction
Transformers
Task analysis
Image edge detection
Head
Convolution
Location awareness
Convolutional neural networks (CNNs)
object detection
remote sensing (RS)
transformer

期刊

IEEE Geoscience and Remote Sensing Magazine 封面图
IEEE Geoscience and Remote Sensing Magazine
IF:
16.4
论文数:
1.0W
被引数:
5.1K

机构

C
chongqing university of posts & telecommunications
学者数:
6.7K
论文数: 5.3K
被引数: 5
C
Chongqing Institute of Engineering
学者数:
87
论文数: 82
被引数: 0
引用论文

引用论文

Frontiers in spin-polarized tunneling
err2010-04-01
err0
PREAI
errJagadeesh S. Moodera; Guo-Xing Miao; Tiffany S. Santos
err分享
err收藏
学者 查看更多内容