arrow
返回

SFRNet: Fine-Grained Oriented Object Recognition via Separate Feature Refinement

delete2023-01-01
delete60
PRE
AI
G
Gong Cheng
Q
Qingyang Li
王光兴 封面图
王光兴 (Guangxing Wang)
X
Xingxing Xie
L
Lingtong Min *
J
Junwei Han
DOI:10.1109/TGRS.2023.3277626delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Fine-grained oriented object recognition (FGO(2)R) is a practical need for intellectually interpreting remote sensing images. It aims at realizing fine-grained classification and precise localization with oriented bounding boxes, simultaneously. Our considerations for the task are general but decisive: 1) the extraction of subtle differences carries a big weight in differentiating fine-grained classes and 2) oriented localization prefers rotation-sensitive features. In this article, we propose a network with separate feature refinement (SFRNet), in which two transformer-based branches are designed to perform function specific feature refinement for fine-grained classification and oriented localization, separately. To highlight the discriminative information advantageous to fine-grained classification, we propose a spatial and channel transformer (SC-Former) to capture both the long-range spatial interactions and the key correlations hidden in the feature channels. Besides, we design a multi region of interest (RoI) loss (MRL) following the protocol of deep metric learning to enhance the separability of finegrained classes further. For oriented localization, we integrate the oriented response convolution with the transformer structure (namely, OR-Former) to assist in encoding rotation information during regression. Extensive experimental results validate the effectiveness and robustness of our SFRNet. Without bells and whistles, our SFRNet achieves the state-of-the-art performance on the large-scale FAIR1M datasets (FAIR1M-1.0 and FAIR1M-2.0). Code will be available at https://github.com/Ranchosky/SFRNet.
Keyword:
Transformers
Location awareness
Remote sensing
Object detection
Feature extraction
Encoding
Detectors
Deep metric learning
fine-grained classification
oriented object detection
vision transformer

期刊

IEEE Transactions on Geoscience and Remote Sensing 封面图
IEEE Transactions on Geoscience and Remote Sensing
IF:
8.6
论文数:
2.1W
被引数:
10.7W

机构

N
Northwestern Polytechnical University
学者数:
4.6W
论文数: 3.7W
被引数: 5.3W
引用论文

引用论文

Impurity effects on ionic-liquid-based supercapacitors
err2016-12-27
err0
errOAAI
errKun Liu; Cheng Lian; Douglas Henderson; Jianzhong Wu
err分享
err收藏
Revealing influencing factors on global waste distribution via deep-learning based dumpsite detection from satellite imagery
err2023-03-15
err36
errOAAI
errSun, Xian; Yin, Dongshuo; Qin, Fei; Yu, Hongfeng; Lu, Wanxuan; Yao, Fanglong; He, Qibin; Huang, Xingliang; Yan, Zhiyuan; Wang, Peijin; Deng, Chubo; Liu, Nayu; Yang, Yiran; Liang, Wei; Wang, Ruiping; Wang, Cheng; Yokoya, Naoto; Haensch, Ronny; Fu, Kun
err分享
err收藏
On Improving Bounding Box Representations for Oriented Object Detection关于改进面向对象检测的边界框表示
err2023-01-01
err86
PREAI
errYao, Yanqing; Cheng, Gong; Wang, Guangxing; Li, Shengyang; Zhou, Peicheng; Xie, Xingxing; Han, Junwei
err分享
err收藏
学者 查看更多内容