返回
SFRNet: Fine-Grained Oriented Object Recognition via Separate Feature Refinement
DOI:10.1109/TGRS.2023.3277626.png)
摘要
En 中文
Fine-grained oriented object recognition (FGO(2)R) is a practical need for intellectually interpreting remote sensing images. It aims at realizing fine-grained classification and precise localization with oriented bounding boxes, simultaneously. Our considerations for the task are general but decisive: 1) the extraction of subtle differences carries a big weight in differentiating fine-grained classes and 2) oriented localization prefers rotation-sensitive features. In this article, we propose a network with separate feature refinement (SFRNet), in which two transformer-based branches are designed to perform function specific feature refinement for fine-grained classification and oriented localization, separately. To highlight the discriminative information advantageous to fine-grained classification, we propose a spatial and channel transformer (SC-Former) to capture both the long-range spatial interactions and the key correlations hidden in the feature channels. Besides, we design a multi region of interest (RoI) loss (MRL) following the protocol of deep metric learning to enhance the separability of finegrained classes further. For oriented localization, we integrate the oriented response convolution with the transformer structure (namely, OR-Former) to assist in encoding rotation information during regression. Extensive experimental results validate the effectiveness and robustness of our SFRNet. Without bells and whistles, our SFRNet achieves the state-of-the-art performance on the large-scale FAIR1M datasets (FAIR1M-1.0 and FAIR1M-2.0). Code will be available at https://github.com/Ranchosky/SFRNet.
Keyword:
Transformers
Location awareness
Remote sensing
Object detection
Feature extraction
Encoding
Detectors
Deep metric learning
fine-grained classification
oriented object detection
vision transformer
期刊
IF:
8.6
论文数:
2.1W
被引数:
10.7W
机构
引用论文
Inflexibility of mental planning: A characteristic disorder with prefrontal lobe lesions?心理计划的僵化: 前额叶病变的特征性障碍?
Revealing influencing factors on global waste distribution via deep-learning based dumpsite detection from satellite imagery
NATURE COMMUNICATIONS
IF15.7
Instance-Aware Distillation for Efficient Object Detection in Remote Sensing Images用于遥感图像中有效目标检测的实例感知蒸馏
Thermal comfort, perceived air quality, and cognitive performance when personally controlled air movement is used by tropically acclimatized persons当热带适应的人使用个人控制的空气运动时,热舒适性,感知的空气质量和认知表现
Indoor Air
IF0

