arrow
Return

MStrans: Multiscale Vision Transformer for Aerial Objects Detection

delete2022-01-01
delete1
delete
OA
AI
G
Guanlin Lu
赫晓慧 (Xiaohui He) *
王强 (Qiang Wang)
F
Faming Shao
J
Jinkang Wang
L
Likai Hao
DOI:10.1109/ACCESS.2022.3190415delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Detecting objects in aerial images is a challenging task due to the large-scale variations and arbitrary orientations with tiny instances. A new multi-scale transformer-based aerial objects detector called MStrans is proposed in this paper to deal with the challenges in aerial detection. To detect remote instances, MStrans adopts a multi-scale patch embedding transformer (MViT) to extract the global features of the image effectively. Furthermore, to capture the different discriminant features for classification and regression branch tasks, the partial interactive fusion module (PIFM) is designed to enhance the semantic expression of the key features of classification and regression tasks by using the strategy of interactive modeling of adjacent layer features. In addition, considering that the transformer may worsen the local feature details while capturing long-distance feature dependencies, this paper designs a global to local interactive fusion module (GLIFM). It uses the advantage of convolution to extract local features to enrich the detailed information in the transformer. Experiments were carried out on DOTA and DIOR datasets, and the MStrans achieves superior detection performances compared with other approaches.
Keywords:
Object detection
Transformers
Feature extraction
Task analysis
Detectors
Convolution
Autonomous aerial vehicles
Aerial object detection
deep learning
multiscale object detection
transformer
CNN

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

A
Army Engineering University of PLA
Scholars:
5.0K
Papers: 3.7K
Citations: 5