.png){kind=icon}
.png){kind=icon}
Return
Direction-Guided Multiscale Feature Fusion Network for Geo-Localization
.png){kind=icon}
PRE
AI
DOI：10.1109/TGRS.2024.3396912.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Cross-view geo-localization has been widely used as an important technique for determining the geographical location of unmanned aerial vehicles (UAVs). Despite various image retrieval methods proposed, drone and satellite image cross-view geo-localization still remain challenging due to their wildly inconsistent view angles. In this article, we propose a new framework, the Swin-radial-locality network (SRLN), to extract robust image feature representations. Specifically, SRLN is based on a pruned version of the Swin transformer, which integrates multiscale feature aggregation within a Siamese network structure, featuring shared weights and equipped with multiclassification heads. SRLN is mainly comprised of a radial-slicer-network (RSN) and a local-pattern-network (LPN), which is designed to effectively harmonize directional information from drone-captured images and broader environmental features from satellite imagery, crucial for capturing angle and feature details between drone and satellite images. The RSN part focuses on capturing fine-grained features that represent the drone's directional information, while the LPN is utilized for a more comprehensive analysis of broader environmental features. Extensive experiments are carried out on widely used public benchmark datasets, i.e., University-1652 and SUES-200. With more than 3% improvement over existing methods in both drone-view target localization tasks and drone navigation applications, the results validate the superior performance of our multiscale feature fusion model, achieving a state-of-the-art performance record.
Keywords:
Transformers
Feature extraction
Autonomous aerial vehicles
Location awareness
Drones
Visualization
Task analysis
Cross-view geo-localization
local pattern network
multiscale image processing
radial slicer network (RSN)
Swin transformer
unmanned aerial vehicle (UAV) image localization
Journal
IF:
8.6
Papers:
2.1W
Citations:
10.7W