返回
Multi-level representation learning via ConvNeXt-based network for unaligned cross-view matching
DOI:10.1080/10095020.2024.2439385.png)
摘要
En 中文
Cross-view matching refers to the use of images from different platforms (e.g. drone and satellite views) to retrieve the most relevant images, where the key is that the viewpoints and spatial resolution. However, most of the existing methods focus on extracting fine-grained features and ignore the connection of contextual information in the image. Therefore, we propose a novel ConvNeXt-based multi-level representation learning model for the solution of this task. First, we extract global features through the ConvNeXt model. In order to obtain a joint part-based representation learning from the global features, we then replicated the obtained global features, operating one copy with spatial attention and the other copy using a standard convolutional operation. In addition, the features of different branches are aggregated through the multilevel feature fusion module to prepare for cross-view matching. Finally, we created a new hybrid loss function to better limit these features and assist in mining crucial data regarding global features. The experimental results indicate that we have achieved advanced performance on two common datasets, University-1652 and SUES-200 at 89.79% and 95.75% in drone target matching and 94.87% and 98.80 in drone navigation.
Keyword:
Cross-view matching
ConvNeXt
satellite view
drone view
multilevel feature
期刊
G
IF:
5.5
论文数:
864
被引数:
2.4K
机构
引用论文
A robust and accurate feature matching method for multi-modal geographic images spatial registration一种鲁棒且精确的多模态地理图像空间配准特征匹配方法
STCD: efficient Siamese transformers-based change detection method for remote sensing imagesSTCD: 基于Siamese transformers的遥感影像高效变化检测方法

