arrow
返回

Efficient Feature Relation Learning Network for Cross-Spectral Image Patch Matching

delete2023-01-01
delete3
PRE
AI
C
Chuang Yu
J
Jinmiao Zhao
Y
Yunpeng Liu *
S
Shuhang Wu
C
Chenxi Li
DOI:10.1109/TGRS.2023.3290074delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Recently, cross-spectral image patch matching methods based on feature difference aggregation have achieved excellent performance, but they introduce a large number of parameters, limit matching speed, and have poor scalability. At the same time, only using feature difference learning (FD) to extract differential features will lead to the loss of consistent features between cross-spectral image patches. Therefore, we construct a novel four-branch efficient feature relation learning network (EFR-Net) without feature difference aggregation. Specifically, a new four-branch feature relation learning strategy is proposed, which reasonably combines multiple feature relation learning to comprehensively and effectively extract the differential features and consistent features between image patches. At the same time, we construct an efficient local attention (ELA) module with negligible parameters, which can learn some global context information, enhance the interaction of local information, and promote the extraction of discriminative features. In addition, a combined metric network is introduced to facilitate network optimization and improve network generalization. Furthermore, a public optical and synthetic aperture radar (SAR) image patch matching dataset with a patch size of 64 x 64 pixels is constructed based on the OS dataset, which is called the OS patch dataset. We also establish an experimental benchmark on this new dataset. Extensive experimental results show that the proposed EFR-Net achieves excellent performance on cross-spectral image patch matching (OS patch dataset, VIS-NIR patch dataset) and single spectral image patch matching (Brown dataset).
Keyword:
Combined metric network
cross-spectral image patch matching
efficient local attention (ELA) module
four-branch feature relation learning

期刊

IEEE Transactions on Geoscience and Remote Sensing 封面图
IEEE Transactions on Geoscience and Remote Sensing
IF:
8.6
论文数:
2.2W
被引数:
10.7W

机构

C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

Cross-Spectral Local Descriptors via Quadruplet Network
errSENSORS
IF3.5
err2017-04-15
err31
errOAAI
errAguilera, Cristhian A.; Sappa, Angel D.; Aguilera, Cristhian; Toledo, Ricardo
err分享
err收藏
Element-Wise Feature Relation Learning Network for Cross-Spectral Image Patch Matching
err2022-08-01
err11
PREAI
errQuan, Dou; Wang, Shuang; Huyan, Ning; Chanussot, Jocelyn; Wang, Ruojing; Liang, Xuefeng; Hou, Biao; Jiao, Licheng
err分享
err收藏
学者 查看更多内容