.png){kind=icon}
返回
Feature Interaction Learning Network for Cross-Spectral Image Patch Matching
.png){kind=icon}
PRE
AI
DOI：10.1109/TIP.2023.3313488.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Recently, feature relation learning has attracted extensive attention in cross-spectral image patch matching. However, most feature relation learning methods can only extract shallow feature relations and are accompanied by the loss of useful discriminative features or the introduction of disturbing features. Although the latest multi-branch feature difference learning network can relatively sufficiently extract useful discriminative features, the multi-branch network structure it adopts has a large number of parameters. Therefore, we propose a novel two-branch feature interaction learning network (FIL-Net). Specifically, a novel feature interaction learning idea for cross-spectral image patch matching is proposed, and a new feature interaction learning module is constructed, which can effectively mine common and private features between cross-spectral image patches, and extract richer and deeper feature relations with invariance and discriminability. At the same time, we re-explore the feature extraction network for the cross-spectral image patch matching task, and a new two-branch residual feature extraction network with stronger feature extraction capabilities is constructed. In addition, we propose a new multi-loss strong-constrained optimization strategy, which can facilitate reasonable network optimization and efficient extraction of invariant and discriminative features. Furthermore, a public VIS-LWIR patch dataset and a public SEN1-2 patch dataset are constructed. At the same time, the corresponding experimental benchmarks are established, which are convenient for future research while solving few existing cross-spectral image patch matching datasets. Extensive experiments show that the proposed FIL-Net achieves state-of-the-art performance in three different cross-spectral image patch matching scenarios.
Keyword:
Cross-spectral image patch matching
feature relation learning
feature interaction learning
期刊
IF:
13.7
论文数:
1.0W
被引数:
8.4W
机构
引用论文
AT-GAN: A generative adversarial network with attention and transition for infrared and visible image fusionAT-GAN: 用于红外和可见光图像融合的具有注意力和过渡的生成对抗网络.png)
INFORMATION FUSION
INFORMATION FUSIONIF15.5
PREAI
分享收藏Combining Phase Congruency and Self-Similarity Features for Multimodal Remote Sensing Image Matching结合相位一致性和自相似性特征的多模态遥感影像匹配
PREAI
分享收藏Crystalline‐State Reaction with Allosteric Effect in Spin‐Crossover, Interpenetrated Networks with Magnetic and Optical Bistability具有磁和光学双稳态的自旋交叉，互穿网络中具有变构效应的晶态反应
PREAI
分享收藏分享收藏
查看更多内容