.png){kind=icon}
返回
A Multiscale Framework With Unsupervised Learning for Remote Sensing Image Registration
.png){kind=icon}
PRE
AI
DOI：10.1109/TGRS.2022.3167644.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Registration for multisensor or multimodal image pairs with a large degree of distortions is a fundamental task for many remote sensing applications. To achieve accurate and low-cost remote sensing image registration, we propose a multiscale framework with unsupervised learning, named MU-Net. Without costly ground truth labels, MU-Net directly learns the end-to-end mapping from the image pairs to their transformation parameters. MU-Net stacks several deep neural network (DNN) models on multiple scales to generate a coarse-to-fine registration pipeline, which prevents the backpropagation from falling into a local extremum and resists significant image distortions. We design a novel loss function paradigm based on structural similarity, which makes MU-Net suitable for various types of multimodal images. MU-Net is compared with traditional feature-based and area-based methods, as well as supervised and other unsupervised learning methods on the optical-optical, optical-infrared, optical-synthetic aperture radar (SAR), and optical-map datasets. Experimental results show that MU-Net achieves more comprehensive and accurate registration performance between these image pairs with geometric and radiometric distortions. We share the code implemented by Pytorch at https://github.com/yeyuanxin110/MU-Net.
Keyword:
Feature extraction
Optical distortion
Optical imaging
Optical sensors
Distortion
Unsupervised learning
Image registration
Image registration
multimodal images
multiscale framework
unsupervised learning
期刊
IF:
8.6
论文数:
2.1W
被引数:
10.7W
机构
引用论文
MIND: Modality independent neighbourhood descriptor for multi-modal deformable registration.png)
MEDICAL IMAGE ANALYSIS
MEDICAL IMAGE ANALYSISIF11.8
PREAI
分享收藏分享收藏Crystalline‐State Reaction with Allosteric Effect in Spin‐Crossover, Interpenetrated Networks with Magnetic and Optical Bistability具有磁和光学双稳态的自旋交叉，互穿网络中具有变构效应的晶态反应
PREAI
分享收藏
VoxelMorph: A Learning Framework for Deformable Medical Image RegistrationVoxelMorph: 可变形医学图像配准的学习框架
PREAI
分享收藏
查看更多内容