.png){kind=icon}
返回
A robust and interpretable deep learning framework for multi-modal registration via keypoints
.png){kind=icon}
OA
AI
DOI：10.1016/j.media.2023.102962.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
We present KeyMorph, a deep learning-based image registration framework that relies on automatically detecting corresponding keypoints. State-of-the-art deep learning methods for registration often are not robust to large misalignments, are not interpretable, and do not incorporate the symmetries of the problem. In addition, most models produce only a single prediction at test-time. Our core insight which addresses these shortcomings is that corresponding keypoints between images can be used to obtain the optimal transformation via a differentiable closed-form expression. We use this observation to drive the end-to-end learning of keypoints tailored for the registration task, and without knowledge of ground-truth keypoints. This framework not only leads to substantially more robust registration but also yields better interpretability, since the keypoints reveal which parts of the image are driving the final alignment. Moreover, KeyMorph can be designed to be equivariant under image translations and/or symmetric with respect to the input image ordering. Finally, we show how multiple deformation fields can be computed efficiently and in closed-form at test time corresponding to different transformation variants. We demonstrate the proposed framework in solving 3D affine and spline-based registration of multi-modal brain MRI scans. In particular, we show registration accuracy that surpasses current state-of-the-art methods, especially in the context of large displacements. Our code is available at https://github.com/alanqrwang/keymorph.
Keyword:
Image registration
Multi-modal
Keypoint detection
期刊
IF:
11.8
论文数:
3.9K
被引数:
2.4W
机构
引用论文
Symmetric diffeomorphic image registration with cross-correlation: Evaluating automated labeling of elderly and neurodegenerative brain具有互相关的对称微分图像配准: 评估老年人和神经退行性脑的自动标记.png)
MEDICAL IMAGE ANALYSIS
OAAI
MEDICAL IMAGE ANALYSISIF11.8
OAAI分享收藏AutoMorph: Automated Retinal Vascular Morphology Quantification Via a Deep Learning PipelineAutoMorph: 通过深度学习管道自动量化视网膜血管形态OAAI
OAAI分享收藏Unsupervised learning of probabilistic diffeomorphic registration for images and surfacesMEDICAL IMAGE ANALYSISOAAI
MEDICAL IMAGE ANALYSISIF11.8
OAAI分享收藏MIND: Modality independent neighbourhood descriptor for multi-modal deformable registrationMEDICAL IMAGE ANALYSIS
MEDICAL IMAGE ANALYSISIF11.8
PREAI
分享收藏分享收藏Cross-modal attention for multi-modal image registration多模态图像配准中的跨模态注意MEDICAL IMAGE ANALYSISOAAI
MEDICAL IMAGE ANALYSISIF11.8
OAAI分享收藏
查看更多内容