返回
Multimodal MRI Reconstruction Assisted With Spatial Alignment Network
DOI:10.1109/TMI.2022.3164050.png)
摘要
En 中文
In clinical practice, multi-modal magnetic resonance imaging (MRI) with different contrasts is usually acquired in a single study to assess different properties of the same region of interest in the human body. The whole acquisition process can be accelerated by having one or more modalities under-sampled in the k-space. Recent research has shown that, considering the redundancy between different modalities, a target MRI modality under-sampled in the k-space can be more efficiently reconstructed with a fully-sampled reference MRI modality. However, we find that the performance of the aforementioned multi-modal reconstruction can be negatively affected by subtle spatial misalignment between different modalities, which is actually common in clinical practice. In this paper, we improve the quality of multi-modal reconstruction by compensating for such spatial misalignment with a spatial alignment network. First, our spatial alignment network estimates the displacement between the fully-sampled reference and the under-sampled target images, and warps the reference image accordingly. Then, the aligned fully-sampled reference image joins the multimodal reconstruction of the under-sampled target image. Also, considering the contrast difference between the target and reference images, we have designed a crossmodality-synthesis-based registration loss in combination with the reconstruction loss, to jointly train the spatial alignment network and the reconstruction network. The experiments on both clinical MRI and multi-coil k-space raw data demonstrate the superiority and robustness of the multi-modal MRI reconstruction empowered with our spatial alignment network. Our code is publicly available at https://github.corn/woxuankai/SpatialAlignmentNetwork.
Keyword:
Image synthesis
magnetic resonance imaging
MRI reconstruction
multi-modal reconstruction
multi-modal registration
期刊
IF:
9.8
论文数:
6.3K
被引数:
3.7W
机构
引用论文
Improving resolution of MR images with an adversarial network incorporating images with different contrast使用包含不同对比度图像的对抗网络提高MR图像的分辨率
MEDICAL PHYSICS
IF3.2
MIND: Modality independent neighbourhood descriptor for multi-modal deformable registration
MEDICAL IMAGE ANALYSIS
IF11.8
Adversarial learning for mono- or multi-modal registration用于单模态或多模态配准的对抗学习
MEDICAL IMAGE ANALYSIS
IF11.8
Symmetric diffeomorphic image registration with cross-correlation: Evaluating automated labeling of elderly and neurodegenerative brain具有互相关的对称微分图像配准: 评估老年人和神经退行性脑的自动标记
MEDICAL IMAGE ANALYSIS
IF11.8

