arrow
返回

Multimodal MRI Reconstruction Assisted With Spatial Alignment Network

delete2022-09-01
delete15
delete
OA
AI
K
Kai Xuan
L
Lei Xiang
X
Xiaoqian Huang
张立箎 封面图
张立箎 (Lichi Zhang)
S
Shu Liao
D
Dinggang Shen
王茜 封面图
王茜 (Qian Wang) *
DOI:10.1109/TMI.2022.3164050delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In clinical practice, multi-modal magnetic resonance imaging (MRI) with different contrasts is usually acquired in a single study to assess different properties of the same region of interest in the human body. The whole acquisition process can be accelerated by having one or more modalities under-sampled in the k-space. Recent research has shown that, considering the redundancy between different modalities, a target MRI modality under-sampled in the k-space can be more efficiently reconstructed with a fully-sampled reference MRI modality. However, we find that the performance of the aforementioned multi-modal reconstruction can be negatively affected by subtle spatial misalignment between different modalities, which is actually common in clinical practice. In this paper, we improve the quality of multi-modal reconstruction by compensating for such spatial misalignment with a spatial alignment network. First, our spatial alignment network estimates the displacement between the fully-sampled reference and the under-sampled target images, and warps the reference image accordingly. Then, the aligned fully-sampled reference image joins the multimodal reconstruction of the under-sampled target image. Also, considering the contrast difference between the target and reference images, we have designed a crossmodality-synthesis-based registration loss in combination with the reconstruction loss, to jointly train the spatial alignment network and the reconstruction network. The experiments on both clinical MRI and multi-coil k-space raw data demonstrate the superiority and robustness of the multi-modal MRI reconstruction empowered with our spatial alignment network. Our code is publicly available at https://github.corn/woxuankai/SpatialAlignmentNetwork.
Keyword:
Image synthesis
magnetic resonance imaging
MRI reconstruction
multi-modal reconstruction
multi-modal registration

期刊

IEEE Transactions on Medical Imaging 封面图
IEEE Transactions on Medical Imaging
IF:
9.8
论文数:
6.3K
被引数:
3.7W

机构

S
shanghai jiao tong university
学者数:
15.7W
论文数: 11.7W
被引数: 159
S
ShanghaiTech University
学者数:
9.7K
论文数: 5.9K
被引数: 1.6W
引用论文

引用论文

Nitroxide-mediated protection against X-ray-and neocarzinostatin-induced DNA damage
err1992-11-01
err0
PREAI
errWilliam G. DeGraff; Murali C. Krishna; Dwight Kaufman; James B. Mitchell
err分享
err收藏
Prior-Guided Image Reconstruction for Accelerated Multi-Contrast MRI via Generative Adversarial Networks
err2020-10-01
err108
errOAAI
errDar, Salman U. H.; Yurt, Mahmut; Shahdloo, Mohammad; Ildiz, Muhammed Emrullah; Tinaz, Berk; Cukur, Tolga
err分享
err收藏
Compressed sensing for longitudinal MRI: An adaptive-weighted approach
err2015-08-11
err77
errOAAI
errWeizman, Lior; Eldar, Yonina C.; Ben Bashat, Dafna
err分享
err收藏
MIND: Modality independent neighbourhood descriptor for multi-modal deformable registration
err2012-10-01
err523
PREAI
errHeinrich, Mattias P.; Jenkinson, Mark; Bhushan, Manav; Matin, Tahreema; Gleeson, Fergus V.; Brady, Sir Michael; Schnabel, Julia A.
err分享
err收藏
Adversarial learning for mono- or multi-modal registration用于单模态或多模态配准的对抗学习
err2019-12-01
err116
errOAAI
errFan, Jingfan; Cao, Xiaohuan; Wang, Qian; Yap, Pew-Thian; Shen, Dinggang
err分享
err收藏
err分享
err收藏
学者 查看更多内容