arrow
返回

Cross-Modality Image Registration Using a Training-Time Privileged Third Modality

delete2022-11-01
delete3
delete
OA
AI
Q
Qianye Yang *
D
David Atkinson
Y
Yunguan Fu
T
Tom Syer
Y
Yan Wen
S
Shonit Punwani
M
Matthew J. Clarkson
D
Dean C. Barratt
T
Tom Vercauteren
Y
Yipeng Hu
DOI:10.1109/TMI.2022.3187873delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In this work, we consider the task of pairwise cross-modality image registration, which may benefit from exploiting additional images available only at training time from an additional modality that is different to those being registered. As an example, we focus on aligning intra-subject multiparametric Magnetic Resonance (mpMR) images, between T2-weighted (T2w) scans and diffusion-weighted scans with high b-value (DWIhigh-b). For the application of localising tumours in mpMR images, diffusion scans with zero b-value (DWIb=0) are considered easier to register to T2w due to the availability of corresponding features. We propose a learning from privileged modality algorithm, using a training-only imaging modality DWIb=0, to support the challenging multi-modality registration problems. We present experimental results based on 369 sets of 3D multiparametric MRI images from 356 prostate cancer patients and report, with statistical significance, a lowered median target registration error of 4.34 mm, when registering the holdout DWIhigh-b and T2w image pairs, compared with that of 7.96 mm before registration. Results also show that the proposed learning-based registration networks enabled efficient registration with comparable or better accuracy, compared with a classical iterative algorithm and other tested learning-based methods with/without the additional modality. These compared algorithms also failed to produce any significantly improved alignment between DWI(high-b )and T2w in this challenging application.
Keyword:
Medical image registration
privileged learning
deep learning
multi-parametric MRI

期刊

IEEE Transactions on Medical Imaging 封面图
IEEE Transactions on Medical Imaging
IF:
9.8
论文数:
6.3K
被引数:
3.7W

机构

U
University College London
学者数:
7.9W
论文数: 6.2W
被引数: 15.7W
E
engineering & physical sciences research council (epsrc)
学者数:
709
论文数: 470
被引数: 1
U
university of london
学者数:
21.5W
论文数: 19.7W
被引数: 305
学者 查看更多机构
引用论文

引用论文

CrossModalNet: exploiting quality preoperative images for multimodal image registrationCrossModalNet: 利用高质量的术前图像进行多模式图像配准
err2021-08-23
err3
PREAI
errSun, Jiawei; Liu, Cong; Li, Chunying; Lu, Zhengda; He, Mu; Gao, Liugang; Lin, Tao; Sui, Jianfeng; Xie, Kai; Ni, Xinye
err分享
err收藏
Co-trained convolutional neural networks for automated detection of prostate cancer in multi-parametric MRI
err2017-12-01
err132
PREAI
errYang, Xin; Liu, Chaoyue; Wang, Zhiwei; Yang, Jun; Le Min, Hung; Wang, Liang; Cheng, Kwang-Ting (Tim)
err分享
err收藏
err分享
err收藏
Diffusion-weighted Endorectal MR Imaging at 3 T for Prostate Cancer: Tumor Detection and Assessment of Aggressiveness
errRADIOLOGY
IF15.2
err2011-06-01
err368
errOAAI
errVargas, Hebert Alberto; Akin, Oguz; Franiel, Tobias; Mazaheri, Yousef; Zheng, Junting; Moskowitz, Chaya; Udo, Kazuma; Eastham, James; Hricak, Hedvig
err分享
err收藏
Oxidative Stress Associated with Indoor Air Pollution and Sick Building Syndrome-Related Symptoms among Office Workers in Taiwan
err2010-07-03
err0
errOAAI
errChung-Yen Lu; Yee-Chung Ma; Jia-Min Lin; Chung-Yi Li; Reuy S. Lin; Fung-Chang Sung
err分享
err收藏
Forest Fire Assessment Using Remote Sensing to Support the Development of an Action Plan Proposal in Ecuador
err2022-04-07
err0
errOAAI
errFernando Morante-Carballo; Lady Bravo-Montero; Paúl Carrión-Mero; Andrés Velastegui-Montoya; Edgar Berrezueta
err分享
err收藏
Prostate Imaging Reporting and Data System Version 2.1: 2019 Update of Prostate Imaging Reporting and Data System Version 2前列腺影像报告和数据系统版本2.1: 前列腺影像报告和数据系统版本2的2019更新
err2019-09-01
err1.6K
PREAI
errTurkbey, Baris; Rosenkrantz, Andrew B.; Haider, Masoom A.; Padhani, Anwar R.; Villeirs, Geert; Macura, Katarzyna J.; Tempany, Clare M.; Choyke, Peter L.; Cornud, Francois; Margolis, Daniel J.; Thoeny, Harriet C.; Verma, Sadhna; Barentsz, Jelle; Weinreb, Jeffrey C.
err分享
err收藏
学者 查看更多内容