arrow
返回

Missing MRI Pulse Sequence Synthesis Using Multi-Modal Generative Adversarial Network

delete2020-04-01
delete123
delete
OA
AI
A
Anmol Sharma *
G
Ghassan Hamarneh
DOI:10.1109/TMI.2019.2945521delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Magnetic resonance imaging (MRI) is being increasingly utilized to assess, diagnose, and plan treatment for a variety of diseases. The ability to visualize tissue in varied contrasts in the form of MR pulse sequences in a single scan provides valuable insights to physicians, as well as enabling automated systems performing downstream analysis. However, many issues like prohibitive scan time, image corruption, different acquisition protocols, or allergies to certain contrast materials may hinder the process of acquiring multiple sequences for a patient. This poses challenges to both physicians and automated systems since complementary information provided by the missing sequences is lost. In this paper, we propose a variant of generative adversarial network (GAN) capable of leveraging redundant information contained within multiple available sequences in order to generate one or more missing sequences for a patient scan. The proposed network is designed as a multi-input, multi-output network which combines information from all the available pulse sequences and synthesizes the missing ones in a single forward pass. We demonstrate and validate our method on two brain MRI datasets each with four sequences, and show the applicability of the proposed method in simultaneously synthesizing all missing sequences in any possible scenario where either one, two, or three of the four sequences may be missing. We compare our approach with competing unimodal and multi-modal methods, and show that we outperform both quantitatively and qualitatively.
Keyword:
Generative adversarial networks
multi-modal
missing modality
pulse sequences
MRI
synthesis
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Medical Imaging 封面图
IEEE Transactions on Medical Imaging
IF:
9.8
论文数:
6.3K
被引数:
3.7W

机构

S
Simon Fraser University
学者数:
1.0W
论文数: 1.0W
被引数: 1.4W
引用论文

引用论文

err分享
err收藏
Brain tumor segmentation with Deep Neural Networks基于深度神经网络的脑肿瘤分割
err2017-01-01
err2.1K
errOAAI
errHavaei, Mohammad; Davy, Axel; Warde-Farley, David; Biard, Antoine; Courville, Aaron; Bengio, Yoshua; Pal, Chris; Jodoin, Pierre-Marc; Larochelle, Hugo
err分享
err收藏
The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS)多模态脑肿瘤图像分割基准 (BRATS)
err2015-10-01
err3.7K
errOAAI
errMenze, Bjoern H.; Jakab, Andras; Bauer, Stefan; Kalpathy-Cramer, Jayashree; Farahani, Keyvan; Kirby, Justin; Burren, Yuliya; Porz, Nicole; Slotboom, Johannes; Wiest, Roland; Lanczi, Levente; Gerstner, Elizabeth; Weber, Marc-Andre; Arbel, Tal; Avants, Brian B.; Ayache, Nicholas; Buendia, Patricia; Collins, D. Louis; Cordier, Nicolas; Corso, Jason J.; Criminisi, Antonio; Das, Tilak; Delingette, Herve; Demiralp, Cagatay; Durst, Christopher R.; Dojat, Michel; Doyle, Senan; Festa, Joana; Forbes, Florence; Geremia, Ezequiel; Glocker, Ben; Golland, Polina; Guo, Xiaotao; Hamamci, Andac; Iftekharuddin, Khan M.; Jena, Raj; John, Nigel M.; Konukoglu, Ender; Lashkari, Danial; Mariz, Jose Antonio; Meier, Raphael; Pereira, Sergio; Precup, Doina; Price, Stephen J.; Raviv, Tammy Riklin; Reza, Syed M. S.; Ryan, Michael; Sarikaya, Duygu; Schwartz, Lawrence; Shin, Hoo-Chang; Shotton, Jamie; Silva, Carlos A.; Sousa, Nuno; Subbanna, Nagesh K.; Szekely, Gabor; Taylor, Thomas J.; Thomas, Owen M.; Tustison, Nicholas J.; Unal, Gozde; Vasseur, Flor; Wintermark, Max; Ye, Dong Hye; Zhao, Liang; Zhao, Binsheng; Zikic, Darko; Prastawa, Marcel; Reyes, Mauricio; Van Leemput, Koen
err分享
err收藏
Prediction of a fertilizer particle motion along a vane of a centrifugal spreader disc assuming its pure rolling
err2018-01-01
err0
errOAAI
errTomantschger Kurt; Petrović Dragan; Cerović Vera; Dimitrijević Aleksandra; Radojević Rade
err分享
err收藏
学者 查看更多内容