arrow
返回

Multi-Domain Image Completion for Random Missing Input Data

delete2021-04-01
delete48
delete
OA
AI
L
Liyue Shen *
W
Wentao Zhu
X
Xiaosong Wang
邢
邢磊 (Lei Xing)
J
John M. Pauly
B
Barış Türkbey
S
Stephanie A. Harmon
T
Thomas Sanford
S
Sherif Mehralivand
P
Peter L. Choyke
B
Bradford J. Wood
D
Daguang Xu
DOI:10.1109/TMI.2020.3046444delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Multi-domain data are widely leveraged in vision applications taking advantage of complementary information from different modalities, e.g., brain tumor segmentation from multi-parametric magnetic resonance imaging (MRI). However, due to possible data corruption and different imaging protocols, the availability of images for each domain could vary amongst multiple data sources in practice, which makes it challenging to build a universal model with a varied set of input data. To tackle this problem, we propose a general approach to complete the random missing domain(s) data in real applications. Specifically, we develop a novel multi-domain image completion method that utilizes a generative adversarial network (GAN) with a representational disentanglement scheme to extract shared content encoding and separate style encoding across multiple domains. We further illustrate that the learned representation in multi-domain image completion could be leveraged for high-level tasks, e.g., segmentation, by introducing a unified framework consisting of image completion and segmentation with a shared content encoder. The experiments demonstrate consistent performance improvement on three datasets for brain tumor segmentation, prostate segmentation, and facial expression image completion respectively.
Keyword:
Image segmentation
Tumors
Task analysis
Image synthesis
Magnetic resonance imaging
Image reconstruction
Biomedical imaging
Multi-domain image-to-image translation
multi-contrast MRI
missing data problem
missing-domain segmentation
medical image synthesis

期刊

IEEE Transactions on Medical Imaging 封面图
IEEE Transactions on Medical Imaging
IF:
9.8
论文数:
6.3K
被引数:
3.7W

机构

N
national institutes of health (nih) - usa
学者数:
10.3W
论文数: 8.2W
被引数: 111
S
Stanford University
学者数:
9.6W
论文数: 8.2W
被引数: 17.0W
N
nvidia corporation
学者数:
767
论文数: 439
被引数: 1
N
nih national cancer institute (nci)
学者数:
2.1W
论文数: 1.6W
被引数: 27
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
Computer-Aided Detection of Prostate Cancer inMRI前列腺癌的计算机辅助mri检测
err2014-05-01
err380
PREAI
errLitjens, Geert; Debats, Oscar; Barentsz, Jelle; Karssemeijer, Nico; Huisman, Henkjan
err分享
err收藏
3D Graphene for High-Performance Supercapacitors
err2023-07-21
err0
PREAI
errK. A. U. Madhushani; Ram K. Gupta
err分享
err收藏
Comparison of three grain size measuring methods applied to coarse-grained gravel deposits
err2023-03-01
err0
errOAAI
errPhilippos Garefalakis; Ariel Henrique do Prado; David Mair; Guilhem Amin Douillet; Franziska Nyffenegger; Fritz Schlunegger
err分享
err收藏
The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS)多模态脑肿瘤图像分割基准 (BRATS)
err2015-10-01
err3.7K
errOAAI
errMenze, Bjoern H.; Jakab, Andras; Bauer, Stefan; Kalpathy-Cramer, Jayashree; Farahani, Keyvan; Kirby, Justin; Burren, Yuliya; Porz, Nicole; Slotboom, Johannes; Wiest, Roland; Lanczi, Levente; Gerstner, Elizabeth; Weber, Marc-Andre; Arbel, Tal; Avants, Brian B.; Ayache, Nicholas; Buendia, Patricia; Collins, D. Louis; Cordier, Nicolas; Corso, Jason J.; Criminisi, Antonio; Das, Tilak; Delingette, Herve; Demiralp, Cagatay; Durst, Christopher R.; Dojat, Michel; Doyle, Senan; Festa, Joana; Forbes, Florence; Geremia, Ezequiel; Glocker, Ben; Golland, Polina; Guo, Xiaotao; Hamamci, Andac; Iftekharuddin, Khan M.; Jena, Raj; John, Nigel M.; Konukoglu, Ender; Lashkari, Danial; Mariz, Jose Antonio; Meier, Raphael; Pereira, Sergio; Precup, Doina; Price, Stephen J.; Raviv, Tammy Riklin; Reza, Syed M. S.; Ryan, Michael; Sarikaya, Duygu; Schwartz, Lawrence; Shin, Hoo-Chang; Shotton, Jamie; Silva, Carlos A.; Sousa, Nuno; Subbanna, Nagesh K.; Szekely, Gabor; Taylor, Thomas J.; Thomas, Owen M.; Tustison, Nicholas J.; Unal, Gozde; Vasseur, Flor; Wintermark, Max; Ye, Dong Hye; Zhao, Liang; Zhao, Binsheng; Zikic, Darko; Prastawa, Marcel; Reyes, Mauricio; Van Leemput, Koen
err分享
err收藏
学者 查看更多内容