arrow
返回

Multimodal brain tumor detection using multimodal deep transfer learning

delete2022-11-01
delete22
PRE
AI
P
Parvin Razzaghi *
K
Karim Abbasi
S
Shima Rashidi
DOI:10.1016/j.asoc.2022.109631delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
MRI brain image analysis, including brain tumor detection, is a challenging task. MRI images are multimodal, and in recent years, multimodal medical image analysis has gotten more attention. Modes refer to data from multiple sources which are semantically correlated and sometimes provide complementary information to each other. In this paper, modalities in MRI brain images refer to the different planes of view (axial, sagittal, and coronal planes) in which MRI images are taken. In most cases, in the literature on multimodal data analysis, it is assumed that all modalities for all samples are available. While, in medical image analysis, this assumption is not valid, and only some modalities might be available for each sample. The knowledge transfer between and within modalities is considered to tackle this challenge in MRI brain image segmentation. For knowledge transfer, domain adaptation is an important step that deals with the problem of having different distributions between the training and test sets. These challenges have not been considered in recent multimodal brain image analysis studies. This paper proposed a new multimodal deep transfer learning for MRI brain image analysis. The main differences of the proposed approach, with respect to the other multimodal brain image analysis, are 1) proposing a new multimodal feature encoder and 2) proposing a new multimodal adaptation technique to handle the different distribution between the training and test sets. We applied it to IBSR and Figshre brain tumor datasets to evaluate the proposed approach. The results confirm that the proposed approach significantly outperforms the other comparable approaches. (c) 2022 Elsevier B.V. All rights reserved.
Keyword:
Multimodal brain images
Domain adaptation
Deep learning
Brain image segmentation

期刊

Applied Soft Computing 封面图
Applied Soft Computing
IF:
6.6
论文数:
1.4W
被引数:
4.8W

机构

U
University of Tehran
学者数:
2.4W
论文数: 2.3W
被引数: 2.7W
引用论文

引用论文

Correspondence of closest gradient Voxels—A robust registration algorithm
err2005-11-17
err0
PREAI
errJohn L. Ostuni; Ronald L. Levin; Joseph A. Frank; Charles DeCarli
err分享
err收藏
Multimodal Deep Autoencoder for Human Pose Recovery
err2015-12-01
err520
PREAI
errHong, Chaoqun; Yu, Jun; Wan, Jian; Tao, Dacheng; Wang, Meng
err分享
err收藏
Directive Contrast Based Multimodal Medical Image Fusion in NSCT Domain
err2013-08-01
err373
PREAI
errBhatnagar, Gaurav; Wu, Q. M. Jonathan; Liu, Zheng
err分享
err收藏
err分享
err收藏
Deep Transferable Compound Representation across Domains and Tasks for Low Data Drug Discovery
err2019-10-29
err39
PREAI
errAbbasi, Karim; Poso, Antti; Ghasemi, Jahanbakhsh; Amanlou, Massoud; Masoudi-Nejad, Ali
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
Brain tumor segmentation with Deep Neural Networks基于深度神经网络的脑肿瘤分割
err2017-01-01
err2.1K
errOAAI
errHavaei, Mohammad; Davy, Axel; Warde-Farley, David; Biard, Antoine; Courville, Aaron; Bengio, Yoshua; Pal, Chris; Jodoin, Pierre-Marc; Larochelle, Hugo
err分享
err收藏
学者 查看更多内容