.png){kind=icon}
返回
Reconstruct incomplete relation for incomplete modality brain tumor segmentation
.png){kind=icon}
PRE
AI
DOI：10.1016/j.neunet.2024.106657.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Different brain tumor magnetic resonance imaging (MRI) modalities provide diverse tumor-specific information. Previous works have enhanced brain tumor segmentation performance by integrating multiple MRI modalities. However, multi-modal MRI data are often unavailable in clinical practice. An incomplete modality leads to missing tumor-specific information, which degrades the performance of existing models. Various strategies have been proposed to transfer knowledge from a full modality network (teacher) to an incomplete modality one (student) to address this issue. However, they neglect the fact that brain tumor segmentation is a structural prediction problem that requires voxel semantic relations. In this paper, we propose a Reconstruct Incomplete Relation Network (RIRN) that transfers voxel semantic relational knowledge from the teacher to the student. Specifically, we propose two types of voxel relations to incorporate structural knowledge: Class-relative relations (CRR) and Class-agnostic relations (CAR). The CRR groups voxels into different tumor regions and constructs a relation between them. The CAR builds a global relation between all voxel features, complementing the local inter-region relation. Moreover, we use adversarial learning to align the holistic structural prediction between the teacher and the student. Extensive experimentation on both the BraTS 2018 and BraTS 2020 datasets establishes that our method outperforms all state-of-the-art approaches.
Keyword:
Brain tumor segmentation
Incomplete modalities
Structural relation knowledge
Knowledge distillation
期刊
IF:
6.3
论文数:
8.3K
被引数:
3.0W
机构
引用论文
分享收藏D2-Net: Dual Disentanglement Network for Brain Tumor Segmentation With Missing ModalitiesD2-Net: 双解纠缠网络缺失模态脑肿瘤分割
PREAI
分享收藏From YouTube to the brain: Transfer learning can improve brain-imaging predictions with deep learning从YouTube到大脑: 迁移学习可以通过深度学习改善大脑成像预测.png)
NEURAL NETWORKS
OAAI
NEURAL NETWORKSIF6.3
OAAI分享收藏
查看更多内容