返回
Learning intra-inter-modality complementary for brain tumor segmentation
DOI:10.1007/s00530-023-01138-2.png)
摘要
En 中文
Multi-modal MRI has become a valuable tool in medical imaging for diagnosing and investigating brain tumors, as it provides complementary information from multiple modalities. However, traditional methods for multi-modal MRI segmentation using UNet architecture typically fuse the modalities at an early or mid-stage of the network, without considering the inter-modal feature fusion or dependencies. To address this, a novel CMMFNet (cross-modal multi-scale fusion network) is proposed in this work, which explores both intra-modality and inter-modality relationships in brain tumor segmentation. The network is built on a transformer-based multi-encoder and single-decoder structure, which performs nested multi-modal fusion for high-level representations of different modalities. Additionally, the proposed CMMFNet uses a focusing mechanism that extracts larger receptive fields more effectively at the low-level scale and connects them to the decoding layer effectively. The multi-modal feature fusion module nests modality-aware feature aggregation, and the multi-modal features are better fused through long-term dependencies within each modality in the self-attention and cross-attention layers. The experiments showed that our CMMFNet outperformed state-of-the-art methods on the BraTS2020 benchmark dataset in brain tumor segmentation.
Keyword:
Multi-modal MRI
Brain tumor segmentation
Multi-modal feature fusion
3D wide focusing
期刊
IF:
3.1
论文数:
2.8K
被引数:
2.7K
机构
引用论文
Comparison of Solution Structures and Stabilities of Native, Partially Unfolded and Partially Refolded Pepsin
Biochemistry
IF0
CRAUNet: A cascaded residual attention U-Net for retinal vessel segmentationCRAUNet: 一种用于视网膜血管分割的级联剩余注意力u-net

