arrow
返回

Learning intra-inter-modality complementary for brain tumor segmentation

delete2023-07-16
delete5
PRE
AI
J
Jiangpeng Zheng
F
Fan Shi
M
Meng Zhao
陈佳 封面图
陈佳 (Jia Chen)
王聪聪 封面图
王聪聪 (Congcong Wang) *
DOI:10.1007/s00530-023-01138-2delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Multi-modal MRI has become a valuable tool in medical imaging for diagnosing and investigating brain tumors, as it provides complementary information from multiple modalities. However, traditional methods for multi-modal MRI segmentation using UNet architecture typically fuse the modalities at an early or mid-stage of the network, without considering the inter-modal feature fusion or dependencies. To address this, a novel CMMFNet (cross-modal multi-scale fusion network) is proposed in this work, which explores both intra-modality and inter-modality relationships in brain tumor segmentation. The network is built on a transformer-based multi-encoder and single-decoder structure, which performs nested multi-modal fusion for high-level representations of different modalities. Additionally, the proposed CMMFNet uses a focusing mechanism that extracts larger receptive fields more effectively at the low-level scale and connects them to the decoding layer effectively. The multi-modal feature fusion module nests modality-aware feature aggregation, and the multi-modal features are better fused through long-term dependencies within each modality in the self-attention and cross-attention layers. The experiments showed that our CMMFNet outperformed state-of-the-art methods on the BraTS2020 benchmark dataset in brain tumor segmentation.
Keyword:
Multi-modal MRI
Brain tumor segmentation
Multi-modal feature fusion
3D wide focusing

期刊

Multimedia Systems 封面图
Multimedia Systems
IF:
3.1
论文数:
2.8K
被引数:
2.7K

机构

T
Tianjin University of Technology
学者数:
8.8K
论文数: 5.9K
被引数: 1.0W
引用论文

引用论文

Provably safe motion of mobile robots in human environments
err2017-09-01
err0
errOAAI
errStefan B. Liu; Hendrik Roehm; Christian Heinzemann; Ingo Lutkebohle; Jens Oehlerking; Matthias Althoff
err分享
err收藏
Comparison of Solution Structures and Stabilities of Native, Partially Unfolded and Partially Refolded Pepsin
err2006-11-01
err0
errOAAI
errDerek Dee; Jeremy Pencer; Mu-Ping Nieh; Susan Krueger; John Katsaras; Rickey Y. Yada
err分享
err收藏
Design and implementation of energy reshaping based fuzzy logic control for optimal power extraction of PMSG wind energy converter
err2022-09-28
err0
errOAAI
errAshish Jaiswal; Youcef Belkhier; Subhash Chandra; Anurag Priyadarshi; Mohit Bajaj; Mukesh Pushkarna; Elmazeg Elgamli; Mokhtar Shouran; Salah Kamel
err分享
err收藏
err分享
err收藏
Acoustics and Sound Insulation
err
IF0
err2009-12-31
err0
PREAI
errEckard Mommertz
err分享
err收藏
err分享
err收藏
Managing cultivated pastures for improving soil quality in South Africa: challenges and opportunities
err2015-06-05
err0
PREAI
errPieter A Swanepoel; Philip R Botha; Chris C du Preez; Hennie A Snyman; Johan Labuschagne
err分享
err收藏
学者 查看更多内容