.png){kind=icon}
.png){kind=icon}
Return
A complementary and contrastive network for stimulus segmentation and generalization
.png){kind=icon}
PRE
AI
DOI：10.1016/j.imavis.2023.104694.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Existing convolutional neural networks (CNNs) have achieved remarkable performance in medical image segmentation tasks. However, they still fail to generalize well to unseen datasets due to the limited size and diversity of training data as well as distribution shifts. Meanwhile, CNN-based methods have inherent limi-tations in capturing global contexts and suffer semantic dilution issues in the decoder stage, which leads to sub-optimal predictions especially under low inter-class discrepancy and complex backgrounds. In this paper, we propose a novel framework named CCNet that learns complementary and contrastive features for accurate seg-mentation. Firstly, a novel complementary feature extraction module is formulated to learn global-local features by coordinating Transformer and CNN-style parallel branches. Secondly, a global context refinement module is constructed to adaptively generate a set of layer-specific global maps, so as to remedy semantic dilution. Thirdly, a mutual attentive module is designed to alleviate background confusion, in which contrastive cues are mutually captured from the foreground and background view by cascaded dual attention blocks. Moreover, we implement synthetic data augmentation to deal with training data scarcity and distribution shifts, thereby improving the out-of-distribution generalization of our model. Extensive experiments demonstrate that our CCNet achieves outstanding performance in polyp, skin lesion, and nuclei segmentation tasks, outperforming the state-of-the-arts. & COPY; 2023 Published by Elsevier B.V.
Keywords:
Complementary feature
Contrastive feature
Mutual attention
Synthetic data augmentation
Medical image segmentation