arrow
返回

PRCL: Probabilistic Representation Contrastive Learning for Semi-Supervised Semantic Segmentation

delete2024-05-14
delete0
PRE
AI
H
Haoyu Xie
C
Changqi Wang
J
Jian Zhao *
刘洋 (Yang Liu)
J
Jun Dan
C
Chong Fu
B
Baigui Sun *
DOI:10.1007/s11263-024-02016-8delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Tremendous breakthroughs have been developed in Semi-Supervised Semantic Segmentation (S4) through contrastive learning. However, due to limited annotations, the guidance on unlabeled images is generated by the model itself, which inevitably exists noise and disturbs the unsupervised training process. To address this issue, we propose a robust contrastive-based S4 framework, termed the Probabilistic Representation Contrastive Learning (PRCL) framework to enhance the robustness of the unsupervised training process. We model the pixel-wise representation as Probabilistic Representations (PR) via multivariate Gaussian distribution and tune the contribution of the ambiguous representations to tolerate the risk of inaccurate guidance in contrastive learning. Furthermore, we introduce Global Distribution Prototypes (GDP) by gathering all PRs throughout the whole training process. Since the GDP contains the information of all representations with the same class, it is robust from the instant noise in representations and bears the intra-class variance of representations. In addition, we generate Virtual Negatives (VNs) based on GDP to involve the contrastive learning process. Extensive experiments on two public benchmarks demonstrate the superiority of our PRCL framework.
Keyword:
Semi-supervised semantic segmentation
Contrastive learning
Probabilistic representation
Robust learning

期刊

International Journal of Computer Vision 封面图
International Journal of Computer Vision
IF:
9.3
论文数:
3.9K
被引数:
2.8W

机构

A
alibaba group
学者数:
1.1K
论文数: 789
被引数: 0
N
northeastern university - china
学者数:
3.1W
论文数: 2.7W
被引数: 37
Z
zhejiang university
学者数:
17.7W
论文数: 12.1W
被引数: 152
学者 查看更多机构
引用论文

引用论文

11.36 It takes two to tango: high rates of concussion in both ball carriers and tacklers in high school boys’ rugby
err2024-01-31
err0
PREAI
errStephen West; Isla Shill; Stacy Sick; Kathryn Schneider; J Preston Wiley; Brent Hagel; Carolyn Emery; Amanda Black
err分享
err收藏
err分享
err收藏
DMT: Dynamic mutual training for semi-supervised learningDMT: 半监督学习的动态互训练
err2022-10-01
err86
errOAAI
errFeng, Zhengyang; Zhou, Qianyu; Gu, Qiqi; Tan, Xin; Cheng, Guangliang; Lu, Xuequan; Shi, Jianping; Ma, Lizhuang
err分享
err收藏
err分享
err收藏
Proteomic Analysis of Human Lens Epithelial Cells Exposed to Microwaves
err2007-12-21
err0
PREAI
errHong-Wu Li; Ke Yao; Hong-Ying Jin; Li-Xia Sun; De-Qiang Lu; Yi-Bo Yu
err分享
err收藏
学者 查看更多内容