.png){kind=icon}
返回
On complementing unsupervised learning with uncertainty quantification
.png){kind=icon}
PRE
AI
DOI：10.1016/j.patrec.2023.10.023.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Pseudo-label-based semi-supervised learning (SSL) recently has achieved significant success in unlabeled data utilization. Recent success on pseudo-label-based SSL methods crucially hinges on thresholded pseudo-labeling and consistency regularization for the unlabeled data. However, most of the existing methods do not measure and incorporate the uncertainties due to the noisy pseudo-labels or out-of-distribution unlabeled samples. Therefore, the model's discernment becomes noisier in real-life applications that involve a substantial amount of out-of-distribution unannotated data. This leads to slow convergence in the training process and poor generalization performance. Inspired by the recent developments in SSL, our goal in this paper is to propose a novel unsupervised uncertainty-aware objective and threshold-mediated pseudo-labeling scheme that rely on uncertainty quantification from aleatoric and epistemic sources. By incorporating recent techniques in SSL, our proposed uncertainty-aware framework can mitigate the issue of confirmation bias and the impact of noisy pseudo-labels, resulting in improved training efficiency and enhanced generalization performance within the SSL domain. Despite its simplicity and computational efficiency, our approach demonstrates improved performance compared to state-of-the-art SSL methods on challenging datasets, such as CIFAR-100 and the real-world dataset Semi-iNat.
Keyword:
Uncertainty quantification
Semi-supervised learning
Approximate Bayesian models
Confirmation bias
期刊
IF:
3.3
论文数:
8.0K
被引数:
1.6W
机构
引用论文
.png){kind=icon}
Rectifying Pseudo Label Learning via Uncertainty Estimation for Domain Adaptive Semantic Segmentation通过不确定性估计纠正伪标签学习，用于领域自适应语义分割
PREAI
分享收藏Effects of head-mounted and scene-oriented video systems on remote collaboration on physical tasks
OAAI
OAAI分享收藏分享收藏 没有更多内容
没有更多内容