arrow
Return

Catastrophic Forgetting Problem in Semi-Supervised Semantic Segmentation

delete2022-01-01
delete6
delete
OA
AI
Y
Yan Zhou *
R
Ruyi Jiao
D
Dongli Wang
J
Jinzhen Mu
J
Jianxun Li
DOI:10.1109/ACCESS.2022.3172664delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Restricted by the cost of generating labels for training, semi-supervised methods have been applied to semantic segmentation tasks and have achieved varying degrees of success. Recently, the semi-supervised learning method has taken pseudo supervision as the core idea, especially self-training methods that generate pseudo labels. However, pseudo labels are noisy. In semi-supervised learning, as training progresses, the model needs to focus on more semantic classes and bias towards the newly learned classes. Moreover, due to the limitation of the amount of labeled data, it is difficult for the model to stabilize the learned knowledge. That raise the issue of the model forgetting previously learned knowledge. Based on this new view, we point out that alleviating catastrophic forgetting of the model is beneficial for enhancing the quality of pseudo labels, and propose a pseudo label enhancement strategy. In this strategy, the pseudo labels generated by the previous model are used to rehearse the previous knowledge. Additionally, conflict reduction is proposed to resolve the conflicts of pseudo labels generated from both the previous and current models. We evaluate our scheme on two general semi-supervised semantic segmentation benchmarks, and both achieve state-of-the-art performance. Our codes are released at https://github.com/wing212/DMT-PLE.
Keywords:
Training
Semantics
Data models
Task analysis
Semisupervised learning
Image segmentation
Noise measurement
Catastrophic forgetting problem
noisy pseudo label
pseudo label enhancement strategy
semi-supervised semantic segmentation

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

S
shanghai jiao tong university
Scholars:
15.6W
Papers: 11.6W
Citations: 159
X
xiangtan university
Scholars:
1.5W
Papers: 9.2K
Citations: 8