arrow
返回

Self-Training for Class-Incremental Semantic Segmentation

delete2023-11-01
delete30
delete
OA
AI
余璐 封面图
余璐 (Lu Yu)
X
Xialei Liu *
J
Joost van de Weijer
DOI:10.1109/TNNLS.2022.3155746delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In class-incremental semantic segmentation, we have no access to the labeled data of previous tasks. Therefore, when incrementally learning new classes, deep neural networks suffer from catastrophic forgetting of previously learned knowledge. To address this problem, we propose to apply a self-training approach that leverages unlabeled data, which is used for rehearsal of previous knowledge. Specifically, we first learn a temporary model for the current task, and then, pseudo labels for the unlabeled data are computed by fusing information from the old model of the previous task and the current temporary model. In addition, conflict reduction is proposed to resolve the conflicts of pseudo labels generated from both the old and temporary models. We show that maximizing self-entropy can further improve results by smoothing the overconfident predictions. Interestingly, in the experiments, we show that the auxiliary data can be different from the training data and that even general-purpose, but diverse auxiliary data can lead to large performance gains. The experiments demonstrate the state-of-the-art results: obtaining a relative gain of up to 114% on Pascal-VOC 2012 and 8.5% on the more challenging ADE20K compared to previous state-of-the-art methods.
Keyword:
Semantics
Task analysis
Data models
Image segmentation
Training
Adaptation models
Computational modeling
Class-incremental learning
self-training
semantic segmentation

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.5K
被引数:
7.2W

机构

T
Tianjin University of Technology
学者数:
8.8K
论文数: 5.9K
被引数: 1.0W
A
Autonomous University of Barcelona
学者数:
3.7W
论文数: 2.6W
被引数: 47
N
nankai university
学者数:
4.8W
论文数: 3.3W
被引数: 74
学者 查看更多机构
引用论文

引用论文

Recommendation system for automatic design of magazine covers
err2013-03-19
err0
PREAI
errAli Jahanian; Jerry Liu; Qian Lin; Daniel Tretter; Eamonn O'Brien-Strain; Seungyon Claire Lee; Nic Lyons; Jan Allebach
err分享
err收藏
A Pilot Study of the Efficacy of the Unified Protocol for Transdiagnostic Treatment of Emotional Disorders in Treating Posttraumatic Psychopathology: A Randomized Controlled Trial
err2021-01-16
err0
errOAAI
errMeaghan L. O'Donnell; Winnie Lau; Katherine Chisholm; James Agathos; Jonathon Little; Sonia Terhaag; Rachel Brand; Andrea Putica; Alexander C. N. Holmes; Lynda Katona; Kim L. Felmingham; Kim Murray; Fardous Hosseiny; Matthew W. Gallagher
err分享
err收藏
Electrochemically assisted micro localized grafting of aptamers in a microchannel engraved in fluorinated thermoplastic polymer Dyneon THV
err2015-01-01
err0
PREAI
errC. Perréard; Y. Ladner; F. d'Orlyé; S. Descroix; V. Taniga; A. Varenne; F. Kanoufi; C. Slim; S. Griveau; F. Bedioui
err分享
err收藏
学者 查看更多内容