.png){kind=icon}
Return
ISM-Net: Mining incremental semantics for class incremental learning
.png){kind=icon}
PRE
AI
DOI：10.1016/j.neucom.2022.12.029.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Class incremental learning (CIL) aims to learn new classes from the data stream, where old class data is largely discarded due to data privacy or memory restrictions. A handful of exemplars cannot reflect the complete distribution of old classes, and the separation between old and new classes is hard to guarantee, which is an important cause of catastrophic forgetting. To overcome this problem, we first propose incre-mental semantics mining (ISM) to reduce the misclassification between old and new classes by excluding the semantics of old classes from the representation of new classes. Then, we propose a distillation-based representation expansion strategy to encode the incremental semantics into an additional representation space. Compared to the standard representation expansion strategy, our method features lower memory overhead and computational costs. In addition, an old model queue is proposed to facilitate the mainte-nance of earlier knowledge. Extensive experiments on CIFAR-100 and ImageNet datasets demonstrate the superiority of our method in both performance and parameter efficiency. Several state-of-the-art results are established under different incremental settings. Code: https://github.com/zihuanqiu/ISM-Net (c) 2022 Elsevier B.V. All rights reserved.
Keywords:
Class incremental learning
Image classification
Deep neural networks
Journal
IF:
6.5
Papers:
2.5W
Citations:
6.5W
Organization
No organization information available
Cited Papers
ShareSavePrecipitation Versus Partitioning Kinetics during the Quenching of Low-Carbon Martensitic Steels.png)
Metals
OAAI
MetalsIF0
OAAIShareSaveShareSaveShareSaveShareSaveShareSavePrivacy-preserving and verifiable deep learning inference based on secret sharingNEUROCOMPUTING
NEUROCOMPUTINGIF6.5
PREAI
ShareSave
View more