.png){kind=icon}
返回
ISM-Net: Mining incremental semantics for class incremental learning
.png){kind=icon}
PRE
AI
DOI：10.1016/j.neucom.2022.12.029.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Class incremental learning (CIL) aims to learn new classes from the data stream, where old class data is largely discarded due to data privacy or memory restrictions. A handful of exemplars cannot reflect the complete distribution of old classes, and the separation between old and new classes is hard to guarantee, which is an important cause of catastrophic forgetting. To overcome this problem, we first propose incre-mental semantics mining (ISM) to reduce the misclassification between old and new classes by excluding the semantics of old classes from the representation of new classes. Then, we propose a distillation-based representation expansion strategy to encode the incremental semantics into an additional representation space. Compared to the standard representation expansion strategy, our method features lower memory overhead and computational costs. In addition, an old model queue is proposed to facilitate the mainte-nance of earlier knowledge. Extensive experiments on CIFAR-100 and ImageNet datasets demonstrate the superiority of our method in both performance and parameter efficiency. Several state-of-the-art results are established under different incremental settings. Code: https://github.com/zihuanqiu/ISM-Net (c) 2022 Elsevier B.V. All rights reserved.
Keyword:
Class incremental learning
Image classification
Deep neural networks
期刊
IF:
6.5
论文数:
2.5W
被引数:
6.5W
机构
暂无机构信息
引用论文
Precipitation Versus Partitioning Kinetics during the Quenching of Low-Carbon Martensitic Steels.png)
Metals
OAAI
MetalsIF0
OAAI分享收藏分享收藏Privacy-preserving and verifiable deep learning inference based on secret sharing基于秘密共享的隐私保护和可验证深度学习推理NEUROCOMPUTING
NEUROCOMPUTINGIF6.5
PREAI
分享收藏
查看更多内容