.png){kind=icon}
返回
GFR: Generic feature representations for class incremental learning
.png){kind=icon}
PRE
AI
DOI：10.1016/j.neucom.2023.126410.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Class incremental learning (CIL) aims to continuously learn new classes while maintaining discrimination for old classes with sequentially coming data. Due to the lack of old-class samples, existing CIL methods fail to learn discriminative representations for both old and new classes simultaneously, resulting in a severe performance drop in old classes, which is the well-known catastrophic forgetting phenomenon. Different from most existing works, we facilitate CIL by learning generic feature representations that perform well in seen and unseen classes. Specifically, we prove that representations with a substantial number of significant singular values benefit CIL via better old knowledge reservation. However, the overly uniform singular value spectrum will hurt the discrimination of current tasks. Furthermore, we propose that increasing the embedding dimension can enhance the number of significant singular values and validate this assumption from two perspectives: adopting different pooling techniques and devising a wider network. Meanwhile, we also prove that satisfactory current task accuracy and old knowledge reservation can be achieved simultaneously. Finally, the simple yet effective generic feature representation regulation (GFR) is devised and incorporated into two baselines. Extensive experiments are conducted on CIFAR100, ImageNet-Subset, and ImageNet. The results show that the proposed method boosts the performance of both baselines with a large margin (2.00%-9.58% on CIFAR100, 0.68%-7.10% on ImageNetSubset and 1.18%-5.04% on ImageNet) which outperforms existing SOTAs.& COPY; 2023 Elsevier B.V. All rights reserved.
Keyword:
Incremental learning
Generic feature representations
Image classification
期刊
IF:
6.5
论文数:
2.5W
被引数:
6.5W
机构
暂无机构信息
引用论文
分享收藏High enantioselectivity in the reactions of (R)- and (S)-1-phenylethylamine with 6A-deoxy-6A-iodo-β-cyclodextrin(R)-和(S)-1-苯基乙胺与6A-脱氧-6A-碘-β-环糊精反应的高对映选择性
PREAI
分享收藏
分享收藏Unsupervised pixel-wise classification for Chaetoceros image segmentation用于Chaetoceros图像分割的无监督像素分类.png)
NEUROCOMPUTING
NEUROCOMPUTINGIF6.5
PREAI
分享收藏
查看更多内容