.png){kind=icon}
返回
Overcomplete-to-sparse representation learning for few-shot class-incremental learning
.png){kind=icon}
PRE
AI
DOI：10.1007/s00530-024-01294-z.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Few-shot class-incremental learning (FSCIL) aims to continually learn new semantics given a few training samples of new classes. As training examples are too few to construct good representation upon, FSCIL is required to generalize learned semantics from old to new classes, as well as reduce the representation aliasing between them (old classes 'forgetting'). This motivates us to develop overcomplete-to-sparse representation learning (O2SRL). It solves the 'new class generalization' and 'old class forgetting' problems systematically by regularizing both feature completeness and sparsity. Specifically, O2SRL consists of a spatial excitation module (SEM) and a channel purification module (CPM). SEM drives the model to learn overcomplete and generic features, which not only represent all classes well but also benefit generalization to new classes. CPM regularizes the sparsity and uniqueness of features, reducing semantic aliasing between classes and alleviating the forgetting of old classes. These two modules facilitate each other to configure unique and robust representation for both old and new classes. Experiments show that O2SRL improves the state-of-the-art of FSCIL by significant margins on public datasets including CUB200, CIFAR100, and mini-ImageNet. O2SRL's effectiveness is also validated under the general few-shot learning setting.
Keyword:
Few-shot
Class-incremental learning
Overcomplete-to-sparse
Representation learning
期刊
IF:
3.1
论文数:
2.8K
被引数:
2.7K
机构
引用论文
.png){kind=icon}
The effect of maternal exercise on umbilical artery blood flow in pregnancy-induced hypertension
PREAI
分享收藏Using Suction and Dielectric Measurements as Performance Indicators for Aggregate Base Materials
PREAI
分享收藏分享收藏Central Processing of Acute Muscle Pain in Chronic Low Back Pain Patients: An EEG Mapping Study
PREAI
分享收藏
查看更多内容