.png){kind=icon}
Return
Knowledge aggregation networks for class incremental learning
.png){kind=icon}
PRE
AI
DOI：10.1016/j.patcog.2023.109310.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Most existing class incremental learning methods rely on storing old exemplars to avoid catastrophic forgetting. However, these methods inevitably face the gradient conflict problem, the inherent conflict between new streaming knowledge and existing knowledge in the gradient direction. To alleviate gradient conflict, this paper reuses the previous knowledge and expands the branch to accommodate new concepts instead of fine-tuning the original models. Specifically, this paper designs a novel dual-branch network called Knowledge Aggregation Networks. The previously trained model is frozen as a branch to retain existing knowledge, and a consistent trainable network is constructed as the other branch to learn new concepts. An adaptive feature fusion module is adopted to dynamically balance the two branches' information during training. Moreover, a model compression stage maintains the dual-branch structure. Extensive experiments on CIFAR-10 0, ImageNet-Sub, and ImageNet show that our method significantly outperforms the other methods and effectively balances stability and plasticity. & COPY; 2023 Elsevier Ltd. All rights reserved.
Keywords:
Class incremental learning
Catastrophic forgetting
Dual-branch network
Knowledge aggregation
Model compression
Journal
IF:
7.6
Papers:
1.3W
Citations:
4.5W
Organization
No organization information available
Cited Papers
ShareSaveShareSaveShareSaveA comprehensive study of class incremental learning algorithms for visual tasks.png)
NEURAL NETWORKS
OAAI
NEURAL NETWORKSIF6.3
OAAIShareSaveShareSaveLoGID: An adaptive framework combining local and global incremental learning for dynamic selection of ensembles of HMMsPATTERN RECOGNITION
PATTERN RECOGNITIONIF7.6
PREAI
ShareSaveShareSave
View more