.png){kind=icon}
返回
Adaptive knowledge transfer for class incremental learning
.png){kind=icon}
PRE
AI
DOI：10.1016/j.patrec.2024.05.011.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Humans are excellent at adapting to constantly changing circumstances, but deep neural networks have catastrophic forgetting. Recently, significant progress has been made with class -incremental methods based on dynamic network structures. However, these methods combine individual networks in a simplistic coupled manner, neglecting the fusion capabilities between modules, leading to a decline in the overall prediction performance. To address this, we propose a class -incremental learning paradigm with adaptive knowledge transfer. This paradigm leverages crucial self -learning factors to transfer the importance knowledge of old classes as much as possible, allowing each module to integrate the optimal information from the current class. Experiments demonstrate that our designed adaptive knowledge transfer module effectively reduces the sharpness of decision boundaries, thereby significantly improving the final accuracy. Additionally, we have devised a compression module with supplementary learning to mitigate errors arising from long-term session sequences during model fusion. Extensive experiments conducted on benchmarks, Our approach achieved an average accuracy exceeding 2.72%, 1.30% in the CIFAR-100 and ImageNet-100/1000 achieves SOTA performance in both ordinary and challenging class -incremental settings.
Keyword:
Class incremental learning
Knowledge sharing
Knowledge distillation
Dynamic network
期刊
IF:
3.3
论文数:
8.0K
被引数:
1.9W
机构
引用论文
Precipitation Versus Partitioning Kinetics during the Quenching of Low-Carbon Martensitic Steels.png)
Metals
OAAI
MetalsIF0
OAAI分享收藏Competition between Kirkendall and Frenkel effects during multicomponent interdiffusion process
PREAI
分享收藏
查看更多内容