.png){kind=icon}
返回
Continual learning via region-aware memory
.png){kind=icon}
PRE
AI
DOI：10.1007/s10489-022-03928-z.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Continual learning for classification is a common learning scenario in practice yet remains an open challenge for deep neural networks (DNNs). The contemporary DNNs suffer from catastrophic forgetting-they are prone to forgetting the previously acquired knowledge when learning new tasks. Storing a small portion of samples of old tasks in an episodic memory and then replaying them when learning new tasks is an effective way to mitigate catastrophic forgetting. Due to the storage constraint, an episodic memory with limited but diverse samples is more preferable for continual learning. To select samples from various regions in the feature space, we propose a region-aware memory (RAM) construction method. Specifically, we exploit adversarial attack to approximately measure the distance of an example to its class decision boundary. Then, we uniformly choose the samples with different distances to the decision boundary, i.e. the samples from various regions, to store in the episodic memory. We evaluate our RAM on CIFAR10, CIFAR100 and ImageNet datasets in the 'blurry' setup Prabhu et al. (2020) and Bang et al. (2021). Experimental results show that our RAM can outperform state-of-the-art methods. In particular, the performance on ImageNet is boosted by 4.82%.
Keyword:
Continual learning
Region-aware memory
Adversarial attack
Diverse samples
期刊
IF:
3.5
论文数:
7.6K
被引数:
1.7W
机构
暂无机构信息
引用论文
.png){kind=icon}
分享收藏
查看更多内容