arrow
返回

Generative negative replay for continual learning

delete2023-05-01
delete8
delete
OA
AI
G
Gabriele Graffieti *
D
Davide Maltoni
L
Lorenzo Pellegrini
V
Vincenzo Lomonaco
DOI:10.1016/j.neunet.2023.03.006delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Learning continually is a key aspect of intelligence and a necessary ability to solve many real-life problems. One of the most effective strategies to control catastrophic forgetting, the Achilles' heel of continual learning, is storing part of the old data and replaying them interleaved with new experiences (also known as the replay approach). Generative replay, which is using generative models to provide replay patterns on demand, is particularly intriguing, however, it was shown to be effective mainly under simplified assumptions, such as simple scenarios and low-dimensional data. In this paper, we show that, while the generated data are usually not able to improve the classification accuracy for the old classes, they can be effective as negative examples (or antagonists) to better learn the new classes, especially when the learning experiences are small and contain examples of just one or few classes. The proposed approach is validated on complex class-incremental and data-incremental continual learning scenarios (CORe50 and ImageNet-1000) composed of high-dimensional data and a large number of training experiences: a setup where existing generative replay approaches usually fail.(c) 2023 Elsevier Ltd. All rights reserved.
Keyword:
Continual learning
Generative replay
Continual object recognition
Pseudo-rehearsal
Generative model
Negative replay
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Neural Networks 封面图
Neural Networks
IF:
6.3
论文数:
8.2K
被引数:
3.0W

机构

U
University of Pisa
学者数:
3.1W
论文数: 2.4W
被引数: 2.4W
U
University of Bologna
学者数:
4.5W
论文数: 3.8W
被引数: 4.1W
引用论文

引用论文

Recommendation system for automatic design of magazine covers
err2013-03-19
err0
PREAI
errAli Jahanian; Jerry Liu; Qian Lin; Daniel Tretter; Eamonn O'Brien-Strain; Seungyon Claire Lee; Nic Lyons; Jan Allebach
err分享
err收藏
A new method of packaging cocaine for international traffic and implications for the management of cocaine body packers
err2002-08-01
err0
PREAI
errRocco Roberto Pidoto; Anna Maria Agliata; Roberto Bertolini; Alberto Mainini; Gianfranco Rossi; Giuseppe Giani
err分享
err收藏
学者 查看更多内容