arrow
返回

Three types of incremental learning

delete2022-12-05
delete136
delete
OA
AI
G
Gido M. van de Ven *
T
Tinne Tuytelaars
A
Andreas S. Tolias
DOI:10.1038/s42256-022-00568-3delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Incrementally learning new information from a non-stationary stream of data, referred to as 'continual learning', is a key feature of natural intelligence, but a challenging problem for deep neural networks. In recent years, numerous deep learning methods for continual learning have been proposed, but comparing their performances is difficult due to the lack of a common framework. To help address this, we describe three fundamental types, or 'scenarios', of continual learning: task-incremental, domain-incremental and class-incremental learning. Each of these scenarios has its own set of challenges. To illustrate this, we provide a comprehensive empirical comparison of currently used continual learning strategies, by performing the Split MNIST and Split CIFAR-100 protocols according to each scenario. We demonstrate substantial differences between the three scenarios in terms of difficulty and in terms of the effectiveness of different strategies. The proposed categorization aims to structure the continual learning field, by forming a key foundation for clearly defining benchmark problems.
Keyword:
ALGORITHMS
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Nature Machine Intelligence 封面图
Nature Machine Intelligence
IF:
23.9
论文数:
1.3K
被引数:
1.5W

机构

B
Baylor College of Medicine
学者数:
4.1W
论文数: 3.0W
被引数: 4.2W
K
KU Leuven
学者数:
5.7W
论文数: 5.2W
被引数: 8.1W
引用论文

引用论文

Embracing Change: Continual Learning in Deep Neural Networks
err2020-12-01
err229
errOAAI
errHadsell, Raia; Rao, Dushyant; Rusu, Andrei A.; Pascanu, Razvan
err分享
err收藏
Is Class-Incremental Enough for Continual Learning?班级增量足以持续学习吗?
err2022-03-24
err10
errOAAI
errCossu, Andrea; Graffieti, Gabriele; Pellegrini, Lorenzo; Maltoni, Davide; Bacciu, Davide; Carta, Antonio; Lomonaco, Vincenzo
err分享
err收藏
err分享
err收藏
Contextual inference underlies the learning of sensorimotor repertoires
errNATURE
IF48.5
err2021-11-24
err76
errOAAI
errHeald, James B.; Lengyel, Mate; Wolpert, Daniel M.
err分享
err收藏
A comprehensive study of class incremental learning algorithms for visual tasks
err2021-03-01
err135
errOAAI
errBelouadah, Eden; Popescu, Adrian; Kanellos, Ioannis
err分享
err收藏
学者 查看更多内容