arrow
返回

Generative Memory for Lifelong Learning

delete2020-06-01
delete16
PRE
AI
X
Xin Su
S
Shangqi Guo
T
Tian Tan
陈
陈峰 (Feng Chen) *
DOI:10.1109/TNNLS.2019.2927369delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Lifelong learning is a crucial issue in advanced artificial intelligence. It requires the learning system to learn and accumulate knowledge from sequential tasks. The learning system needs to deal with increasingly more domains and tasks. We consider that the key to an effective and efficient lifelong learning system is the ability to memorize and recall the learned knowledge using neural networks. Following this idea, we propose Generative Memory (GM) as a novel memory module, and the resulting lifelong learning system is referred to as the GM Net (GMNet). To make the GMNet feasible, we propose a novel learning mechanism, referred to as P-invariant learning method. It replaces the memory of the real data by a memory of the data distribution, which makes it possible for the learning system to accurately and continuously accumulate the learned experiences. We demonstrate that GMNet achieves the state-of-the-art performance on lifelong learning tasks.
Keyword:
Catastrophic forgetting
generative memory (GM)
lifelong learning
neural network
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.6K
被引数:
7.2W

机构

T
tsinghua university
学者数:
11.9W
论文数: 10.0W
被引数: 137
引用论文

引用论文

Radial seismic anisotropy as a constraint for upper mantle rheology
err2008-03-01
err0
PREAI
errThorsten W. Becker; Bogdan Kustowski; Göran Ekström
err分享
err收藏
Multisensory Processes: A Balancing Act across the Lifespan
err2016-08-01
err175
errOAAI
errMurray, Micah M.; Lewkowicz, David J.; Amedi, Amir; Wallace, Mark T.
err分享
err收藏
Neuroscience-Inspired Artificial Intelligence神经科学启发的人工智能
errNEURON
IF15
err2017-07-01
err890
errOAAI
errHassabis, Demis; Kumaran, Dharshan; Summerfield, Christopher; Botvinick, Matthew
err分享
err收藏
Envelope theorems for arbitrary choice sets
err2002-03-01
err692
errOAAI
errMilgrom, P; Segal, I
err分享
err收藏
Gap Analysis to Guide DOE R&D in Supporting Extended Storage and Transportation of Spent Nuclear Fuel: An FY2019 Assessment (Final Report)
err
IF0
err2019-12-23
err0
errOAAI
errMelissa Teague; Sylvia Saltzstein; Brady Hanson; Ken Sorenson; Geoffrey Freeze
err分享
err收藏
学者 查看更多内容