arrow
返回

Domain-incremental learning without forgetting based on random vector functional link networks

delete2024-07-01
delete1
PRE
AI
L
Liu, Chong
D
Dong Li
王曦照 封面图
王曦照 (Xizhao Wang) *
DOI:10.1016/j.patcog.2024.110430delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Incremental learning is a paradigm that extends knowledge by learning from new data, often used to add new classes to an existing model or to learn a new domain. It imposes strict limitations on the model's access to data from previous tasks, making it similar to the human learning process. The main challenge of incremental learning is catastrophic forgetting, where previous knowledge is severely forgotten while learning new tasks. In this work, we propose a novel approach for domain -incremental learning. Inspired by the Normal Equation , we accumulate the Gram Matrix from each task's hidden layer output to update a simplified RVFL model. This algorithm achieves performance comparable to joint training while strictly adhering to privacy restrictions. With issues such as forgetting, storage requirements and privacy protection be addressed, this algorithm has the potential to play a crucial role in the field of edge computing and other related fields.
Keyword:
Incremental learning
Domain-incremental learning
RVFL network
Catastrophic forgetting
Privacy preservation

期刊

Pattern Recognition 封面图
Pattern Recognition
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

I
institute of computing technology, cas
学者数:
1.0K
论文数: 878
被引数: 1
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

Recommendation system for automatic design of magazine covers
err2013-03-19
err0
PREAI
errAli Jahanian; Jerry Liu; Qian Lin; Daniel Tretter; Eamonn O'Brien-Strain; Seungyon Claire Lee; Nic Lyons; Jan Allebach
err分享
err收藏
Random vector functional link neural network based ensemble deep learning
err2021-09-01
err158
errOAAI
errShi, Qiushi; Katuwal, Rakesh; Suganthan, P. N.; Tanveer, M.
err分享
err收藏
Neurons born in the adult dentate gyrus form functional synapses with target cells
err2008-07-11
err0
errOAAI
errNicolas Toni; Diego A Laplagne; Chunmei Zhao; Gabriela Lombardi; Charles E Ribak; Fred H Gage; Alejandro F Schinder
err分享
err收藏
Continual lifelong learning with neural networks: A review神经网络的持续终身学习: 综述
err2019-05-01
err1.8K
errOAAI
errParisi, German I.; Kemker, Ronald; Part, Jose L.; Kanan, Christopher; Wermter, Stefan
err分享
err收藏
Improvement, Clinical Course, and Quality of Life After Palliative Radiotherapy for Recurrent Glioblastoma
err2008-06-01
err0
PREAI
errCarsten Nieder; Sabrina T. Astner; Minesh P. Mehta; Anca L. Grosu; Michael Molls
err分享
err收藏
Towards Robust Pattern Recognition: A Review
err2020-06-01
err86
errOAAI
errZhang, Xu-Yao; Liu, Cheng-Lin; Suen, Ching Y.
err分享
err收藏
学者 查看更多内容