arrow
Return

Domain-incremental learning without forgetting based on random vector functional link networks

delete2024-07-01
delete1
PRE
AI
L
Liu, Chong
D
Dong Li
王曦照 cover
王曦照 (Xizhao Wang) *
DOI:10.1016/j.patcog.2024.110430delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Incremental learning is a paradigm that extends knowledge by learning from new data, often used to add new classes to an existing model or to learn a new domain. It imposes strict limitations on the model's access to data from previous tasks, making it similar to the human learning process. The main challenge of incremental learning is catastrophic forgetting, where previous knowledge is severely forgotten while learning new tasks. In this work, we propose a novel approach for domain -incremental learning. Inspired by the Normal Equation , we accumulate the Gram Matrix from each task's hidden layer output to update a simplified RVFL model. This algorithm achieves performance comparable to joint training while strictly adhering to privacy restrictions. With issues such as forgetting, storage requirements and privacy protection be addressed, this algorithm has the potential to play a crucial role in the field of edge computing and other related fields.
Keywords:
Incremental learning
Domain-incremental learning
RVFL network
Catastrophic forgetting
Privacy preservation

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

I
institute of computing technology, cas
Scholars:
1.0K
Papers: 878
Citations: 1
C
chinese academy of sciences
Scholars:
56.7W
Papers: 45.0W
Citations: 704
Cited Papers

Cited Papers

Recommendation system for automatic design of magazine covers
err2013-03-19
err0
PREAI
errAli Jahanian; Jerry Liu; Qian Lin; Daniel Tretter; Eamonn O'Brien-Strain; Seungyon Claire Lee; Nic Lyons; Jan Allebach
errShare
errSave
Random vector functional link neural network based ensemble deep learning
err2021-09-01
err158
errOAAI
errShi, Qiushi; Katuwal, Rakesh; Suganthan, P. N.; Tanveer, M.
errShare
errSave
Neurons born in the adult dentate gyrus form functional synapses with target cells
err2008-07-11
err0
errOAAI
errNicolas Toni; Diego A Laplagne; Chunmei Zhao; Gabriela Lombardi; Charles E Ribak; Fred H Gage; Alejandro F Schinder
errShare
errSave
Continual lifelong learning with neural networks: A review
err2019-05-01
err1.8K
errOAAI
errParisi, German I.; Kemker, Ronald; Part, Jose L.; Kanan, Christopher; Wermter, Stefan
errShare
errSave
Improvement, Clinical Course, and Quality of Life After Palliative Radiotherapy for Recurrent Glioblastoma
err2008-06-01
err0
PREAI
errCarsten Nieder; Sabrina T. Astner; Minesh P. Mehta; Anca L. Grosu; Michael Molls
errShare
errSave
Towards Robust Pattern Recognition: A Review
err2020-06-01
err86
errOAAI
errZhang, Xu-Yao; Liu, Cheng-Lin; Suen, Ching Y.
errShare
errSave
researcher View more