arrow
返回

The continuous learning algorithm with null space and eigenface-based orthogonal weight modification

delete2025-07-01
delete0
PRE
AI
L
Liao, Dingding
J
Junfeng Liu
J
Jun Zeng *
X
Xu, Shikang
DOI:10.1016/j.eswa.2025.127468delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
持续学习的挑战在于使深度神经网络能够在顺序任务学习中学习新知识,同时不遗忘先前获得的知识。正交权重修改(OWM)是近年来提出的一种重要的持续学习算法。CEig-OWM算法是一种基于特征脸输入空间表示采用正交权重修改的持续学习算法。为增强CEig-OWM算法保持学习知识的稳定性,本研究将零特征值向量的零空间引入到CEig-OWM算法中输入空间正交矩阵的计算中,从而得到基于零空间特征脸的正交权重修改(NEig-OWM)持续学习算法。在多种数据集上进行了广泛的持续学习比较实验,实验结果表明,在具有可比参数规模的算法中,NEig-OWM算法展现出最佳的持续学习性能。
Keyword:
Continual learning
Orthogonal weight modification
Null space
Eigenface

期刊

Expert Systems with Applications 封面图
Expert Systems with Applications
IF:
7.5
论文数:
3.0W
被引数:
10.2W

机构

暂无机构信息
引用论文

引用论文

Memory Recall: A Simple Neural Network Training Framework Against Catastrophic Forgetting
err2022-05-01
err16
PREAI
errZhang, Baosheng; Guo, Yuchen; Li, Yipeng; He, Yuwei; Wang, Haoqian; Dai, Qionghai
err分享
err收藏
Continual learning of context-dependent processing in neural networks
err2019-08-09
err156
PREAI
errZeng, Guanxiong; Chen, Yang; Cui, Bo; Yu, Shan
err分享
err收藏
Disturbance-immune weight sharing for neural architecture search用于神经结构搜索的干扰免疫权重共享
err2021-12-01
err12
errOAAI
errNiu, Shuaicheng; Wu, Jiaxiang; Zhang, Yifan; Guo, Yong; Zhao, Peilin; Huang, Junzhou; Tan, Mingkui
err分享
err收藏
Overcoming catastrophic forgetting in neural networks克服神经网络中的灾难性遗忘
err2017-03-14
err3.7K
errOAAI
errKirkpatricka, James; Pascanu, Razvan; Rabinowitz, Neil; Veness, Joel; Desjardins, Guillaume; Rusu, Andrei A.; Milan, Kieran; Quan, John; Ramalho, Tiago; Grabska-Barwinska, Agnieszka; Hassabis, Demis; Clopath, Claudia; Kumaran, Dharshan; Hadsell, Raia
err分享
err收藏
没有更多内容