.png){kind=icon}
返回
Efficient Incremental Learning Using Dynamic Correction Vector
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2019.2963461.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
One major challenge for modern artificial neural networks (ANNs) is that they typically does not handle incremental learning well. In other words, while learning the new features, the performances of existing features usually deteriorate. This phenomenon is called catastrophic forgetting, which causes great problems for continuous, incremental, and intelligent learning. In this work, we propose a dynamic correction vector based algorithm to address both the bias problem from knowledge distillation and the overfitting problem. Specifically, we have made the following contributions: 1) we have designed a novel dynamic correction vector based algorithm; 2) we have proposed new loss functions accordingly. Experimental results on MNIST and CIFAR-100 datasets demonstrate that our technique can outperform state-of-the-art incremental learning methods by 4% on large datasets.
Keyword:
Incremental learning
convolutional neural network
deep learning
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
A systematic study of the class imbalance problem in convolutional neural networks卷积神经网络中类不平衡问题的系统研究.png)
NEURAL NETWORKSOAAI
NEURAL NETWORKSIF6.3
OAAI分享收藏Gradient-based learning applied to document recognition基于梯度的学习在文档识别中的应用PROCEEDINGS OF THE IEEE
PROCEEDINGS OF THE IEEEIF25.9
PREAI
分享收藏I223R Mutation in Influenza A(H1N1)pdm09 Neuraminidase Confers Reduced Susceptibility to Oseltamivir and Zanamivir and Enhanced Resistance with H275YPLoS ONE
OAAI
PLoS ONEIF0
OAAI分享收藏分享收藏Self-refreshing memory in artificial neural networks: learning temporal sequences without catastrophic forgettingCONNECTION SCIENCEOAAI
CONNECTION SCIENCEIF3.4
OAAI分享收藏
查看更多内容