.png){kind=icon}
返回
Class-Incremental Learning Based on Big Dataset Pre-Trained Models
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2023.3287771.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Deep neural networks have shown excellent performance in the field of pattern classification and are widely used. However, real-world data are often cannot be obtained at once, and the knowledge of old classes will be heavily forgotten when training new classes of data on the network, which is called catastrophic forgetting. Therefore, the incremental learning method to solve this problem came into being. In this paper, we propose a class-incremental learning method based on a big data pre-trained model, which makes full use of the large amount of public knowledge in the pre-trained model's front network to reduce the forgetting problem of the network in subsequent classification tasks. On the basis of our previous incremental learning method based on PEDCC, we discuss the effects of different pre-trained models, training strategy, training hyperparameters, etc. PEDCC-Loss is used to constrain the cosine distance between the latent feature and the pre-defined class center, and finally the joint prediction is determined by multiple network prediction results. The algorithm in this paper is verified on the CIFAR100, Tiny ImageNet, and FaceScrub datasets with and without partial retention of old samples, and achieves the best results compared to the previous typical class-incremental learning methods. The performance in coarse-grained datasets even exceeds the accuracy of non-incremental learning without pre-trained model. Code is available in https://github.com/byBinWen/Class-Incremental-Learning-Based-on-Big-Dataset-Pre-trained-Models.
Keyword:
Ensemble learning
Learning systems
Knowledge engineering
Data models
Mathematical models
Task analysis
Predictive models
Incremental learning
image classification
ensemble learning
PEDCC-Loss
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
Do Perceptions of Competence Mediate The Relationship Between Fundamental Motor Skill Proficiency and Physical Activity Levels of Children in Kindergarten?能力的感知是否可以介导幼儿园儿童的基本运动技能熟练程度与身体活动水平之间的关系？
PREAI
分享收藏Generation and Frame Characteristics of Predefined Evenly-Distributed Class Centroids for Pattern Classification.png)
IEEE ACCESS
OAAI
IEEE ACCESSIF3.6
OAAI分享收藏Development of allocentric spatial memory abilities in children from 18 months to 5 years of age18个月至5岁儿童的中心空间记忆能力的发展OAAI
OAAI分享收藏分享收藏分享收藏
查看更多内容