arrow
返回

Incremental Zero-Shot Learning

delete2022-12-01
delete35
PRE
AI
K
Kun Wei
邓程 (Cheng Deng) *
X
Xu Yang
D
Dacheng Tao
DOI:10.1109/TCYB.2021.3110369delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The goal of zero-shot learning (ZSL) is to recognize objects from unseen classes correctly without corresponding training samples. The existing ZSL methods are trained on a set of predefined classes and do not have the ability to learn from a stream of training data. However, in many real-world applications, training data are collected incrementally; this is one of the main reasons why ZSL methods cannot be applied to certain real-world situations. Accordingly, in order to handle practical learning tasks of this kind, we introduce a novel ZSL setting, referred to as incremental ZSL (IZSL), the goal of which is to accumulate historical knowledge and alleviate Catastrophic Forgetting to facilitate better recognition when incrementally trained on new classes. We further propose a novel method to realize IZSL, which employs a generative replay strategy to produce virtual samples of previously seen classes. The historical knowledge is then transferred from the former learning step to the current step through joint training on both real new and virtual old data. Subsequently, a knowledge distillation strategy is leveraged to distill the knowledge from the former model to the current model, which regularizes the training process of the current model. In addition, our method can be flexibly equipped with the most generative-ZSL methods to tackle IZSL. Extensive experiments on three challenging benchmarks indicate that the proposed method can effectively tackle the IZSL problem effectively, while the existing ZSL methods fail.
Keyword:
Training
Visualization
Semantics
Task analysis
Data models
Generative adversarial networks
Training data
Generative replay
incremental learning
knowledge distillation
transfer knowledge
zero-shot learning (ZSL)

期刊

IEEE Transactions on Cybernetics 封面图
IEEE Transactions on Cybernetics
IF:
10.5
论文数:
1.1W
被引数:
5.0W

机构

X
Xidian University
学者数:
2.4W
论文数: 1.9W
被引数: 9.7K
引用论文

引用论文

Transductive Zero-Shot Learning With a Self-Training Dictionary Approach
err2018-10-01
err57
errOAAI
errYu, Yunlong; Ji, Zhong; Li, Xi; Guo, Jichang; Zhang, Zhongfei; Ling, Haibin; Wu, Fei
err分享
err收藏
The Devil is in the Channels: Mutual-Channel Loss for Fine-Grained Image Classification
err2020-01-01
err271
errOAAI
errChang, Dongliang; Ding, Yifeng; Xie, Jiyang; Bhunia, Ayan Kumar; Li, Xiaoxu; Ma, Zhanyu; Wu, Ming; Guo, Jun; Song, Yi-Zhe
err分享
err收藏
An Improved Incremental Learning Approach for KPI Prognosis of Dynamic Fuel Cell System
err2016-12-01
err78
PREAI
errYin, Shen; Xie, Xiaochen; Lam, James; Cheung, Kie Chung; Gao, Huijun
err分享
err收藏
Effects of Pollution on Human Growth and Development: An Introduction
err2006-01-01
err0
errOAAI
errLawrence M. Schell; Mia V. Gallo; Melinda Denham; Julia Ravenscroft
err分享
err收藏
err分享
err收藏
Sa1255 Perianal Complications in an Asian Crohn's Disease Cohort
err2012-05-01
err0
errOAAI
errValerie Tan; Kelvin T. Thia; Wei Lin Tay; Benjamin A. Haaland; Chris San Choon Kong; Wee Chian Lim; Michelle A. Gowans; Jeannie Ong; David E. Ong; Marion Aw; Poh Seng Tan; Hui Ping Chu; Khoon-Lin Ling; Choon Jin Ooi
err分享
err收藏
学者 查看更多内容