arrow
Return

Incremental Zero-Shot Learning

delete2022-12-01
delete35
PRE
AI
K
Kun Wei
邓程 (Cheng Deng) *
X
Xu Yang
D
Dacheng Tao
DOI:10.1109/TCYB.2021.3110369delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The goal of zero-shot learning (ZSL) is to recognize objects from unseen classes correctly without corresponding training samples. The existing ZSL methods are trained on a set of predefined classes and do not have the ability to learn from a stream of training data. However, in many real-world applications, training data are collected incrementally; this is one of the main reasons why ZSL methods cannot be applied to certain real-world situations. Accordingly, in order to handle practical learning tasks of this kind, we introduce a novel ZSL setting, referred to as incremental ZSL (IZSL), the goal of which is to accumulate historical knowledge and alleviate Catastrophic Forgetting to facilitate better recognition when incrementally trained on new classes. We further propose a novel method to realize IZSL, which employs a generative replay strategy to produce virtual samples of previously seen classes. The historical knowledge is then transferred from the former learning step to the current step through joint training on both real new and virtual old data. Subsequently, a knowledge distillation strategy is leveraged to distill the knowledge from the former model to the current model, which regularizes the training process of the current model. In addition, our method can be flexibly equipped with the most generative-ZSL methods to tackle IZSL. Extensive experiments on three challenging benchmarks indicate that the proposed method can effectively tackle the IZSL problem effectively, while the existing ZSL methods fail.
Keywords:
Training
Visualization
Semantics
Task analysis
Data models
Generative adversarial networks
Training data
Generative replay
incremental learning
knowledge distillation
transfer knowledge
zero-shot learning (ZSL)

Journal

IEEE Transactions on Cybernetics cover
IEEE Transactions on Cybernetics
IF:
10.5
Papers:
1.1W
Citations:
5.0W

Organization

X
Xidian University
Scholars:
2.4W
Papers: 1.9W
Citations: 9.7K
Cited Papers

Cited Papers

The Effect of 40-Hz Light Therapy on Amyloid Load in Patients with Prodromal and Clinical Alzheimer’s Disease
err2018-07-30
err0
errOAAI
errRola Ismail; Allan K. Hansen; Peter Parbo; Hans Brændgaard; Hanne Gottrup; David J. Brooks; Per Borghammer
errShare
errSave
Transductive Zero-Shot Learning With a Self-Training Dictionary Approach
err2018-10-01
err57
errOAAI
errYu, Yunlong; Ji, Zhong; Li, Xi; Guo, Jichang; Zhang, Zhongfei; Ling, Haibin; Wu, Fei
errShare
errSave
VMAN: A Virtual Mainstay Alignment Network for Transductive Zero-Shot Learning
err2021-01-01
err26
PREAI
errXie, Guo-Sen; Zhang, Xu-Yao; Yao, Yazhou; Zhang, Zheng; Zhao, Fang; Shao, Ling
errShare
errSave
The Devil is in the Channels: Mutual-Channel Loss for Fine-Grained Image Classification
err2020-01-01
err271
errOAAI
errChang, Dongliang; Ding, Yifeng; Xie, Jiyang; Bhunia, Ayan Kumar; Li, Xiaoxu; Ma, Zhanyu; Wu, Ming; Guo, Jun; Song, Yi-Zhe
errShare
errSave
An Improved Incremental Learning Approach for KPI Prognosis of Dynamic Fuel Cell System
err2016-12-01
err78
PREAI
errYin, Shen; Xie, Xiaochen; Lam, James; Cheung, Kie Chung; Gao, Huijun
errShare
errSave
Effects of Pollution on Human Growth and Development: An Introduction
err2006-01-01
err0
errOAAI
errLawrence M. Schell; Mia V. Gallo; Melinda Denham; Julia Ravenscroft
errShare
errSave
errShare
errSave
Sa1255 Perianal Complications in an Asian Crohn's Disease Cohort
err2012-05-01
err0
errOAAI
errValerie Tan; Kelvin T. Thia; Wei Lin Tay; Benjamin A. Haaland; Chris San Choon Kong; Wee Chian Lim; Michelle A. Gowans; Jeannie Ong; David E. Ong; Marion Aw; Poh Seng Tan; Hui Ping Chu; Khoon-Lin Ling; Choon Jin Ooi
errShare
errSave
researcher View more