arrow
Return

Semantics-Guided Intra-Category Knowledge Transfer for Generalized Zero-Shot Learning

delete2023-02-15
delete6
PRE
AI
F
Fu-En Yang
Y
Yuan‐Hao Lee
C
Chia-Ching Lin
Y
Yu-Chiang Frank Wang *
DOI:10.1007/s11263-023-01767-0delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Zero-shot learning (ZSL) requires one to associate visual and semantic information observed from data of seen classes, so that test data of unseen classes can be recognized based on the described semantic representation. Aiming at synthesizing visual data from the given semantic inputs, hallucination-based ZSL approaches might suffer from mode collapse and biased problems due to the lack of ability in modeling the desirable visual features for unseen categories. In this paper, we present a generative model of Cross-Modal Consistency GAN (CMC-GAN), which performs semantics-guided intra-category knowledge transfer across image categories, so that data hallucination for unseen classes can be achieved with proper semantics and sufficient visual diversity. In our experiments, we perform standard and generalized ZSL on four benchmark datasets, confirming the effectiveness of our approach over that of state-of-the-art ZSL methods.
Keywords:
Generalized zero-shot learning
Generative models
Deep learning
Computer vision

Journal

International Journal of Computer Vision cover
International Journal of Computer Vision
IF:
9.3
Papers:
3.9K
Citations:
2.8W

Organization

N
National Taiwan University
Scholars:
4.7W
Papers: 4.2W
Citations: 3.6W