Semantic Contrastive Embedding for Generalized Zero-Shot Learning

doi:10.1007/s11263-022-01656-y

Semantic Contrastive Embedding for Generalized Zero-Shot Learning

2022-08-18

10

PRE

AI

DOI：10.1007/s11263-022-01656-y

Original

Original request for help

Save

Abstract

En 中文

Generalized zero-shot learning (GZSL) aims to recognize objects from both seen and unseen classes when only the labeled examples from seen classes are provided. Recent feature generation methods learn a generative model that can synthesize the missing visual features of unseen classes to mitigate the data-imbalance problem in GZSL. However, the original visual feature space is suboptimal for GZSL recognition since it lacks semantic information, which is vital for recognizing the unseen classes. To tackle this issue, we propose to integrate the feature generation model with an embedding model. Our GZSL framework maps both the real and the synthetic samples produced by the generation model into an embedding space, where we perform the final GZSL classification. Specifically, we propose a semantic contrastive embedding (SCE) for our GZSL framework. Our SCE consists of attribute-level contrastive embedding and class-level contrastive embedding. They aim to obtain the transferable and discriminative information, respectively, in the embedding space. We evaluate our GZSL method with semantic contrastive embedding, named SCE-GZSL, on four benchmark datasets. The results show that our SCE-GZSL method can achieve the state-of-the-art or the second-best on these datasets.

Keywords:

Generalized zero-shot learning

Attribute

Semantic embedding

Contrastive learning

Semantic Contrastive Embedding for Generalized Zero-Shot Learning

Abstract

Journal

Organization