arrow
Return

Enhanced VAEGAN: a zero-shot image classification method

delete2022-08-06
delete5
PRE
AI
B
Bo Ding
Y
Yufei Fan
何
何勇军 (Yongjun He) *
赵
赵静 (Jing Zhao)
DOI:10.1007/s10489-022-03869-7delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Zero-shot learning (ZSL) aims to classify samples of unseen categories for which no training data is available. At present, the VAEGAN framework which combines Generative Adversarial Networks (GAN) with Variational Auto-Encoder (VAE) has achieved good performance in zero-shot image classification. Based on the VAEGAN, we propose a new zero-shot image classification method named Enhanced VAEGAN (E-VAEGAN). Firstly, we design a feature alignment module to align visual features and attribute features. Then, the aligned features are fused with the hidden layer features of the encoder to improve output features of the encoder. Secondly, the triplet loss is applied during the encoder training, which further increases the discriminability of features. Finally, the hidden layer features of the discriminator are input into a transform module and then fed back to the generator, which improves the quality of the generated fake samples. The originality of this paper is that we design a new E-VAEGAN which employs the feature alignment module, triplet loss and transform module to reduce the ambiguity between categories and make the generated fake features similar to the real features. Experiments show that our method outperforms the compared methods on five zero-shot learning benchmarks.
Keywords:
Zero-shotlearning
Image classification
Generative adversarial network
Variational auto-encoder

Journal

Applied Intelligence cover
Applied Intelligence
IF:
3.5
Papers:
7.6K
Citations:
1.7W

Organization

No organization information available
Cited Papers

Cited Papers

Core–Shell Catalyst CuO–ZnO–Al2O3@Al2O3 for Dimethyl Ether Synthesis from Syngas
err2013-04-05
err0
PREAI
errYan Wang; Wenli Wang; Yuexian Chen; Jinghong Ma; Jiajun Zheng; Ruifeng Li
errShare
errSave
In situdiagnostics of the crystal-growth process through neutron imaging: application to scintillators
err2016-04-12
err0
errOAAI
errAnton S. Tremsin; Małgorzata G. Makowska; Didier Perrodin; Tetiana Shalapska; Ivan V. Khodyuk; Pavel Trtik; Pierre Boillat; Sven C. Vogel; Adrian S. Losko; Markus Strobl; L. Theil Kuhn; Gregory A. Bizarri; Edith D. Bourret-Courchesne
errShare
errSave
STUDIES OF ARTHROPOD‐BORNE VIRUS INFECTIONS IN QUEENSLAND
err1963-02-01
err0
PREAI
errRL Doherty; JG Carley; M Josephine Mackerras; Elizabeth N Marks
errShare
errSave
Identifying lncRNA-mediated regulatory modules via ChIA-PET network analysis
err2019-05-29
err0
errOAAI
errDenise Thiel; Nataša Djurdjevac Conrad; Evgenia Ntini; Ria X. Peschutter; Heike Siebert; Annalisa Marsico
errShare
errSave
Dual VAEGAN: A generative model for generalized zero-shot learning
err2021-08-01
err32
PREAI
errLuo, Yuxuan; Wang, Xizhao; Pourpanah, Farhad
errShare
errSave
researcher View more