arrow
返回

An Integral Projection-Based Semantic Autoencoder for Zero-Shot Learning

delete2023-01-01
delete1
delete
OA
AI
W
William Heyden *
H
Habib Ullah
M
M. Salman Siddiqui
F
Fadi Al Machot
DOI:10.1109/ACCESS.2023.3303640delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Zero-shot Learning (ZSL) classification categorizes or predicts classes (labels) that are not included in the training set (unseen classes). Recent works proposed different semantic autoencoder (SAE) models where the encoder embeds a visual feature vector space into the semantic space and the decoder reconstructs the original visual feature space. The objective is to learn the embedding by leveraging a source data distribution, which can be applied effectively to a different but related target data distribution. Such embedding-based methods are prone to domain shift problems and are vulnerable to biases. We propose an integral projection-based semantic autoencoder (IP-SAE) where an encoder projects a visual feature space concatenated with the semantic space into a latent representation space. We force the decoder to reconstruct the visual-semantic data space. Due to this constraint, the visual-semantic projection function preserves the discriminatory data included inside the original visual feature space. The enriched projection forces a more precise reconstitution of the visual feature space invariant to the domain manifold. Consequently, the learned projection function is less domain-specific and alleviates the domain shift problem. Our proposed IP-SAE model consolidates a symmetric transformation function for embedding and projection, and thus, it provides transparency for interpreting generative applications in ZSL. Therefore, in addition to outperforming state-of-the-art methods considering four benchmark datasets, our analytical approach allows us to investigate distinct characteristics of generative-based methods in the unique context of zero-shot inference.
Keyword:
Autoencoder
generative modelling
generative regularisation
latent space
linear transfor-mation
semantic embedding
visual projection
zero-shot learning

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

N
Norwegian University of Life Sciences
学者数:
5.6K
论文数: 5.5K
被引数: 8.6K
引用论文

引用论文

err分享
err收藏
Raman heterodyne detection of nuclear magnetic resonance
err1983-11-01
err0
PREAI
errN. C. Wong; E. S. Kintzer; J. Mlynek; R. G. DeVoe; R. G. Brewer
err分享
err收藏
Developmental Disruption of Erbb4 in Pet1+ Neurons Impairs Serotonergic Sub-System Connectivity and Memory Formation
err2021-12-10
err0
errOAAI
errCandela Barettino; Álvaro Ballesteros-Gonzalez; Andrés Aylón; Xavier Soler-Sanchis; Leticia Ortí; Selene Díaz; Isabel Reillo; Francisco García-García; Francisco José Iborra; Cary Lai; Nathalie Dehorter; Xavier Leinekugel; Nuria Flames; Isabel Del Pino
err分享
err收藏
STUDIES OF ARTHROPOD‐BORNE VIRUS INFECTIONS IN QUEENSLAND
err1963-02-01
err0
PREAI
errRL Doherty; JG Carley; M Josephine Mackerras; Elizabeth N Marks
err分享
err收藏
学者 查看更多内容