arrow
返回

Deep Unbiased Embedding Transfer for Zero-Shot Learning

delete2020-01-01
delete35
PRE
AI
Z
Zhen Jia
张
张彰 (Zhang Zhang) *
王亮 封面图
王亮 (Liang Wang)
C
Caifeng Shan
Tieniu Tan 封面图
Tieniu Tan (Tieniu Tan)
DOI:10.1109/TIP.2019.2947780delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Zero-shot learning aims to recognize objects which do not appear in the training dataset. Previous prevalent mapping-based zero-shot learning methods suffer from the projection domain shift problem due to the lack of image classes in the training stage. In order to alleviate the projection domain shift problem, a deep unbiased embedding transfer (DUET) model is proposed in this paper. The DUET model is composed of a deep embedding transfer (DET) module and an unseen visual feature generation (UVG) module. In the DET module, a novel combined embedding transfer net which integrates the complementary merits of the linear and nonlinear embedding mapping functions is proposed to connect the visual space and semantic space. Whats more, the end-to-end joint training process is implemented to train the visual feature extractor and the combined embedding transfer net simultaneously. In the UVG module, a visual feature generator trained with a conditional generative adversarial framework is used to synthesize the visual features of the unseen classes to ease the disturbance of the projection domain shift problem. Furthermore, a quantitative index, namely the score of resistance on domain shift (ScoreRDS), is proposed to evaluate different models regarding their resistance capability on the projection domain shift problem. The experiments on five zero-shot learning benchmarks verify the effectiveness of the proposed DUET model. As demonstrated by the qualitative and quantitative analysis, the unseen class visual feature generation, the combined embedding transfer net and the end-to-end joint training process all contribute to alleviating projection domain shift in zero-shot learning.
Keyword:
Visualization
Feature extraction
Semantics
Training
Seals
Prototypes
Indexes
Zero-shot learning
image classification
projection domain shift
convolutional neural network
generative adversarial network
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

U
university of chinese academy of sciences, cas
学者数:
4.1W
论文数: 3.8W
被引数: 75
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

Sclerostin deficient mice rapidly heal bone defects by activating β-catenin and increasing intramembranous ossification
err2013-11-01
err0
errOAAI
errMeghan E. McGee-Lawrence; Zachary C. Ryan; Lomeli R. Carpio; Sanjeev Kakar; Jennifer J. Westendorf; Rajiv Kumar
err分享
err收藏
Raman heterodyne detection of nuclear magnetic resonance
err1983-11-01
err0
PREAI
errN. C. Wong; E. S. Kintzer; J. Mlynek; R. G. DeVoe; R. G. Brewer
err分享
err收藏
STUDIES OF ARTHROPOD‐BORNE VIRUS INFECTIONS IN QUEENSLAND
err1963-02-01
err0
PREAI
errRL Doherty; JG Carley; M Josephine Mackerras; Elizabeth N Marks
err分享
err收藏
Zero-Shot Learning With Transferred Samples
err2017-07-01
err84
PREAI
errGuo, Yuchen; Ding, Guiguang; Han, Jungong; Gao, Yue
err分享
err收藏
ImageNet Large Scale Visual Recognition ChallengeImageNet大规模视觉识别挑战
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
err分享
err收藏
Small- and wide-angle elastic light scattering study of fibrin structure
err2003-04-16
err0
PREAI
errM. De Spirito; G. Arcòvito; M. Papi; M. Rocco; F. Ferri
err分享
err收藏
err分享
err收藏
学者 查看更多内容