.png){kind=icon}
返回
Dual-focus transfer network for zero-shot learning
.png){kind=icon}
PRE
AI
DOI：10.1016/j.neucom.2023.126264.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Zero-shot learning aims to recognize image categories which are unseen in the training phase of image classification models. The key to this task is to transfer the learned knowledge from seen classes to unseen classes. In order to make the knowledge transfer process more effective, we propose to exploit both the visual and semantic attention mechanisms simultaneously in zero-shot learning tasks. Specifically, a dual-focus transfer network (DFTN) model is proposed to implement attention mechanisms from both the visual and semantic ends in a mapping based zero-shot learning framework with a visual focus transfer (VFT) module and a semantic focus transfer (SFT) module. The VFT module is composed by multi-head self-attention networks, which endows salient parts of images with greater weights at different resolutions of the feature maps. The SFT module generates semantic weights to re-weight semantic attribute features with the guidance of visual representations, where the semantic attributes corresponding to more visual discrimination capability will obtain greater weights. Extensive experiments of zero-shot learning and generalized zero-shot learning on five representative benchmarks demonstrate the superiority of the proposed DFTN model, compared to other state-of-the-art methods. (c) 2023 Elsevier B.V. All rights reserved.
Keyword:
Zero-shot learning
Attention mechanism
Multi-head attention
Self-attention
Image classification
期刊
IF:
6.5
论文数:
2.5W
被引数:
6.5W
机构
引用论文
分享收藏RECOGNITION-BY-COMPONENTS - A THEORY OF HUMAN IMAGE UNDERSTANDING按组件识别-人类图像理解的理论.png)
PSYCHOLOGICAL REVIEW
OAAI
PSYCHOLOGICAL REVIEWIF5.8
OAAI分享收藏
查看更多内容