arrow
Return

Zero-Shot Visual Recognition via Semantic Attention-Based Compare Network

delete2020-01-01
delete2
delete
OA
AI
F
Fudong Nian *
Y
Yikun Sheng
J
Junfeng Wang
DOI:10.1109/ACCESS.2020.2971174delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Zero-shot visual recognition aims to classify images whose classes are not have been seen in the training stage. Most of current approaches first project the attribute semantic feature and image feature into a common space, then the manually defined similarity measures or linear classifiers are used to recognize the unseen image. Different from the existing study, in this paper, we propose a novel Semantic Attention-based Compare Network (SACN) which is comprised of a visual feature extraction module, a feature fusion module and a similarity compare module. Our SACN has several advantages: (1) In visual feature extraction module, a convolutional neural network (CNN) with multi-losses is introduced to extract more distinguishing visual features. (2) In feature fusion module, an attribute semantic attention mechanism is proposed to associate visual feature and class semantic representation. (3) In similarity compare module, a distance compare network is presented to predict the similarities of the test image with all unseen classes. To evaluate the proposed model, we have conducted extensive experiments on two widely used benchmarks, and both qualitative and quantitative evaluation results have demonstrated the effectiveness of the proposed SACN. More importantly, the proposed method is the 2nd place solution to the AI Challenger 2018 (Global AI Contest).
Keywords:
Zero-shot learning
visual recognition
attribute attention
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

H
hefei university of technology
Scholars:
2.5W
Papers: 1.7W
Citations: 35
H
hefei university
Scholars:
2.3K
Papers: 1.3K
Citations: 20
A
anhui university
Scholars:
1.9W
Papers: 1.2W
Citations: 24
researcher View more organizations