arrow
返回

Semantics-Preserving Graph Propagation for Zero-Shot Object Detection

delete2020-01-01
delete54
PRE
AI
C
Caixia Yan *
Q
Qinghua Zheng
Xiaojun Chang 封面图
Xiaojun Chang (Xiaojun Chang)
罗敏楠 封面图
罗敏楠 (Minnan Luo)
C
Chung‐Hsing Yeh
A
Alexander G. Hauptman
DOI:10.1109/TIP.2020.3011807delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Most existing object detection models are restricted to detecting objects from previously seen categories, an approach that tends to become infeasible for rare or novel concepts. Accordingly, in this paper, we explore object detection in the context of zero-shot learning, i.e., Zero-Shot Object Detection (ZSD), to concurrently recognize and localize objects from novel concepts. Existing ZSD algorithms are typically based on a strict mapping-transfer strategy that suffers from a significant visual-semantic gap. To bridge the gap, we propose a novel Semantics-Preserving Graph Propagation model for ZSD based on Graph Convolutional Networks (GCN). More specifically, we develop a graph construction module to flexibly build category graphs by leveraging diverse correlations between category nodes; this is followed by two semantics-preserving graph propagation modules that enhance both category and region representations. Benefiting from the multi-step graph propagation process, both the semantic description and structural knowledge exhibited in prior category graphs can be effectively leveraged to boost the generalization capability of the learned projection function. Experiments on existing seen/unseen splits of three popular object detection datasets demonstrate that the proposed approach performs favorably against state-of-the-art ZSD methods.
Keyword:
Semantics
Object detection
Task analysis
Visualization
Motorcycles
Bicycles
Correlation
Zero-shot object detection
semantic embedding
semantic relation
graph propagation
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

M
Monash University
学者数:
5.4W
论文数: 5.4W
被引数: 79
X
xi'an jiaotong university
学者数:
9.3W
论文数: 6.7W
被引数: 75
C
Carnegie Mellon University
学者数:
1.4W
论文数: 1.4W
被引数: 2.7W
学者 查看更多机构
引用论文

引用论文

Conductivity Enhancement in Thin Silicon-on-Insulator Layer Embedding Artificial Dislocation Network
err2011-02-01
err0
PREAI
errYasuhiko Ishikawa; Kazuaki Yamauchi; Chihiro Yamamoto; Michiharu Tabe
err分享
err收藏
Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations视觉基因组: 使用众包密集图像注释连接语言和视觉
err2017-02-06
err3.1K
errOAAI
errKrishna, Ranjay; Zhu, Yuke; Groth, Oliver; Johnson, Justin; Hata, Kenji; Kravitz, Joshua; Chen, Stephanie; Kalantidis, Yannis; Li, Li-Jia; Shamma, David A.; Bernstein, Michael S.; Li Fei-Fei
err分享
err收藏
err分享
err收藏
Zero-Shot Learning via Attribute Regression and Class Prototype Rectification
err2018-02-01
err51
PREAI
errLuo, Changzhi; Li, Zhetao; Huang, Kaizhu; Feng, Jiashi; Wang, Meng
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
ImageNet Large Scale Visual Recognition ChallengeImageNet大规模视觉识别挑战
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
err分享
err收藏
学者 查看更多内容