.png){kind=icon}
返回
Explaining the semantics capturing capability of scene graph generation models
.png){kind=icon}
PRE
AI
DOI：10.1016/j.patcog.2020.107427.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Deep neural network is a effective way for scene graph generation tasks. However, it also makes the scene graph generation models difficult to explain. For instance, the current standard metric cannot explain how capable neural network models are of capturing the semantics of relations. In this paper, we try to understand the semantics capturing capability of scene graph generation models based on three types of metrics: conformance recall, violation recall, and non-violation recall, which measure semantic properties of relations that are reflected by triples in scene graph generated by models. Evaluation of these metrics on three representative state-of-the-art scene graph generation models based on deep neural network in Visual Genome dataset shows that the proposed metrics can effectively explain the capability of models to capture different semantic properties and identify design problems in models. By extending the Visual Genome dataset with different sets of additional annotations, these metrics can also explaining whether the semantics capturing capability of deep neural network models can be improved by data enhancement. (c) 2020 Elsevier Ltd. All rights reserved.
Keyword:
Explanation
Metrics
Semantic property
Scene graph generation
Deep neural network
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations视觉基因组: 使用众包密集图像注释连接语言和视觉
OAAI
.png){kind=icon}
OAAI分享收藏分享收藏Zirconium‐Assisted Activation of Palladium To Boost Syngas Production by Methane Dry Reforming锆辅助钯活化甲烷干重整促进合成气生产OAAI
OAAI分享收藏分享收藏 没有更多内容
没有更多内容