.png){kind=icon}
返回
Radial Graph Convolutional Network for Visual Question Generation
.png){kind=icon}
PRE
AI
DOI：10.1109/TNNLS.2020.2986029.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In this article, we address the problem of visual question generation (VQG), a challenge in which a computer is required to generate meaningful questions about an image targeting a given answer. The existing approaches typically treat the VQG task as a reversed visual question answer (VQA) task, requiring the exhaustive match among all the image regions and the given answer. To reduce the complexity, we propose an innovative answer-centric approach termed radial graph convolutional network (Radial-GCN) to focus on the relevant image regions only. Our Radial-GCN method can quickly find the core answer area in an image by matching the latent answer with the semantic labels learned from all image regions. Then, a novel sparse graph of the radial structure is naturally built to capture the associations between the core node (i.e., answer area) and peripheral nodes (i.e., other areas); the graphic attention is subsequently adopted to steer the convolutional propagation toward potentially more relevant nodes for final question generation. Extensive experiments on three benchmark data sets show the superiority of our approach compared with the reference methods. Even in the unexplored challenging zero-shot VQA task, the synthesized questions by our method remarkably boost the performance of several state-of-the-art VQA methods from 0% to over 40%. The implementation code of our proposed method and the successfully generated questions are available at https://github.com/Wangt-CN/VQG-GCN.
Keyword:
Task analysis
Visualization
Training
Data models
Semantics
Convolution
Cross-media understanding
graph convolutional network (GCN)
visual question generation (VQG)
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
8.9
论文数:
7.6K
被引数:
7.2W
机构
引用论文
Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answering使VQA中的V重要: 提升图像理解在视觉问答中的作用
OAAI
OAAI分享收藏Information fusion in visual question answering: A Survey视觉问答中的信息融合: 一项调查.png)
INFORMATION FUSION
INFORMATION FUSIONIF15.5
PREAI
分享收藏Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations视觉基因组: 使用众包密集图像注释连接语言和视觉OAAI
OAAI分享收藏分享收藏Distinct pattern of c-fos mRNA expression after systemic and intra-accumbens amphetamine and MK-801Neuroscience
NeuroscienceIF0
PREAI
分享收藏Reduced ACTH, while normal β-endorphin CSF levels in early epileptic encephalopathiesPeptides
PeptidesIF0
PREAI
分享收藏
查看更多内容