.png){kind=icon}
返回
Inner Knowledge-based Img2Doc Scheme for Visual Question Answering
.png){kind=icon}
PRE
AI
DOI：10.1145/3489142.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Visual Question Answering (VQA) is a research topic of significant interest at the intersection of computer vision and natural language understanding. Recent research indicates that attributes and knowledge can effectively improve performance for both image captioning and VQA. In this article, an inner knowledge-based Img2Doc algorithm for VQA is presented. The inner knowledge is characterized as the inner attribute relationship in visual images. In addition to using an attribute network for inner knowledge-based image representation, VQA scheme is associated with a question-guided Doc2Vec method for question-answering. The attribute network generates inner knowledge-based features for visual images, while a novel question-guided Doc2Vec method aims at converting natural language text to vector features. After the vector features are extracted, they are combined with visual image features into a classifier to provide an answer. Based on our model, the VQA problem is resolved by textual question answering. The experimental results demonstrate that the proposed method achieves superior performance on multiple benchmark datasets.
Keyword:
VQA
dense image captioning
Doc2Vec
inner knowledge-based
attribute network
期刊
IF:
6
论文数:
2.0K
被引数:
5.4K
机构
引用论文
Kinematic analysis of limb movements in neuropsychological research: Subtle deficits and recovery of function.神经心理学研究中肢体运动的运动学分析: 细微的缺陷和功能的恢复。
PREAI
分享收藏
<title>Orthogonal and biorthogonal multiwavelets for signal denoising and image compression</title>
PREAI
分享收藏
Distinct pattern of c-fos mRNA expression after systemic and intra-accumbens amphetamine and MK-801.png)
Neuroscience
NeuroscienceIF0
PREAI
分享收藏分享收藏
查看更多内容