.png){kind=icon}
返回
Co-attention graph convolutional network for visual question answering
.png){kind=icon}
PRE
AI
DOI：10.1007/s00530-023-01125-7.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Visual Question Answering (VQA) is a challenging task that requires a fine-grained understanding of both the visual content of images and the textual content of questions. Conventional visual attention model, which is designed primarily from the perspective of attention mechanism, lacks the ability to reason about relationships between visual objects and ignores the multimodal interactions between questions and images. In this work, we propose a combined both graph convolutional network and co-attention network to circumvent the aforementioned problem. The model employs binary relational reasoning as the graph learner module to learn a graph structure representation that captures relationships between visual objects and learns image representation related to the specific question that has an awareness of spatial location via spatial graph convolution. After that, we perform parallel co-attention learning by passing image representations and features of question words through a deep co-attention module. Experiment results demonstrate that the Overall accuracy of our model delivers 68.67% on the test-std set of the benchmark VQA v2.0 dataset, which outperforms most existing models.
Keyword:
Visual question answering
Binary relational reasoning
Spatial graph convolution
Attention mechanism
期刊
IF:
3.1
论文数:
2.8K
被引数:
2.7K
机构
引用论文
Factors influencing maternal health in indigenous communities with presence of traditional midwifery in the Americas: protocol for a scoping review.png)
BMJ Open
OAAI
BMJ OpenIF0
OAAI分享收藏Inhibition of Ferroptosis Attenuates Acute Kidney Injury in Rats with Severe Acute Pancreatitis
PREAI
分享收藏分享收藏分享收藏International financial reporting standards and experts’ perceptions of disclosure qualityAbacusOAAI
AbacusIF0
OAAI分享收藏
查看更多内容