.png){kind=icon}
返回
Coordinating explicit and implicit knowledge for knowledge-based VQA
.png){kind=icon}
PRE
AI
DOI：10.1016/j.patcog.2024.110368.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Pre -trained models often generate plausible looking statements that are factually incorrect because of the inaccurate implicit knowledge contained in the model's parameters. Related methods retrieve explicit knowledge from the external knowledge source to help improve the prediction performance and reliability. However, these methods often use weak training signals for the retriever, and require the model to make each prediction based on the retrieved knowledge, even when the retrieved knowledge is not reliable or the model can produce better prediction only using its implicit knowledge. Therefore, it is necessary to enable the pre -trained model to actively select more beneficial knowledge for producing better prediction. This work proposes a novel method to help the model to Coordinate Explicit and Implicit Knowledge (CEIK) for the knowledge -based visual question answering (VQA) task, which is an important direction of pre -trained models. Furthermore, a better training signal is proposed for the retriever according to whether the retrieved knowledge can correct the prediction. Experimental results demonstrate the effectiveness of our method.
Keyword:
Knowledge retrieval
Pre -trained model
Knowledge -based VQA
期刊
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
Experimental study of identification and control of structures using neural network. Part 2: control
PREAI
分享收藏分享收藏Cubic–Quartic Optical Soliton Perturbation with Differential Group Delay for the Lakshmanan–Porsezian–Daniel Model by Lie Symmetry.png)
Symmetry
OAAI
SymmetryIF0
OAAI分享收藏Learning visual question answering on controlled semantic noisy labels在受控语义噪声标签上学习视觉问答PATTERN RECOGNITION
PATTERN RECOGNITIONIF7.6
PREAI
分享收藏Visual question answering from another perspective: CLEVR mental rotation tests *PATTERN RECOGNITION
OAAI
PATTERN RECOGNITIONIF7.6
OAAI分享收藏
查看更多内容