arrow
Return

Bayesian-error-informed contrastive learning for knowledge-based question answering systems

delete2025-04-01
delete0
PRE
AI
S
Sudarshan Yerragunta
R
Rajendra Prasath *
G
G. N. Girish
DOI:10.1016/j.compeleceng.2025.110142delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The Knowledge-base Question Answering (KBQA) system aims to answer a question based on a knowledge base (KB). However, incomplete knowledge bases (KBs) limit the performance of KBQA systems. To address this issue, we propose a contrastive regularization method that considers two modules to tackle this problem: knowledge expansion and a contrastive loss function, Bayesian-error-informed Contrastive Learning (BeCoL). These modules leverage latent knowledge from context KBs and their associated question-answer pairs to generate more such pairs. Additionally, we use these question-answer pairs for informative representation learning, which makes hard positive pairs attract and hard negative pairs separate. This approach will enhance the ability of the system to distinguish the pairs better, ultimately improving the systems performance. We evaluate our proposed approach on the WebQuestionSP (WebQSP), ComplexWebQuestions (CompWebQ), and GrailQA datasets. The results indicate that our approach outperforms existing methods across different KB settings in the WebQSP dataset at 10%, 30%, 50%, and 100% with Hits@1 scores of 43.8, 49.7, 61.3, and 73.7 respectively, and with F1-scores of 28.2, 32.5, 44.3, and 61.1 respectively. Similarly, we achieved Hits@1 score of 52.7 and F1-score of 44.2 on the CompWebQ dataset with 100% KB setting. For the GrailQA dataset under the 100% KB setting, our method attained an Exact Match (EM) score of 67.5 and an F1-score of 76.4. The findings demonstrate the proposed methods capacity to address low-resource settings and significantly improve the performance of KBQA systems. The code is available at https://github.com/ysudarshan-collab/BeCoL.
Keywords:
Question answering
Knowledge-based QA
Incomplete knowledge base
Knowledge aware text reader
Gating mechanisms
Contrastive learning

Journal

C
Computers and Electrical Engineering
IF:
4.9
Papers:
6.7K
Citations:
1.3W

Organization

No organization information available
Cited Papers

Cited Papers

Recent Trends in Deep Learning Based Open-Domain Textual Question Answering Systems
err2020-01-01
err31
errOAAI
errHuang, Zhen; Xu, Shiyi; Hu, Minghao; Wang, Xinyi; Qiu, Jinyan; Fu, Yongquan; Zhao, Yuncai; Peng, Yuxing; Wang, Changjian
errShare
errSave
DBpedia - A large-scale, multilingual knowledge base extracted from Wikipedia
err2015-01-01
err2.0K
errOAAI
errLehmann, Jens; Isele, Robert; Jakob, Max; Jentzsch, Anja; Kontokostas, Dimitris; Mendes, Pablo N.; Hellmann, Sebastian; Morsey, Mohamed; van Kleef, Patrick; Auer, Soeren; Bizer, Christian
errShare
errSave
Identification of SPOP related metabolic pathways in prostate cancer
err2017-10-03
err0
errOAAI
errMin Yan; Huan Qi; Jia Li; Guozhu Ye; Yaping Shao; Tongming Li; Jing Liu; Hai-Long Piao; Guowang Xu
errShare
errSave
Automatically extracting information needs from complex clinical questions
err2010-12-01
err34
errOAAI
errCao, Yong-gang; Cimino, James J.; Ely, John; Yu, Hong
errShare
errSave
Tiron as a substrate for mushroom tyrosinase
err1987-01-01
err0
PREAI
errVarda Kahn; Richard W. Miller
errShare
errSave
researcher View more