arrow
Return

Complex knowledge base question answering with difficulty-aware active data augmentation

delete2025-06-01
delete0
PRE
AI
王
王东 (Dong Wang)
S
Sihang Zhou
C
Cong Zhou
K
Ke Liang
C
Chuanli Wang
J
Jian Huang *
DOI:10.1016/j.eswa.2025.127460delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Program induction-based semantic parsing is a crucial method for addressing complex knowledge base question answering. Traditional methods typically convert natural language questions into multi-step executable programs, which often require large amounts of accurately annotated question-program pairs to achieve high performance. Unfortunately, generating such high-quality annotated data is usually labor-intensive and relies on manual effort from domain experts, resulting in insufficient annotated data in real-world scenarios. To improve model performance in data-constrained environments, we propose DADA-CQA, a complex question answering method that uses difficulty-aware active data augmentation. This method leverages active learning to generate synthetic question-program pairs that resemble error samples in the validation set. First, representative error samples are clustered, then selected to create program templates. Second, these templates are instantiated by applying replacement rules within a KB-based program generation algorithm to produce synthetic programs with diverse compositions and correct arguments. Next, the synthetic programs are translated into semantically consistent synthetic questions using a prompt-based question generation method. Finally, these dynamically generated synthetic pairs are merged with the original training set for further training. Additionally, we introduce a voting ranker based on weighted voting mechanism to improve the prediction accuracy of multiple candidate programs during inference. Experimental results on KQA Pro demonstrate that DADA-CQA consistently outperforms previous baselines in both fully-supervised and low-resource settings, validating the effectiveness of difficulty-aware active data augmentation in improving model performance and training efficiency.
Keywords:
Program induction
Complex question answering
Active data augmentation
Synthetic pair generation
Voting ranker

Journal

Expert Systems with Applications cover
Expert Systems with Applications
IF:
7.5
Papers:
3.0W
Citations:
10.2W

Organization

C
cent south univ forestry technol
Scholars:
797
Papers: 276
Citations: 0
N
natl univ def technol
Scholars:
1.5K
Papers: 509
Citations: 141
Cited Papers

Cited Papers

errShare
errSave
FlexKBQA: A Flexible LLM-Powered Framework for Few-Shot Knowledge Base Question Answering
err2024-03-24
err0
errOAAI
errZhenyu Li; Sunqi Fan; Yu Gu; Xiuxing Li; Zhichao Duan; Bowen Dong; Ning Liu; Jianyong Wang
errShare
errSave
Chinese mineral question and answering system based on knowledge graph
err2023-11-01
err15
PREAI
errLiu, Chengjian; Ji, Xiaohui; Dong, Yuhang; He, Mingyue; Yang, Mei; Wang, Yuzhu
errShare
errSave
Key-Value Memory Networks for Directly Reading Documents
err2016-01-01
err0
errOAAI
errAlexander Miller; Adam Fisch; Jesse Dodge; Amir-Hossein Karimi; Antoine Bordes; Jason Weston
errShare
errSave
A contrastive framework for enhancing Knowledge Graph Question Answering: Alleviating exposure bias
err2023-11-01
err3
PREAI
errDu, Huifang; Zhang, Xixie; Wang, Meng; Chen, Yunwen; Ji, Daqi; Ma, Jun; Wang, Haofen
errShare
errSave
researcher View more