arrow
Return

Complex knowledge base question answering with difficulty-aware active data augmentation

delete2025-06-01
delete0
PRE
AI
王东 (Dong Wang)
S
Sihang Zhou
C
Cong Zhou
K
Ke Liang
C
Chuanli Wang
J
Jian Huang *
DOI:10.1016/j.eswa.2025.127460delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Program induction-based semantic parsing is a crucial method for addressing complex knowledge base question answering. Traditional methods typically convert natural language questions into multi-step executable programs, which often require large amounts of accurately annotated question-program pairs to achieve high performance. Unfortunately, generating such high-quality annotated data is usually labor-intensive and relies on manual effort from domain experts, resulting in insufficient annotated data in real-world scenarios. To improve model performance in data-constrained environments, we propose DADA-CQA, a complex question answering method that uses difficulty-aware active data augmentation. This method leverages active learning to generate synthetic question-program pairs that resemble error samples in the validation set. First, representative error samples are clustered, then selected to create program templates. Second, these templates are instantiated by applying replacement rules within a KB-based program generation algorithm to produce synthetic programs with diverse compositions and correct arguments. Next, the synthetic programs are translated into semantically consistent synthetic questions using a prompt-based question generation method. Finally, these dynamically generated synthetic pairs are merged with the original training set for further training. Additionally, we introduce a voting ranker based on weighted voting mechanism to improve the prediction accuracy of multiple candidate programs during inference. Experimental results on KQA Pro demonstrate that DADA-CQA consistently outperforms previous baselines in both fully-supervised and low-resource settings, validating the effectiveness of difficulty-aware active data augmentation in improving model performance and training efficiency.
Keywords:
Program induction
Complex question answering
Active data augmentation
Synthetic pair generation
Voting ranker

Journal

Expert Systems with Applications cover
Expert Systems with Applications
IF:
7.5
Papers:
2.9W
Citations:
10.2W

Organization

C
cent south univ forestry technol
Scholars:
797
Papers: 276
Citations: 0
N
natl univ def technol
Scholars:
1.5K
Papers: 509
Citations: 141