arrow
Return

A diversity-enhanced knowledge distillation model for practical math word problem solving

delete2025-05-01
delete4
delete
OA
AI
Y
Yi Zhang
G
Guangyou Zhou
谢志文 cover
谢志文 (Zhiwen Xie)
J
Jinjin Ma
DOI:10.1016/j.ipm.2025.104059delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Math Word Problem (MWP) solving is a critical task in natural language processing, has garnered significant research interest in recent years. Various recent studies heavily rely on Seq2Seq models and their extensions (e.g., Seq2Tree and Graph2Tree) to generate mathematical equations. While effective, these models struggle to generate diverse but counterpart solution equations, limiting their generalization across various math problem scenarios. In this paper, we introduce a novel Diversity-enhanced Knowledge Distillation (DivKD) model for practical MWP solving. Our approach proposes an adaptive diversity distillation method, in which a student model learns diverse equations by selectively transferring high-quality knowledge from a teacher model. Additionally, we design a diversity prior-enhanced student model to better capture the diversity distribution of equations by incorporating a conditional variational auto-encoder. Extensive experiments on four MWP benchmark datasets demonstrate that our approach achieves higher answer accuracy than strong baselines while maintaining high efficiency for practical applications.
Keywords:
Knowledge distillation
Math word problem
Variational auto-encoder
Question answering
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

I
Information Processing and Management
IF:
6.9
Papers:
5.2K
Citations:
1.4W

Organization

No organization information available