arrow
Return

Integrating Heterogeneous Graphs Using Graph Transformer Encoder for Solving Math Word Problems

delete2023-01-01
delete0
delete
OA
AI
S
Soyun Shin
J
Jaehui Park *
DOI:10.1109/ACCESS.2023.3257571delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This paper introduces a novel method that integrates structural information with training deep neural models to solve math word problems. Prior works adopt the graph structure to represent rich information residing in the input sentences. However, they lack the consideration of different relation types between other parts of the sentences. To provide various types of structural information in a uniform way, we propose a graph transformer encoder to integrate heterogeneous graphs of various input representations. We developed two types of graph structures. First, the Dependency Graph maintains long-distance lexical dependency between words and quantities. Second, the Question Overlap Graph captures the gist within the problem body. The two graphs are encoded as a single graph for graph transformation. Experimental results show that our method produces competitive results compared to the baselines. Our model outperforms state-of-the-art models in Equation and Answer accuracy near three percent in SVAMP benchmark. Moreover, we discuss that integrating different types of textual characteristics may improve the quality of mathematical logic inference from natural language sentences.
Keywords:
Mathematical models
Transformers
Graph neural networks
Cognition
Heterogeneous networks
Decoding
Math word problems
heterogeneous graphs
graph transformer networks
graph neural networks

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

U
University of Seoul
Scholars:
3.5K
Papers: 4.5K
Citations: 4.4K
Cited Papers

Cited Papers

Interprofessional and Interdisciplinary Collaboration in Nursing
err2012-11-01
err0
PREAI
errJana L. Pressler; Carole A. Kenner
errShare
errSave
Insomnia és elalvást segítő szokások felmérése felnőttek körében
err2016-12-01
err0
errOAAI
errKatalin Fusz; Béla Faludi; Dorina Pusztai; Nóra Sebők; András Oláh
errShare
errSave
YAC transgene-mediated olfactory receptor gene choice
err2000-02-01
err0
errOAAI
errFarah A.W. Ebrahimi; James Edmondson; Rodney Rothstein; Andrew Chess
errShare
errSave
Panel Data Models of New Firm Formation in New England
err2017-10-20
err0
errOAAI
errJitendra Parajuli; Kingsley E. Haynes
errShare
errSave
Association between Perceived Neighborhood Built Environment and Walking and Cycling for Transport among Inhabitants from Latin America: The ELANS Study
err2020-09-19
err0
errOAAI
errGerson Ferrari; André Oliveira Werneck; Danilo Rodrigues da Silva; Irina Kovalskys; Georgina Gómez; Attilio Rigotti; Lilia Yadira Cortés Sanabria; Martha García; Rossina Pareja; Marianella Herrera-Cuenca; Ioná Zimberg; Viviana Guajardo; Michael Pratt; Cristian Cofre Bolados; Emilio Saldía; Carlos Pires; Adilson Marques; Miguel Peralta; Eduardo Rossato de Victo; Mauro Fisberg
errShare
errSave
errShare
errSave
researcher View more