.png){kind=icon}
Return
A tree-based model with branch parallel decoding for handwritten mathematical expression recognition
.png){kind=icon}
PRE
AI
DOI：10.1016/j.patcog.2023.110220.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Handwritten mathematical expression recognition (HMER) is a challenging task in the field of computer vision due to the complex two-dimensional spatial structure and diverse handwriting styles of mathematical expressions (MEs). Recent mainstream approach treats MEs as objects with tree structures, modeled by sequence decoders or tree decoders. These decoders recognize the symbols and relationships between symbols in MEs in depth-first order, resulting in long decoding steps that can harm their performance, particularly for MEs with complex structures. In this paper, we propose a novel tree-based model with branch parallel decoding for HMER, which parses the structures of ME trees by explicitly predicting the relationships between symbols. In addition, a query constructing module is proposed to assist the decoder in decoding the branches of ME trees in parallel, thus reducing the number of decoding time steps and alleviating the problem of long sequence attention decoding. As a result, our model outperforms existing models on three widely-used benchmarks and demonstrates significant improvements in HMER performance.
Keywords:
Handwritten mathematical expression
recognition
Tree-based model
Parallel decoding
Attention mechanism
Journal
IF:
7.6
Papers:
1.3W
Citations:
4.5W
Organization
Cited Papers
ShareSaveTree-based data augmentation and mutual learning for offline handwritten mathematical expression recognition.png)
PATTERN RECOGNITION
PATTERN RECOGNITIONIF7.6
PREAI
ShareSaveError detection, error correction and performance evaluation in on-line mathematical expression recognitionPATTERN RECOGNITION
OAAI
PATTERN RECOGNITIONIF7.6
OAAIShareSaveOn the Ecology of the Vegetation of Breckland: III. General Effects of Rabbits on the VegetationOAAI
OAAIShareSaveAn integrated grammar-based approach for mathematical expression recognitionPATTERN RECOGNITIONOAAI
PATTERN RECOGNITIONIF7.6
OAAIShareSave
View more