arrow
返回

A tree-based model with branch parallel decoding for handwritten mathematical expression recognition

delete2024-05-01
delete3
PRE
AI
Z
Zhe Li
W
Wentao Yang
H
Hengnian Qi
金
金连文 (Lianwen Jin) *
黄
黄毅超 (Yichao Huang)
K
Kai Ding
DOI:10.1016/j.patcog.2023.110220delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Handwritten mathematical expression recognition (HMER) is a challenging task in the field of computer vision due to the complex two-dimensional spatial structure and diverse handwriting styles of mathematical expressions (MEs). Recent mainstream approach treats MEs as objects with tree structures, modeled by sequence decoders or tree decoders. These decoders recognize the symbols and relationships between symbols in MEs in depth-first order, resulting in long decoding steps that can harm their performance, particularly for MEs with complex structures. In this paper, we propose a novel tree-based model with branch parallel decoding for HMER, which parses the structures of ME trees by explicitly predicting the relationships between symbols. In addition, a query constructing module is proposed to assist the decoder in decoding the branches of ME trees in parallel, thus reducing the number of decoding time steps and alleviating the problem of long sequence attention decoding. As a result, our model outperforms existing models on three widely-used benchmarks and demonstrates significant improvements in HMER performance.
Keyword:
Handwritten mathematical expression
recognition
Tree-based model
Parallel decoding
Attention mechanism

期刊

Pattern Recognition 封面图
Pattern Recognition
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

H
Huzhou University
学者数:
4.1K
论文数: 3.5K
被引数: 6.7K
S
south china university of technology
学者数:
6.8W
论文数: 5.1W
被引数: 85
引用论文

引用论文

Business model innovation for sustainability
err2021-04-02
err0
PREAI
errInge Oskam; Ard-Pieter de Man; Bart Bossink
err分享
err收藏
Tree-based data augmentation and mutual learning for offline handwritten mathematical expression recognition
err2022-12-01
err10
PREAI
errYang, Chen; Du, Jun; Zhang, Jianshu; Wu, Changjie; Chen, Mingjun; Wu, JiaJia
err分享
err收藏
err分享
err收藏
Handwritten Mathematical Expression Recognition via Paired Adversarial Learning
err2020-01-21
err46
PREAI
errWu, Jin-Wen; Yin, Fei; Zhang, Yan-Ming; Zhang, Xu-Yao; Liu, Cheng-Lin
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
An integrated grammar-based approach for mathematical expression recognition
err2016-03-01
err76
errOAAI
errAlvaro, Francisco; Sanchez, Joan-Andreu; Benedi, Jose-Miguel
err分享
err收藏
学者 查看更多内容