.png){kind=icon}
.png){kind=icon}
Return
A Robust Framework for One-Shot Key Information Extraction via Deep Partial Graph Matching
.png){kind=icon}
PRE
AI
DOI：10.1109/TIP.2024.3357251.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Text field labelling plays a key role in Key Information Extraction (KIE) from structured document images. However, existing methods ignore the field drift and outlier problems, which limit their performance and make them less robust. This paper casts the text field labelling problem into a partial graph matching problem and proposes an end-to-end trainable framework called Deep Partial Graph Matching (dPGM) for the one-shot KIE task. It represents each document as a graph and estimates the correspondence between text fields from different documents by maximizing the graph similarity of different documents. Our framework obtains a strict one-to-one correspondence by adopting a combinatorial solver module with an extra one-to-(at most)-one mapping constraint to do the exact graph matching, which leads to the robustness of the field drift problem and the outlier problem. Finally, a large one-shot KIE dataset named DKIE is collected and annotated to promote research of the KIE task. This dataset will be released to the research and industry communities. Extensive experiments on both the public and our new DKIE datasets show that our method can achieve state-of-the-art performance and is more robust than existing methods.
Keywords:
Labeling
Task analysis
Layout
Information retrieval
Data mining
Text recognition
Text detection
Document understanding
key information extraction
visual information extraction
graph matching
Journal
IF:
13.7
Papers:
1.0W
Citations:
8.4W