arrow
返回

GraphRevisedIE: Multimodal information extraction with graph-revised network

delete2023-08-01
delete6
PRE
AI
P
Panfeng Cao *
J
Jian Wu
DOI:10.1016/j.patcog.2023.109542delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Key information extraction (KIE) from visually rich documents (VRD) has been a challenging task in document intelligence because of not only the complicated and diverse layouts of VRD that make the model hard to generalize but also the lack of methods to exploit the multimodal features in VRD. In this paper, we propose a light-weight model named GraphRevisedIE that effectively embeds multimodal features such as textual, visual, and layout features from VRD and leverages graph revision and graph convolution to enrich the multimodal embedding with global context. Extensive experiments on multiple real-world datasets show that GraphRevisedIE generalizes to documents of varied layouts and achieves comparable or better performance compared to previous KIE methods. We also publish a business license dataset that contains both real-life and synthesized documents to facilitate research of document KIE. (c) 2023 Elsevier Ltd. All rights reserved.
Keyword:
Document information extraction
Graph convolutional network
Transformer

期刊

Pattern Recognition 封面图
Pattern Recognition
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

U
University of Michigan
学者数:
6.4W
论文数: 5.3W
被引数: 124
U
university of michigan system
学者数:
9.1W
论文数: 8.6W
被引数: 133
引用论文

引用论文

err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
Convective vortices and dust devils detected and characterized by Mars 2020
err
IF0
err2022-08-13
err0
errOAAI
errRicardo Hueso; Claire Newman; Teresa del Rio-Gaztelurrutia; Asier Munguira; Agustín Sánchez-Lavega; Daniel Toledo; Víctor Apéstigue; Ignacio Arruego; Alvaro Vicente-Retortillo; German Martinez; Mark T Lemmon; Ralph D. Lorenz; Mark Ian Richardson; Daniel Viúdez-Moreiras; Manuel de la Torre Juárez; Jose Antonio Rodríguez-Manfredi; Leslie Tamppari; Naomi Murdoch; Sara Navarro López; Javier Gomez-Elvira; Mariah Baker; Jorge Pla-García; Ari-Matti Harri; Maria Hieta; Maria Genzer; Jouni Polkko; Iina Jaakonaho; Teemu J T Mäkinen; Alexander Stott; David Mimoun; Baptiste Chide; Eduardo Sebastian Martínez; Donald Banfield; Alain Lepinette Malvitte
err分享
err收藏