arrow
Return

DRFN: A unified framework for complex document layout analysis

delete2023-05-01
delete3
PRE
AI
X
Xingjiao Wu
T
Tianlong Ma
X
Xiangcheng Du
J
Jing Yang
何亮 cover
何亮 (Liang He) *
DOI:10.1016/j.ipm.2023.103339delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Document layout analysis (DLA) plays a vital role in information processing and management. At this stage, the processing of non-Manhattan layout documents has become the bottleneck in implementing the universal document layout analysis framework. To address this challenge, we propose a Complex Document Semantic Structure Extraction non-Manhattan document layout dataset (CDSSE). Furthermore, we design a Dynamic Residual Feature fusion Network (DRFN) to integrate the feature differences between non-Manhattan layouts and Manhattan layouts. During the fusion process, the DRFN makes full use of low-dimensional information and maintains the integrity of high-level semantic information through a Dynamic Residual Fusion Block (DRF). To overcome model overfitting caused by data scarcity, we propose a novel Dynamic Selection Mechanism (DSM). We prove that the DRFN can achieve comparable results on all benchmark datasets. For the Manhattan layout document, F1 reached 89.5% on DSSE-200 and 95.1% on CS-150. For the non-Manhattan layout document, F1 reached 86.8% on CDSSE. In addition, we verified the effectiveness of the model structure. On all datasets, the performance of the model using DRF was significantly improved (DSSE-200: 76.6% vs. 80.3%, CS-150: 91.7% vs. 93.1%, 62.6% vs. 71.8%). The use of the DSM was also significantly improved (DSSE-200: 89.0% vs. 89.5%, CS-150: 94.3% vs. 95.1%, 84.8% vs. 86.8%).
Keywords:
document layout analysis
Deep learning
Dynamic residual feature Fusion
Information extraction
Information understanding

Journal

I
Information Processing and Management
IF:
6.9
Papers:
5.2K
Citations:
1.4W

Organization

E
east china normal university
Scholars:
3.1W
Papers: 2.1W
Citations: 25
F
fudan university
Scholars:
11.8W
Papers: 7.7W
Citations: 121
Cited Papers

Cited Papers

Electrical conductivity of quasi-two-dimensional foams
err2015-04-02
err0
errOAAI
errPavel Yazhgur; Clément Honorez; Wiebke Drenckhan; Dominique Langevin; Anniina Salonen
errShare
errSave
errShare
errSave
Document Layout Analysis: A Comprehensive Survey
err2019-10-16
err95
PREAI
errBinmakhashen, Galal M.; Mahmoud, Sabri A.
errShare
errSave
Domain Invariant and Class Discriminative Feature Learning for Visual Domain Adaptation
err2018-09-01
err206
PREAI
errLi, Shuang; Song, Shiji; Huang, Gao; Ding, Zhengming; Wu, Cheng
errShare
errSave
Electrochemically assisted micro localized grafting of aptamers in a microchannel engraved in fluorinated thermoplastic polymer Dyneon THV
err2015-01-01
err0
PREAI
errC. Perréard; Y. Ladner; F. d'Orlyé; S. Descroix; V. Taniga; A. Varenne; F. Kanoufi; C. Slim; S. Griveau; F. Bedioui
errShare
errSave
Distant regulatory elements in a Sox10‐βGEO BAC transgene are required for expression of Sox10 in the enteric nervous system and other neural crest‐derived tissues
err2006-04-03
err0
errOAAI
errKaren K. Deal; V. Ashley Cantrell; Ronald L. Chandler; Thomas L. Saunders; Douglas P. Mortlock; E. Michelle Southard‐Smith
errShare
errSave
researcher View more