arrow
Return

DRFN: A unified framework for complex document layout analysis

delete2023-05-01
delete3
PRE
AI
X
Xingjiao Wu
T
Tianlong Ma
X
Xiangcheng Du
J
Jing Yang
何亮 cover
何亮 (Liang He) *
DOI:10.1016/j.ipm.2023.103339delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Document layout analysis (DLA) plays a vital role in information processing and management. At this stage, the processing of non-Manhattan layout documents has become the bottleneck in implementing the universal document layout analysis framework. To address this challenge, we propose a Complex Document Semantic Structure Extraction non-Manhattan document layout dataset (CDSSE). Furthermore, we design a Dynamic Residual Feature fusion Network (DRFN) to integrate the feature differences between non-Manhattan layouts and Manhattan layouts. During the fusion process, the DRFN makes full use of low-dimensional information and maintains the integrity of high-level semantic information through a Dynamic Residual Fusion Block (DRF). To overcome model overfitting caused by data scarcity, we propose a novel Dynamic Selection Mechanism (DSM). We prove that the DRFN can achieve comparable results on all benchmark datasets. For the Manhattan layout document, F1 reached 89.5% on DSSE-200 and 95.1% on CS-150. For the non-Manhattan layout document, F1 reached 86.8% on CDSSE. In addition, we verified the effectiveness of the model structure. On all datasets, the performance of the model using DRF was significantly improved (DSSE-200: 76.6% vs. 80.3%, CS-150: 91.7% vs. 93.1%, 62.6% vs. 71.8%). The use of the DSM was also significantly improved (DSSE-200: 89.0% vs. 89.5%, CS-150: 94.3% vs. 95.1%, 84.8% vs. 86.8%).
Keywords:
document layout analysis
Deep learning
Dynamic residual feature Fusion
Information extraction
Information understanding

Journal

I
Information Processing and Management
IF:
6.9
Papers:
5.2K
Citations:
1.4W

Organization

E
east china normal university
Scholars:
3.0W
Papers: 2.1W
Citations: 25
F
fudan university
Scholars:
11.7W
Papers: 7.7W
Citations: 121