arrow
返回

Deep Unrestricted Document Image Rectification

delete2024-01-01
delete1
delete
OA
AI
H
Hao Feng
S
Shaokai Liu
J
Jiajun Deng
W
Wengang Zhou
李
李厚强 (Houqiang Li) *
DOI:10.1109/TMM.2023.3347094delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In recent years, tremendous efforts have been made on document image rectification, but existing advanced algorithms are limited to processing restricted document images, i.e., the input images must incorporate a complete document. Once the captured image merely involves a local text region, its rectification quality is degraded and unsatisfactory. Our previously proposed DocTr, a transformer-assisted network for document image rectification, also suffers from this limitation. In this work, we present DocTr++, a novel unified framework for document image rectification, without any restrictions on the input distorted images. Our major technical improvements can be concluded in three aspects. Firstly, we upgrade the original architecture by adopting a hierarchical encoder-decoder structure for multi-scale representation extraction and parsing. Secondly, we reformulate the pixel-wise mapping relationship between the unrestricted distorted document images and the distortion-free counterparts. The obtained data is used to train our DocTr++ for unrestricted document image rectification. Thirdly, we contribute a real-world test set and metrics applicable for evaluating the rectification quality. To our best knowledge, this is the first learning-based method for the rectification of unrestricted document images. Extensive experiments are conducted, and the results demonstrate the effectiveness and superiority of our method. We hope our DocTr++ will serve as a strong baseline for generic document image rectification, prompting the further advancement and application of learning-based algorithms.
Keyword:
Document image rectification
Unrestricted document images
Transformer

期刊

IEEE Transactions on Multimedia 封面图
IEEE Transactions on Multimedia
IF:
9.7
论文数:
4.6K
被引数:
2.4W

机构

Z
Zhangjiang Laboratory
学者数:
548
论文数: 395
被引数: 2
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

Multimodal Pre-Training Based on Graph Attention Network for Document Understanding
err2023-01-01
err8
errOAAI
errZhang, Zhenrong; Ma, Jiefeng; Du, Jun; Wang, Licheng; Zhang, Jianshu
err分享
err收藏
Gastroprotective Activity of Hydroalcoholic Extract of the Stryphnodendron rotundifolium Mart. in Mice: Mechanism Actions Assay
err2018-01-31
err0
PREAI
errDayanne Rakelle de Oliveira; Lucindo Jose Quintans-Junior; Thais Rodrigues de Albuquerque; Francisco Elizaudo de Brito Junior; Cicera Norma Fernandes; Heloisa Helena Fernandes de Souza; Aline Augusti Boligon; Margareth Linde Athayde; Cicero Bezerra Felipe; Henrique Douglas Melo Coutinho; Roseli Barbosa; Marta Regina Kerntopf; Irwin Rose Alencar de Menezes
err分享
err收藏
Blind Image Quality Estimation via Distortion Aggravation
err2018-06-01
err328
PREAI
errMin, Xiongkuo; Zhai, Guangtao; Gu, Ke; Liu, Yutao; Yang, Xiaokang
err分享
err收藏
Document Rectification and Illumination Correction using a Patch-based CNN
err2019-11-08
err32
errOAAI
errLi, Xiaoyu; Zhang, Bo; Liao, Jing; Sander, Pedro, V
err分享
err收藏
U2-Net: Going deeper with nested U-structure for salient object detectionU2-Net: 基于嵌套U结构的显著性目标检测
err2020-10-01
err1.2K
errOAAI
errQin, Xuebin; Zhang, Zichen; Huang, Chenyang; Dehghan, Masood; Zaiane, Osmar R.; Jagersand, Martin
err分享
err收藏
err分享
err收藏
DEVELOPMENTS IN AUTOMATIC TEXT RETRIEVAL
errSCIENCE
IF45.8
err1991-08-30
err421
PREAI
errSALTON, G
err分享
err收藏
学者 查看更多内容