arrow
返回

NDOrder: Exploring a novel decoding order for scene text recognition

delete2024-09-01
delete1
PRE
AI
H
Hongjian Zhan *
S
Shujing Lyu
C
Cong Liu
B
Bing Yin
P
Palaiahnakote Shivakumara
U
Umapada Pal
Y
Yue Lu
DOI:10.1016/j.eswa.2024.123771delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Text recognition in scene images is still considered as a challenging task for the computer vision and pattern recognition community. For text images affected by multiple adverse factors, such as occlusion (due to obstacles) and poor quality (due to blur and low resolution), the performance of the state-of-the-art scene text recognition methods degrades. The key reason is that the existing encoder-decoder framework follows fixed left -to -right decoding order, which lacks sufficient contextual information. In this paper, we present a novel decoding order where good -quality characters can first be decoded followed by low -quality characters, which preserves the contextual information irrespective of the aforementioned difficult scenarios. Our method, named NDOrder, extracts visual features with a ViT encoder and then decodes with the Random Order Generation module (ROG) for learning to decode with random decoding orders and the Vision -Content -Position module (VCP) for exploiting the connections among visual information, content and position. In addition, a new dataset named OLQT (Occluded and Low -Quality Text) is created by manually collecting text images that suffer from occlusion or low -quality from several standard text recognition datasets. The dataset is now available at https://github.com/djzhong1/OLQT. Experiments on OLQT and public scene text recognition benchmarks show that the proposed method achieves state-of-the-art performance.
Keyword:
Scene text recognition
Transformer
Decoding order optimization
Random order generation
Contextual information

期刊

Expert Systems with Applications 封面图
Expert Systems with Applications
IF:
7.5
论文数:
3.0W
被引数:
10.2W

机构

E
east china normal university
学者数:
3.1W
论文数: 2.1W
被引数: 25
I
indian statistical institute kolkata
学者数:
759
论文数: 822
被引数: 1
U
University of Salford
学者数:
2.4K
论文数: 2.5K
被引数: 2.9K
S
Shanghai Maritime University
学者数:
4.8K
论文数: 4.2K
被引数: 4.7K
I
Indian Statistical Institute
学者数:
1.7K
论文数: 1.8K
被引数: 1.2K
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
err分享
err收藏
Agriculture and biodiversity: a better balance benefits both
err2016-01-01
err0
errOAAI
errJan Willem Erisman; Nick van Eekeren; Jan de Wit; Chris Koopmans; Willemijn Cuijpers; Natasja Oerlemans; Ben J. Koks
err分享
err收藏
err分享
err收藏
Infrared focal plane array incorporating silicon IC process compatible bolometer
err1996-01-01
err0
PREAI
errA. Tanaka; S. Matsumoto; N. Tsukamoto; S. Itoh; K. Chiba; T. Endoh; A. Nakazato; K. Okuyama; Y. Kumazawa; M. Hijikawa; H. Gotoh; T. Tanaka; N. Teranishi
err分享
err收藏
学者 查看更多内容