arrow
返回

Self-supervised memory learning for scene text image super-resolution

delete2024-12-01
delete0
delete
OA
AI
K
Kehua Guo
X
Xiangyuan Zhu
G
Gerald Schaefer
R
Rui Ding
方
方慧 (Hui Fang) *
DOI:10.1016/j.eswa.2024.125247delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Computerised recognition of low-resolution scene text images has been a persistent challenge. To improve the recognition performance, image quality enhancement via image super-resolution technology provides an intuitive solution. Typical deep learning-based scene text image super-resolution methods assume that the image quality degradation from high-resolution images to their corresponding low-resolution counterparts can be represented by mapping well-distributed samples, which limits their reconstruction performance in a practical text recognition system. For real-world scenarios this assumption typically does not hold since image degradations arise from multiple sources during image capture and processing. In this paper, to alleviate this problem, we propose a novel self-supervised end-to-end memory network model for scene text image super- resolution. In particular, after extracting enriched and finer representations from low-resolution text images via a spatial refinement block, we introduce a memory-based network to yield an improved super-resolution model that can handle complex degradation sources. Furthermore, to boost the effectiveness of our method, we design a multi-term loss to exploit textual structure information, where, in addition to the traditional reconstruction loss, we embed a character perceptual loss and a boundary enhancement loss. Extensive experiments on different datasets demonstrate that our proposed MNTSR method effectively improves the recognition accuracy for several scene text image recognition models and achieves state-of-the-art results. The source code is made available at https://github.com/xyzhu1/MNTSR.
Keyword:
Super-resolution
Scene text image
Text recognition
Memory learning
Spatial refinement
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Expert Systems with Applications 封面图
Expert Systems with Applications
IF:
7.5
论文数:
3.0W
被引数:
10.2W

机构

C
Central South University
学者数:
10.0W
论文数: 7.2W
被引数: 10.9W
引用论文

引用论文

err分享
err收藏
err分享
err收藏
Learning multiple attention transformer super-resolution method for grape disease recognition
err2024-05-01
err9
PREAI
errJin, Haibin; Chu, Xiaoquan; Qi, Jianfang; Feng, Jianying; Mu, Weisong
err分享
err收藏
err分享
err收藏
学者 查看更多内容