.png){kind=icon}
返回
Sequential visual and semantic consistency for semi-supervised text recognition
.png){kind=icon}
OA
AI
DOI：10.1016/j.patrec.2024.01.008.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Scene text recognition (STR) is a challenging task that requires large-scale annotated data for training. However, collecting and labeling real text images is expensive and time-consuming, which limits the availability of real data. Therefore, most existing STR methods resort to synthetic data, which may introduce domain discrepancy and degrade the performance of STR models. To alleviate this problem, recent semisupervised STR methods exploit unlabeled real data by enforcing character -level consistency regularization between weakly and strongly augmented views of the same image. However, these methods neglect wordlevel consistency, which is crucial for sequence recognition tasks. This paper proposes a novel semi -supervised learning method for STR that incorporates word -level consistency regularization from both visual and semantic aspects. Specifically, we devise a shortest path alignment module to align the sequential visual features of different views and minimize their distance. Moreover, we adopt a reinforcement learning framework to optimize the semantic similarity of the predicted strings in the embedding space. We conduct extensive experiments on several standard and challenging STR benchmarks and demonstrate the superiority of our proposed method over existing semi -supervised STR methods.
Keyword:
Semi-supervised learning
Scene text recognition
Dynamic programming
Reinforcement learning
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
3.3
论文数:
8.0K
被引数:
1.6W
机构
引用论文
分享收藏Cascaded Segmentation-Detection Networks for Text-Based Traffic Sign Detection用于基于文本的交通标志检测的级联分割检测网络
PREAI
分享收藏Human immunoglobulins and Fc fragments promote microtubule assembly via tau proteins and induce conformational changes of neuronal microtubules in vitro.png)
NeuroReport
NeuroReportIF0
PREAI
分享收藏MORAN: A Multi-Object Rectified Attention Network for scene text recognitionMORAN: 用于场景文本识别的多目标校正注意力网络PATTERN RECOGNITION
PATTERN RECOGNITIONIF7.6
PREAI
分享收藏
查看更多内容