.png){kind=icon}
.png){kind=icon}
Return
Enhancing scene text script identification through multi-task self-supervised learning
.png){kind=icon}
PRE
AI
DOI：10.1007/s00371-025-03982-x.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
This paper proposes a multi-task self-supervised learning framework for scene text script identification, aimed at addressing the challenges posed by diverse fonts, complex backgrounds, low resolutions, and frequent distortions in natural scenes. By leveraging unlabeled data, our approach learns robust image representations tailored for script identification. Three complementary tasks are designed: an advanced Jigsaw puzzle task to capture both local and global features, a spatial alignment-enhanced SwAV task to generalize across transformations while retaining spatial details, and a rotation prediction task to enhance spatial reasoning. Experiments on four benchmark datasets demonstrate that our method achieves state-of-the-art results, outperforming existing approaches. Ablation studies confirm the effectiveness of each module within our framework, showcasing its potential to reduce reliance on labeled data and enhance script identification in real-world applications. The code can be accessed at https://github.com/jin-or-king/Enhancing_scene_text_script_identification_through_multi-task_self-supervised_learning.
Keywords:
Scene text script identification
Multi-task self-supervised learning
Advanced Jigsaw puzzle
Spatial alignment-enhanced SwAV