arrow
Return

MAGIC: Multi-granularity domain adaptation for text recognition

delete2025-05-01
delete0
PRE
AI
J
Jiaying Zhang
刘晓倩 cover
刘晓倩 (Xiaoqian Liu)
Z
Zhiyuan Xue
X
Xin Luo
X
Xin-Shun Xu *
DOI:10.1016/j.patcog.2024.111229delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Domain gaps between synthetic text and real-world text restrict current text recognition methods. One solution is to align features through Unsupervised Domain Adaptation (UDA). Most existing UDA-based text recognition methods extract global and local features to alleviate domain differences, only focusing on character distribution gaps. However, notable distribution gaps in character combinations exert a pivotal influence diverse text recognition tasks. To this end, we propose a Multi-level And multi-Granularity domain adaptation with entropy loss guIded text reCognition model, named MAGIC. It integrates Global-level Domain Adaptation (GDA) to mitigate image-level domain drift and Local-level Multi-granularity Domain Adaptation (LMDA) local feature shifts. Particularly, we design a subword-level domain discriminator to align the subword features relating to each character combination. Moreover, multi-granularity entropy minimization is used to optimize the target domain data for better domain adaptation. Experimental results on several types of text datasets demonstrate the effectiveness of MAGIC.
Keywords:
Text recognition
Unsupervised domain adaptation
Entropy minimization
Multi-granularity prediction

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

S
shandong university
Scholars:
9.4W
Papers: 6.4W
Citations: 94