arrow
Return

Semi-Supervised Pixel-Level Scene Text Segmentation by Mutually Guided Network

delete2021-01-01
delete17
PRE
AI
C
Chuan Wang
S
Shan Zhao
L
Li Zhu
K
Kunming Luo
Y
Yanwen Guo
J
Jue Wang
S
Shuaicheng Liu *
DOI:10.1109/TIP.2021.3113157delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this paper we present a new data-driven method for pixel-level scene text segmentation from a single natural image. Although scene text detection, i.e. producing a text region mask, has been well studied in the past decade, pixel-level text segmentation is still an open problem due to the lack of massive pixel-level labeled data for supervised training. To tackle this issue, we incorporate text region mask as an auxiliary data into this task, considering acquiring large-scale of labeled text region mask is commonly less expensive and time-consuming. To be specific, we propose a mutually guided network which produces a polygon-level mask in one branch and a pixel-level text mask in the other. The two branches' outputs serve as guidance for each other and the whole network is trained via a semi-supervised learning strategy. Extensive experiments are conducted to demonstrate the effectiveness of our mutually guided network, and experimental results show our network outperforms the state-of-the-art in pixel-level scene text segmentation. We also demonstrate the mask produced by our network could improve the text recognition performance besides the trivial image editing application.
Keywords:
Image segmentation
Task analysis
Training
Decoding
Feature extraction
Text recognition
Convolutional neural networks
Semi-supervised
scene text segmentation
mutually guided network
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

C
chongqing university of posts & telecommunications
Scholars:
6.7K
Papers: 5.3K
Citations: 5
N
nanjing university
Scholars:
7.7W
Papers: 5.6W
Citations: 87