arrow
Return

Semi-Supervised Pixel-Level Scene Text Segmentation by Mutually Guided Network

delete2021-01-01
delete17
PRE
AI
C
Chuan Wang
S
Shan Zhao
L
Li Zhu
K
Kunming Luo
Y
Yanwen Guo
J
Jue Wang
S
Shuaicheng Liu *
DOI:10.1109/TIP.2021.3113157delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this paper we present a new data-driven method for pixel-level scene text segmentation from a single natural image. Although scene text detection, i.e. producing a text region mask, has been well studied in the past decade, pixel-level text segmentation is still an open problem due to the lack of massive pixel-level labeled data for supervised training. To tackle this issue, we incorporate text region mask as an auxiliary data into this task, considering acquiring large-scale of labeled text region mask is commonly less expensive and time-consuming. To be specific, we propose a mutually guided network which produces a polygon-level mask in one branch and a pixel-level text mask in the other. The two branches' outputs serve as guidance for each other and the whole network is trained via a semi-supervised learning strategy. Extensive experiments are conducted to demonstrate the effectiveness of our mutually guided network, and experimental results show our network outperforms the state-of-the-art in pixel-level scene text segmentation. We also demonstrate the mask produced by our network could improve the text recognition performance besides the trivial image editing application.
Keywords:
Image segmentation
Task analysis
Training
Decoding
Feature extraction
Text recognition
Convolutional neural networks
Semi-supervised
scene text segmentation
mutually guided network
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

C
chongqing university of posts & telecommunications
Scholars:
6.7K
Papers: 5.3K
Citations: 5
N
nanjing university
Scholars:
7.8W
Papers: 5.6W
Citations: 87
Cited Papers

Cited Papers

Electrochemically assisted micro localized grafting of aptamers in a microchannel engraved in fluorinated thermoplastic polymer Dyneon THV
err2015-01-01
err0
PREAI
errC. Perréard; Y. Ladner; F. d'Orlyé; S. Descroix; V. Taniga; A. Varenne; F. Kanoufi; C. Slim; S. Griveau; F. Bedioui
errShare
errSave
Crystallographic transformations of rapidly quenched Sm10Fe90−xTix and magnetic properties of their nitrides
err1997-12-15
err0
PREAI
errQ. F. Xiao; Z. D. Zhang; T. Zhao; W. Liu; Y. C. Sui; X. G. Zhao; D. Y. Geng
errShare
errSave
errShare
errSave
Integration of RF-MEMS resonators on submicrometric commercial CMOS technologies
err2008-11-27
err0
PREAI
errJ L Lopez; J Verd; J Teva; G Murillo; J Giner; F Torres; A Uranga; G Abadal; N Barniol
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
Weak supervision for generating pixel-level annotations in scene text segmentation
err2020-10-01
err39
errOAAI
errBonechi, Simone; Bianchini, Monica; Scarselli, Franco; Andreini, Paolo
errShare
errSave
researcher View more