arrow
返回

Exploiting mixing regularization for truly unsupervised font synthesis

delete2023-05-01
delete4
PRE
AI
A
Ammar Ul Hassan Muhammad
H
Hyun‐Soo Lee
J
Jaeyoung Choi *
DOI:10.1016/j.patrec.2023.03.019delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Creating a novel font set requires domain expertise and is a laborious and time-consuming process, par-ticularly for languages with a large number of characters and complicated structures. Existing deep learn-ing based methods consider font generation (FG) as an image-to-image translation problem, mostly in a supervised setting, either in the form of pair images (paired data) or font labels (character or style la-bels), which requires extensive effort and is expensive to collect. Additionally, these supervised counter parts lack generalization for extending to other text image-related tasks, such as word image genera-tion and font attribute control at inference time. We found that these drawbacks are mainly due to the supervised setting adopted by these existing methods for font generation. In this paper, we tackle the FG problem in a truly unsupervised fashion, where a complete font set can be generated by training the generator such that adjacent styles are not correlated and projecting the input glyph image into its corresponding font style latent space. To accomplish this, we propose the Font Mixing Generative Adver-sarial Network (FM-GAN), which employs mixing regularization to supervise the generator to localize the font styles, and a projection encoder to project an arbitrary glyph image into its corresponding semantic space that is compatible with the generator. In the experiments, we demonstrated that our unsupervised model synthesizes font images that are comparable to supervised state-of-the-art FG baselines. Further-more, FM-GAN can be directly applied to other text image related tasks, such as multi-lingual font style transfer, word image generation, and font attribute control.(c) 2023 Elsevier B.V. All rights reserved.
Keyword:
Keyword1
Keyword2
Keyword3

期刊

Pattern Recognition Letters 封面图
Pattern Recognition Letters
IF:
3.3
论文数:
8.0K
被引数:
1.6W

机构

S
Soongsil University
学者数:
3.4K
论文数: 3.5K
被引数: 3.2K
引用论文

引用论文

SDM-NET: Deep Generative Network for Structured Deformable Mesh
err2019-11-08
err135
errOAAI
errGao, Lin; Yang, Jie; Wu, Tong; Yuan, Yu-Jie; Fu, Hongbo; Lai, Yu-Kun; Zhang, Hao
err分享
err收藏
Generative Adversarial Networks生成对抗网络
err2020-10-22
err1.0W
errOAAI
errGoodfellow, Ian; Pouget-Abadie, Jean; Mirza, Mehdi; Xu, Bing; Warde-Farley, David; Ozair, Sherjil; Courville, Aaron; Bengio, Yoshua
err分享
err收藏