arrow
返回

Diff-Font: Diffusion Model for Robust One-Shot Font Generation

delete2024-06-13
delete3
PRE
AI
H
Haibin He
X
Xinyuan Chen
C
Chaoyue Wang
J
Juhua Liu *
B
Bo Du
D
Dacheng Tao
Y
Yu Qiao
DOI:10.1007/s11263-024-02137-0delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
Font generation presents a significant challenge due to the intricate details needed, especially for languages with complex ideograms and numerous characters, such as Chinese and Korean. Although various few-shot (or even one-shot) font generation methods have been introduced, most of them rely on GAN-based image-to-image translation frameworks that still face (i) unstable training issues, (ii) limited fidelity in replicating font styles, and (iii) imprecise generation of complex characters. To tackle these problems, we propose a unified one-shot font generation framework called Diff-Font, based on the diffusion model. In particular, we approach font generation as a conditional generation task, where the content of characters is managed through predefined embedding tokens and the desired font style is extracted from a one-shot reference image. For glyph-rich characters such as Chinese and Korean, we incorporate additional inputs for strokes or components as fine-grained conditions. Owing to the proposed diffusion training process, these three types of information can be effectively modeled, resulting in stable training. Simultaneously, the integrity of character structures can be learned and preserved. To the best of our knowledge, Diff-Font is the first work to utilize a diffusion model for font generation tasks. Comprehensive experiments demonstrate that Diff-Font outperforms prior font generation methods in both high-fidelity font style replication and the generation of intricate characters. Our method achieves state-of-the-art results in both qualitative and quantitative aspects.
Keyword:
Font generation
One-shot image generation
Diffusion model-based framework
Conditional generation

期刊

International Journal of Computer Vision 封面图
International Journal of Computer Vision
IF:
9.3
论文数:
4.0K
被引数:
2.8W

机构

S
Shanghai Artificial Intelligence Laboratory
学者数:
48
论文数: 20
被引数: 0
N
nanyang technological university
学者数:
1.4K
论文数: 712
被引数: 0
W
wuhan university
学者数:
3.8K
论文数: 1.1K
被引数: 0
学者 查看更多机构
引用论文

引用论文

Reliable Neuronal Systems: The Importance of Heterogeneity
err2013-12-04
err0
errOAAI
errJohannes Lengler; Florian Jug; Angelika Steger
err分享
err收藏
err分享
err收藏
Artificial Placentae1
err2008-01-21
err0
PREAI
errL. LAWN; R. A. McCANCE
err分享
err收藏
Sentinel behavior in captive meerkats (Suricata suricatta)
err2021-08-16
err0
errOAAI
errFlorian D. Huels; Angela S. Stoeger
err分享
err收藏
SDM-NET: Deep Generative Network for Structured Deformable Mesh
err2019-11-08
err135
errOAAI
errGao, Lin; Yang, Jie; Wu, Tong; Yuan, Yu-Jie; Fu, Hongbo; Lai, Yu-Kun; Zhang, Hao
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容