arrow
返回

Semantics-Preserving Sketch Embedding for Face Generation

delete2023-01-01
delete1
delete
OA
AI
B
Binxin Yang
陈
陈雪锦 (Xuejin Chen) *
C
Chaoqun Wang
C
Chi Zhang
Z
Zihan Chen
孙
孙晓燕 (Xiaoyan Sun)
DOI:10.1109/TMM.2023.3239182delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
With recent advances in image-to-image translation tasks, remarkable progress has been witnessed in generating face images from sketches. However, existing methods frequently fail to generate images with details that are semantically and geometrically consistent with the input sketch, especially when various decoration strokes are drawn. To address this issue, we introduce a novel W-W+ encoder architecture to take advantage of the high expressive power of W+ space and semantic controllability of W space. We introduce an explicit intermediate representation for sketch semantic embedding. With a semantic feature matching loss for effective semantic supervision, our sketch embedding precisely conveys the semantics in the input sketches to the synthesized images. Moreover, a novel sketch semantic interpretation approach is designed to automatically extract semantics from vectorized sketches. We conduct extensive experiments on both synthesized sketches and hand-drawn sketches, and the results demonstrate the superiority of our method over existing approaches on both semantics-preserving and generalization ability.
Keyword:
Semantics
Faces
Aerospace electronics
Codes
Image synthesis
Task analysis
Generators
Sketch-based generation
face generation
image-to-image translation
semantics-preserving

期刊

IEEE Transactions on Multimedia 封面图
IEEE Transactions on Multimedia
IF:
9.7
论文数:
4.5K
被引数:
2.4W

机构

C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

Varicella-zoster virus inhibits autophagosome-lysosome fusion and the degradation stage of mTOR-mediated autophagic flux
err2018-09-01
err0
PREAI
errChiharu Graybill; Michael J. Morgan; Myron J. Levin; Katherine S. Lee
err分享
err收藏
err分享
err收藏
SketchGNN: Semantic Sketch Segmentation with Graph Neural Networks
err2021-08-01
err34
errOAAI
errYang, Lumin; Zhuang, Jiajie; Fu, Hongbo; Wei, Xiangzhi; Zhou, Kun; Zheng, Youyi
err分享
err收藏
Assessment of best single sample for finding chlamydia in women with and without symptoms: a diagnostic test study
errBMJ
IF0
err2012-12-12
err0
errOAAI
errS. A. Schoeman; C. M. W. Stewart; R. A. Booth; S. D. Smith; M. H. Wilcox; J. D. Wilson
err分享
err收藏
err分享
err收藏
学者 查看更多内容