arrow
返回

SofGAN: A Portrait Image Generator with Dynamic Styling

delete2022-02-09
delete48
delete
OA
AI
R
Ruiyang Liu
L
Ling Xie
Z
Zhang Chen
H
Hao Su
J
Jingyi Yu
DOI:10.1145/3470848delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Recently, Generative Adversarial Networks (GANs) have been widely used for portrait image generation. However, in the latent space learned by GANs, different attributes, such as pose, shape, and texture style, are generally entangled, making the explicit control of specific attributes difficult. To address this issue, we propose a Sof GAN image generator to decouple the latent space of portraits into two subspaces: a geometry space and a texture space. The latent codes sampled from the two subspaces are fed to two network branches separately, one to generate the 3D geometry of portraits with canonical pose, and the other to generate textures. The aligned 3D geometries also come with semantic part segmentation, encoded as a semantic occupancy field (SOF). The SOF allows the rendering of consistent 2D semantic segmentation maps at arbitrary views, which are then fused with the generated texturemaps and stylized to a portrait photo using our semantic instance-wise module. Through extensive experiments, we show that our system can generate high-quality portrait images with independently controllable geometry and texture attributes. The method also generalizes well in various applications, such as appearance-consistent facial animation and dynamic styling.
Keyword:
Image synthesis
3D modeling
generative adversarial networks

期刊

ACM Transactions on Graphics 封面图
ACM Transactions on Graphics
IF:
9.5
论文数:
4.7K
被引数:
3.6W

机构

University of California System 封面图
University of California System
学者数:
37.7W
论文数: 33.8W
被引数: 6.6K
S
ShanghaiTech University
学者数:
9.7K
论文数: 5.9K
被引数: 1.6W
引用论文

引用论文

Chibchan languages
err2012-01-13
err0
PREAI
errAdolfo Constenla Umaña
err分享
err收藏
Neural Volumes: Learning Dynamic Renderable Volumes from images神经体积: 从图像中学习动态可渲染体积
err2019-07-12
err478
errOAAI
errLombardi, Stephen; Simon, Tomas; Saragih, Jason; Schwartz, Gabriel; Lehrmann, Andreas; Sheikh, Yaser
err分享
err收藏
Warp-Guided GANs for Single-Photo Facial Animation
err2018-12-04
err64
PREAI
errGeng, Jiahao; Shao, Tianjia; Zheng, Youyi; Weng, Yanlin; Zhou, Kun
err分享
err收藏
Assessment of best single sample for finding chlamydia in women with and without symptoms: a diagnostic test study
errBMJ
IF0
err2012-12-12
err0
errOAAI
errS. A. Schoeman; C. M. W. Stewart; R. A. Booth; S. D. Smith; M. H. Wilcox; J. D. Wilson
err分享
err收藏
err分享
err收藏
An ACVRL1 gene mutation presenting as vein of Galen malformation at prenatal diagnosis
err2020-03-14
err0
PREAI
errCaterina De Luca; Elisa Bevilacqua; Dominique A. Badr; Mieke M. Cannie; Teresa C. Sanchez; Valérie Segers; Kathelijn Keymolen; Jacques C. Jani
err分享
err收藏
学者 查看更多内容