arrow
Return

DeepFaceReshaping: Interactive deep face reshaping via landmark manipulation

delete2024-10-01
delete0
delete
OA
AI
S
Shuyu Chen
J
Jiang, Yue-Ren
H
Hongbo Fu
X
Xinyang Han
Z
Zitao Liu
李蓉 (Rong Li)
L
Lin Gao *
DOI:10.1007/s41095-023-0373-1delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Deep generative models allow the synthesis of realistic human faces from freehand sketches or semantic maps. However, although they are flexible, sketches and semantic maps provide too much freedom for manipulation, and thus, are not easy for novice users to control. In this study, we present DeepFaceReshaping, a novel landmark-based deep generative framework for interactive face reshaping. To edit the shape of a face realistically by manipulating a small number of face landmarks, we employ neural shape deformation to reshape individual face components. Furthermore, we propose a novel Transformer-based partial refinement network to synthesize the reshaped face components conditioned on the edited landmarks, and fuse the components to generate the entire face using a local-to-global approach. In this manner, we limit possible reshaping effects within a feasible component-based face space. Thus, our interface is intuitive even for novice users, as confirmed by a user study. Our experiments demonstrate that our method outperforms traditional warping-based approaches and recent deep generative techniques.
Keywords:
face reshaping
deep generative model
interactive editing
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Computational Visual Media cover
Computational Visual Media
IF:
18.3
Papers:
310
Citations:
2.6K

Organization

U
university of chinese academy of sciences, cas
Scholars:
4.1W
Papers: 3.8W
Citations: 75
I
institute of computing technology, cas
Scholars:
1.0K
Papers: 877
Citations: 1
J
jinan university
Scholars:
4.3W
Papers: 2.6W
Citations: 38
C
chinese academy of sciences
Scholars:
56.2W
Papers: 44.8W
Citations: 704
researcher View more organizations