arrow
Return

Multimodal Conditional 3D Face Geometry Generation

delete2025-08-13
delete0
delete
OA
AI
C
Christopher Otto *
P
Prashanth Chandran
S
Sebastian Weiß
M
Markus Groß
G
Gaspard Zoss
D
Derek Bradley
DOI:10.1016/j.cag.2025.104325delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
• We present a new method for 3D face geometry generation from 6 different types of conditionings (prompts) within a single model. • We propose a comprehensive solution for training such a method from scratch, with 3D geometry data augmentations and by representing 3D geometry as position maps to better fit existing diffusion pipelines. • We show that our method supports face generation with expressions, sketch-based editing for 3D face design, stochastic variations of details conditioned on low resolution FLAME faces, generalization to in-the-wild data and dynamic face generation from videos.
Keywords:
Multimodal generation
3D face geometry
Deep learning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

C
Computers
IF:
4.2
Papers:
1.5K
Citations:
3.3K

Organization

E
eth zürich
Scholars:
2.4K
Papers: 838
Citations: 1
D
disneyresearch—studios
Scholars:
4
Papers: 1
Citations: 0
Cited Papers

Cited Papers

U-Net: Convolutional Networks for Biomedical Image Segmentation
err2015-11-18
err0
PREAI
errOlaf Ronneberger; Philipp Fischer; Thomas Brox
errShare
errSave
Learning Dynamic 3D Geometry and Texture for Video Face Swapping
err2023-03-20
err0
PREAI
errC. Otto; J. Naruniec; L. Helminger; T. Etterlin; G. Mignone; P. Chandran; G. Zoss; C. Schroers; M. Gross; P. Gotardo; D. Bradley; R. Weber
errShare
errSave
Semantic Deep Face Models
err2020-11-01
err0
errOAAI
errPrashanth Chandran; Derek Bradley; Markus Gross; Thabo Beeler
errShare
errSave
Continuous Landmark Detection with 3D Queries
err2023-06-01
err0
PREAI
errPrashanth Chandran; Gaspard Zoss; Paulo Gotardo; Derek Bradley
errShare
errSave
Interactive Sculpting of Digital Faces Using an Anatomical Modeling Paradigm
err2020-08-12
err0
errOAAI
errA. Gruber; M. Fratarcangeli; G. Zoss; R. Cattaneo; T. Beeler; M. Gross; D. Bradley
errShare
errSave
Overcoming catastrophic forgetting in neural networks
err2017-03-14
err3.7K
errOAAI
errKirkpatricka, James; Pascanu, Razvan; Rabinowitz, Neil; Veness, Joel; Desjardins, Guillaume; Rusu, Andrei A.; Milan, Kieran; Quan, John; Ramalho, Tiago; Grabska-Barwinska, Agnieszka; Hassabis, Demis; Clopath, Claudia; Kumaran, Dharshan; Hadsell, Raia
errShare
errSave
no more