arrow
返回

Learning a Generalized Physical Face Model From Data

delete2024-07-19
delete0
PRE
AI
L
Lingchen Yang *
G
Gaspard Zoss
P
Prashanth Chandran
M
Markus Groß
B
Barbara Solenthaler
E
Eftychios Sifakis
D
Derek Bradley
DOI:10.1145/3658189delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Physically-based simulation is a powerful approach for 3D facial animation as the resulting deformations are governed by physical constraints, allowing to easily resolve self-collisions, respond to external forces and perform realistic anatomy edits. Today's methods are data-driven, where the actuations for finite elements are inferred from captured skin geometry. Unfortunately, these approaches have not been widely adopted due to the complexity of initializing the material space and learning the deformation model for each character separately, which often requires a skilled artist followed by lengthy network training. In this work, we aim to make physics-based facial animation more accessible by proposing a generalized physical face model that we learn from a large 3D face dataset. Once trained, our model can be quickly fit to any unseen identity and produce a ready-to-animate physical face model automatically. Fitting is as easy as providing a single 3D face scan, or even a single face image. After fitting, we offer intuitive animation controls, as well as the ability to retarget animations across characters. All the while, the resulting animations allow for physical effects like collision avoidance, gravity, paralysis, bone reshaping and more.
Keyword:
Differentiable Physics
Deep Learning
Physically-Based Facial Animation
Digital Humans

期刊

ACM Transactions on Graphics 封面图
ACM Transactions on Graphics
IF:
9.5
论文数:
4.8K
被引数:
3.6W

机构

University of Wisconsin System 封面图
University of Wisconsin System
学者数:
6.7W
论文数: 5.8W
被引数: 382
E
ETH Zurich
学者数:
3.0W
论文数: 2.4W
被引数: 8.4W
S
swiss federal institutes of technology domain
学者数:
9.0W
论文数: 8.0W
被引数: 163
学者 查看更多机构
引用论文

引用论文

NeRSemble: Multi-view Radiance Field Reconstruction of Human Heads
err2023-07-26
err18
errOAAI
errKirschstein, Tobias; Qian, Shenhan; Giebenhain, Simon; Walter, Tim; Niessner, Matthias
err分享
err收藏
Local Anatomically-Constrained Facial Performance Retargeting
err2022-07-22
err13
PREAI
errChandran, Prashanth; Ciccone, Loic; Gross, Markus; Bradley, Derek
err分享
err收藏
SCULPTOR: Skeleton-Consistent Face Creation Using a Learned Parametric Generator
err2022-11-30
err3
errOAAI
errQiu, Zesong; Li, Yuwei; He, Dongming; Zhang, Qixuan; Zhang, Longwen; Zhang, Yinghao; Wang, Jingya; Xu, Lan; Wang, Xudong; Zhang, Yuyao; Yu, Jingyi
err分享
err收藏
Genetic determinants of anti-malarial acquired immunity in a large multi-centre study
err2015-08-28
err0
errOAAI
errJennifer M G Shelton; Patrick Corran; Paul Risley; Nilupa Silva; Christina Hubbart; Anna Jeffreys; Kate Rowlands; Rachel Craik; Victoria Cornelius; Meike Hensmann; Sile Molloy; Nuno Sepulveda; Taane G Clark; Gavin Band; Geraldine M Clarke; Christopher C A Spencer; Angeliki Kerasidou; Susana Campino; Sarah Auburn; Adama Tall; Alioune Badara Ly; Odile Mercereau-Puijalon; Anavaj Sakuntabhai; Abdoulaye Djimdé; Boubacar Maiga; Ousmane Touré; Ogobara K Doumbo; Amagana Dolo; Marita Troye-Blomberg; Valentina D Mangano; Frederica Verra; David Modiano; Edith Bougouma; Sodiomon B Sirima; Muntaser Ibrahim; Ayman Hussain; Nahid Eid; Abier Elzein; Hiba Mohammed; Ahmed Elhassan; Ibrahim Elhassan; Thomas N Williams; Carolyne Ndila; Alexander Macharia; Kevin Marsh; Alphaxard Manjurano; Hugh Reyburn; Martha Lemnge; Deus Ishengoma; Richard Carter; Nadira Karunaweera; Deepika Fernando; Rajika Dewasurendra; Christopher J Drakeley; Eleanor M Riley; Dominic P Kwiatkowski; Kirk A Rockett
err分享
err收藏
An Anatomically-Constrained Local Deformation Model for Monocular Face Capture
err2016-07-11
err51
PREAI
errWu, Chenglei; Bradley, Derek; Gross, Markus; Beeler, Thabo
err分享
err收藏
学者 查看更多内容