.png){kind=icon}
返回
3D3M: 3D Modulated Morphable Model for Monocular Face Reconstruction
.png){kind=icon}
PRE
AI
DOI：10.1109/TMM.2022.3212282.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
3D face reconstruction from a single image is a vital task in various multimedia applications. A key challenge for 3D face shape reconstruction is to build the correct dense face correspondence between the monocular input face and the deformable mesh. Most existing methods rely on shape labels fitted by traditional methods or strong priors such as multi-view geometry consistency. In contrast, we propose an innovative 3D Modulated Morphable Model (3D3M) to learn the dense shape correspondence from monocular images in a self-supervised manner. Specifically, given a batch of input faces, 3D3M encodes their 3DMM attributes (shape, texture, lighting, etc.) and then randomly shuffles the 3DMM attributes to generate the attribute-changed faces. The attribute-changed faces can be encoded and rendered back in a cycle-consistent manner, which enables us to utilize the self-supervised consistencies in dense mesh vertices and reconstructed pixels. The dense shape and pixel correspondence enable us to adopt a series of self-supervised constraints to fit the 3D face model accurately and learn the per-vertex correctives end-to-end. 3D3M builds excellent high-quality 3D face reconstruction results from monocular images. Both quantitative and qualitative experimental results have verified the superiority of 3D3M over prior arts on 3D face reconstruction and face alignment.
Keyword:
Faces
Three-dimensional displays
Shape
Image reconstruction
Face recognition
Solid modeling
Codes
3D face reconstruction
dense shape correspondence
self-supervised learning
期刊
IF:
9.7
论文数:
4.5K
被引数:
2.4W
机构
暂无机构信息
引用论文
Use of NMR as an analytical tool in the process development of conjugate vaccines against Haemophilus influenzae type b (Hib) and meningococcal serogroup A (MenA).png)
Biologicals
BiologicalsIF0
PREAI
分享收藏
Assessment of best single sample for finding chlamydia in women with and without symptoms: a diagnostic test studyBMJ
OAAI
BMJIF0
OAAI分享收藏
查看更多内容