.png){kind=icon}
返回
Learning physically based material and lighting decompositions for face editing
.png){kind=icon}
OA
AI
DOI：10.1007/s41095-022-0309-1.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Lighting is crucial for portrait photography, yet the complex interactions between the skin and incident light are expensive to model computationally in graphics and difficult to reconstruct analytically via computer vision. Alternatively, to allow fast and controllable reflectance and lighting editing, we developed a physically based decomposition through deep learned priors from path-traced portrait images. Previous approaches that used simplified material models or low-frequency or low-dynamic-range lighting struggled to model specular reflections or relight directly without intermediate decomposition. However, we estimate the surface normal, skin albedo and roughness, and high-frequency HDRI maps, and propose an architecture to estimate both diffuse and specular reflectance components. In our experiments, we show that this approach can represent the true appearance function more effectively than simpler baseline methods, leading to better generalization and higher-quality editing.
Keyword:
intrinsic decomposition
portrait relighting
inverse rendering
deep learning
期刊
IF:
18.3
论文数:
315
被引数:
2.6K
机构
引用论文
Client processing is altered by novel myopathy-causing mutations in the HSP40 J domain.png)
PLOS ONE
OAAI
PLOS ONEIF0
OAAI分享收藏Rendering with Style: Combining Traditional and Neural Approaches for High-Quality Face Rendering风格渲染: 结合传统和神经方法实现高质量人脸渲染
PREAI
分享收藏
查看更多内容