arrow
返回

Differentiable Monte Carlo Ray Tracing through Edge Sampling

delete2018-12-04
delete148
delete
OA
AI
T
Tzu‐Mao Li *
M
Miika Aittala
F
Frédo Durand
J
Jaakko Lehtinen
DOI:10.1145/3272127.3275109delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Gradient-based methods are becoming increasingly important for computer graphics, machine learning, and computer vision. The ability to compute gradients is crucial to optimization, inverse problems, and deep learning. In rendering, the gradient is required with respect to variables such as camera parameters, light sources, scene geometry, or material appearance. However, computing the gradient of rendering is challenging because the rendering integral includes visibility terms that are not differentiable. Previous work on differentiable rendering has focused on approximate solutions. They often do not handle secondary effects such as shadows or global illumination, or they do not provide the gradient with respect to variables other than pixel coordinates. We introduce a general-purpose differentiable ray tracer, which, to our knowledge, is the first comprehensive solution that is able to compute derivatives of scalar functions over a rendered image with respect to arbitrary scene parameters such as camera pose, scene geometry, materials, and lighting parameters. The key to our method is a novel edge sampling algorithm that directly samples the Dirac delta functions introduced by the derivatives of the discontinuous integrand. We also develop efficient importance sampling methods based on spatial hierarchies. Our method can generate gradients in times running from seconds to minutes depending on scene complexity and desired precision. We interface our differentiable ray tracer with the deep learning library PyTorch and show prototype applications in inverse rendering and the generation of adversarial examples for neural networks.
Keyword:
ray tracing
inverse rendering
differentiable programming
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

ACM Transactions on Graphics 封面图
ACM Transactions on Graphics
IF:
9.5
论文数:
4.8K
被引数:
3.6W

机构

A
Aalto University
学者数:
1.6W
论文数: 1.5W
被引数: 2.1W
引用论文

引用论文

Real-Time Polygonal-Light Shading with Linearly Transformed Cosines
err2016-07-11
err118
PREAI
errHeitz, Eric; Dupuy, Jonathan; Hill, Stephen; Neubelt, David
err分享
err收藏
A first-order analysis of lighting, shading, and shadows
err2007-01-01
err72
errOAAI
errRamamoorthi, Ravi; Mahajan, Dhruv; Belhumeur, Peter
err分享
err收藏
Matching Real Fabrics with Micro-Appearance Models
err2015-12-29
err95
errOAAI
errKhungurn, Pramook; Schroeder, Daniel; Zhao, Shuang; Bala, Kavita; Marschner, Steve
err分享
err收藏
C60's smallest cousin
err1998-06-01
err0
PREAI
errJames R. Heath
err分享
err收藏
Network resilience assessment and reinforcement strategy against cascading failure
err2022-07-01
err0
errOAAI
errJie Li; Ying Wang; Jilong Zhong; Yun Sun; Zhijun Guo; Zhiwei Chen; Chaoqi Fu
err分享
err收藏
学者 查看更多内容