arrow
Return

Recursive Control Variates for Inverse Rendering

delete2023-07-26
delete14
delete
OA
AI
B
Baptiste Nicolet *
F
Fabrice Rousselle
J
Jan Novák
A
Alexander Keller
W
Wenzel Jakob
T
Thomas Müller
DOI:10.1145/3592139delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We present a method for reducing errors-variance and bias-in physically based differentiable rendering (PBDR). Typical applications of PBDR repeatedly render a scene as part of an optimization loop involving gradient descent. The actual change introduced by each gradient descent step is often relatively small, causing a significant degree of redundancy in this computation. We exploit this redundancy by formulating a gradient estimator that employs a recursive control variate, which leverages information from previous optimization steps. The control variate reduces variance in gradients, and, perhaps more importantly, alleviates issues that arise from differentiating loss functions with respect to noisy inputs, a common cause of drift to bad local minima or divergent optimizations. We experimentally evaluate our approach on a variety of path-traced scenes containing surfaces and volumes and observe that primal rendering efficiency improves by a factor of up to 10.
Keywords:
Differentiable rendering
control variates

Journal

ACM Transactions on Graphics cover
ACM Transactions on Graphics
IF:
9.5
Papers:
4.8K
Citations:
3.6W

Organization

E
Ecole Polytechnique Federale de Lausanne
Scholars:
1.7W
Papers: 1.3W
Citations: 25
S
swiss federal institutes of technology domain
Scholars:
9.0W
Papers: 8.0W
Citations: 163
Cited Papers

Cited Papers

Dr.Jit: A Just-In-Time Compiler for Differentiable Rendering
err2022-07-22
err61
errOAAI
errJakob, Wenzel; Speierer, Sebastien; Roussel, Nicolas; Vicini, Delio
errShare
errSave
Temporal Gradient-Domain Path Tracing
err2016-12-05
err24
errOAAI
errManzi, Marco; Kettunen, Markus; Durand, Fredo; Zwicker, Matthias; Lehtinen, Jaakko
errShare
errSave
Spectral and Decomposition Tracking for Rendering Heterogeneous Volumes
err2017-07-20
err48
PREAI
errKutz, Peter; Habel, Ralf; Li, Yining Karl; Novak, Jan
errShare
errSave
Matching Real Fabrics with Micro-Appearance Models
err2015-12-29
err95
errOAAI
errKhungurn, Pramook; Schroeder, Daniel; Zhao, Shuang; Bala, Kavita; Marschner, Steve
errShare
errSave
Real-time Neural Radiance Caching for Path Tracing
err2021-07-19
err64
errOAAI
errMuller, Thomas; Rousselle, Fabrice; Novak, Jan; Keller, Alexander
errShare
errSave
Costs and treatment patterns of incident ADHD patients - a comparative analysis before and after the initial diagnosis -
err2015-12-21
err0
errOAAI
errMike Klora; Jan Zeidler; Roland Linder; Frank Verheyen; J.-Matthias Graf von der Schulenburg
errShare
errSave
Gradient-Domain Path Tracing
err2015-07-27
err69
errOAAI
errKettunen, Markus; Manzi, Marco; Aittala, Miika; Lehtinen, Jaakko; Durand, Fredo; Zwicker, Matthias
errShare
errSave
Differentiable Signed Distance Function Rendering
err2022-07-22
err64
PREAI
errVicini, Delio; Speierer, Sebastien; Jakob, Wenzel
errShare
errSave
Regression-based Monte Carlo Integration
err2022-07-22
err0
errOAAI
errSalaun, Corentin; Gruson, Adrien; Hua, Binh-Son; Hachisuka, Toshiya; Singh, Gurprit
errShare
errSave
Unbiased and consistent rendering using biased estimators
err2022-07-22
err12
PREAI
errMisso, Zackary; Bitterli, Benedikt; Georgiev, Iliyan; Jarosz, Wojciech
errShare
errSave
researcher View more