arrow
Return

Differentiable Photon Mapping using Generalized Path Gradients

delete2024-11-19
delete0
delete
OA
AI
J
Jiankai Xing
Z
Zengyu Li
F
Fujun Luan
K
Kun Xu *
DOI:10.1145/3687958delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Photon mapping is a fundamental and practical Monte Carlo rendering technique for efficiently simulating global illumination effects, especially for caustics and specular-diffuse-specular (SDS) paths. In this paper, we present the first differentiable rendering method for photon mapping. The core of our method is a newly introduced concept named generalized path gradients. Based on the extended path space manifolds (EPSMs) [Xing et al. 2023], the generalized path gradients define the derivatives of the vertex positions and color contributions of a path with respect to scene parameters under given geometric constraints. By formalizing photon mapping as a path sampling technique through vertex merging [Georgiev et al. 2012] and incorporating a smooth differentiable density estimation kernel, we enable the differentiation of the photon mapping algorithms based on the theoretical results of generalized path gradients. Experiments demonstrate that our method is more effective than state-ofthe-art physics-based differentiable rendering methods in inverse rendering applications involving difficult illumination paths, especially SDS paths.
Keywords:
differentiable rendering
photon mapping

Journal

ACM Transactions on Graphics cover
ACM Transactions on Graphics
IF:
9.5
Papers:
4.8K
Citations:
3.6W

Organization

A
adobe systems inc.
Scholars:
273
Papers: 305
Citations: 0
T
tsinghua university
Scholars:
11.9W
Papers: 10.0W
Citations: 137
Cited Papers

Cited Papers

Dr.Jit: A Just-In-Time Compiler for Differentiable Rendering
err2022-07-22
err61
errOAAI
errJakob, Wenzel; Speierer, Sebastien; Roussel, Nicolas; Vicini, Delio
errShare
errSave
Learning to Reconstruct Shape and Spatially-Varying Reflectance from a Single Image
err2018-12-04
err121
PREAI
errLi, Zhengqin; Xu, Zexiang; Ramamoorth, Ravi; Sunkavalli, Kalyan; Chandraker, Manmohan
errShare
errSave
Gradient-Domain Path Tracing
err2015-07-27
err69
errOAAI
errKettunen, Markus; Manzi, Marco; Aittala, Miika; Lehtinen, Jaakko; Durand, Fredo; Zwicker, Matthias
errShare
errSave
Light Transport Simulation with Vertex Connection and Merging
err2012-11-01
err146
errOAAI
errGeorgiev, Iliyan; Krivanek, Jaroslav; Davidovic, Tomas; Slusallek, Philipp
errShare
errSave
Differentiable Signed Distance Function Rendering
err2022-07-22
err64
PREAI
errVicini, Delio; Speierer, Sebastien; Jakob, Wenzel
errShare
errSave
Photon surfaces for robust, unbiased volumetric density estimation
err2019-07-12
err25
errOAAI
errDeng, Xi; Jiao, Shaojie; Bitterli, Benedikt; Jarosz, Wojciech
errShare
errSave
Joint Computational Design of Workspaces and Workplans
err2021-12-10
err1
PREAI
errZhang, Yongqi; Huang, Haikun; Plaku, Erion; Yu, Lap-Fai
errShare
errSave
Monte Carlo Estimators for Differential Light Transport
err2021-07-19
err49
PREAI
errZeltner, Tizian; Speierer, Sebastien; Georgiev, Iliyan; Jakob, Wenzel
errShare
errSave
researcher View more