arrow
Return

Sample-based Monte Carlo Denoising using a Kernel-Splatting Network

delete2019-07-12
delete75
PRE
AI
M
Michaël Gharbi *
T
Tzu‐Mao Li
M
Miika Aittala
J
Jaakko Lehtinen
F
Frédo Durand
DOI:10.1145/3306346.3322954delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Denoising has proven to be useful to efficiently generate high-quality Monte Carlo renderings. Traditional pixel-based denoisers exploit summary statistics of a pixel's sample distributions, which discards much of the samples' information and limits their denoising power. On the other hand, sample-based techniques tend to be slow and have difficulties handling general transport scenarios. We present the first convolutional network that can learn to denoise Monte Carlo renderings directly from the samples. Learning the mapping between samples and images creates new challenges for the network architecture design: the order of the samples is arbitrary, and they should be treated in a permutation invariant manner. To address these challenges, we develop a novel kernel-predicting architecture that splats individual samples onto nearby pixels. Splatting is a natural solution to situations such as motion blur, depth-of-field and many light transport paths, where it is easier to predict which pixels a sample contributes to, rather than a gather approach that needs to figure out, for each pixel, which samples (or nearby pixels) are relevant. Compared to previous state-of-the-art methods, ours is robust to the severe noise of low-sample count images (e.g. 8 samples per pixel) and yields higher-quality results both visually and numerically. Our approach retains the generality and efficiency of pixel-space methods while enjoying the expressiveness and accuracy of the more complex sample-based approaches.
Keywords:
Monte Carlo denoising
deep learning
data-driven methods
convolutional neural networks
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

ACM Transactions on Graphics cover
ACM Transactions on Graphics
IF:
9.5
Papers:
4.8K
Citations:
3.6W

Organization

A
adobe systems inc.
Scholars:
273
Papers: 305
Citations: 0
A
Aalto University
Scholars:
1.6W
Papers: 1.5W
Citations: 2.1W
Cited Papers

Cited Papers

Microalgae-based domestic wastewater treatment: a review of biological aspects, bioremediation potential, and biomass production with biotechnological high-value
err2023-10-27
err0
PREAI
errBarbara de Cassia Soares Brandão; Carlos Yure B. Oliveira; Elizabeth Pereira dos Santos; Jéssika Lima de Abreu; Deyvid Willame Silva Oliveira; Suzianny Maria Bezerra Cabral da Silva; Alfredo Olivera Gálvez
errShare
errSave
Denoising with Kernel Prediction and Asymmetric Loss Functions
err2018-07-30
err141
PREAI
errVogels, Thijs; Rousselle, Fabrice; McWilliams, Brian; Rothlin, Gerhard; Harvill, Alex; Adler, David; Meyer, Mark; Novak, Jan
errShare
errSave
Blind Video Temporal Consistency
err2015-11-02
err145
errOAAI
errBonneel, Nicolas; Tompkin, James; Sunkavalli, Kalyan; Sun, Deqing; Paris, Sylvain; Pfister, Hanspeter
errShare
errSave
Adaptive Rendering with Non-Local Means Filtering
err2012-11-01
err107
PREAI
errRousselle, Fabrice; Knaus, Claude; Zwicker, Matthias
errShare
errSave
Systematic analysis of SARS-CoV-2 infection of an ACE2-negative human airway cell
err
IF0
err2021-03-01
err0
errOAAI
errMaritza Puray-Chavez; Kyle M. LaPak; Travis P. Schrank; Jennifer L. Elliott; Dhaval P. Bhatt; Megan J. Agajanian; Ria Jasuja; Dana Q. Lawson; Keanu Davis; Paul W. Rothlauf; Heejoon Jo; Nakyung Lee; Kasyap Tenneti; Jenna E. Eschbach; Christian Shema Mugisha; Hung R. Vuong; Adam L. Bailey; D. Neil Hayes; Sean P.J. Whelan; Amjad Horani; Steven L. Brody; Dennis Goldfarb; M. Ben Major; Sebla B. Kutluay
errShare
errSave
Temporal Light Field Reconstruction for Rendering Distribution Effects
err2011-07-25
err17
errOAAI
errLehtinen, Jaakko; Aila, Timo; Chen, Jiawen; Laine, Samuli; Durand, Fredo
errShare
errSave
Boosting Monte Carlo Rendering by Ray Histogram Fusion
err2014-02-07
err49
PREAI
errDelbracio, Mauricio; Muse, Pablo; Buades, Antoni; Chauvier, Julien; Phelps, Nicholas; Morel, Jean-Michel
errShare
errSave
Decoupling Algorithms from Schedules for Easy Optimization of Image Processing Pipelines
err2012-07-01
err141
errOAAI
errRagan-Kelley, Jonathan; Adams, Andrew; Paris, Sylvain; Levoy, Marc; Amarasinghe, Saman; Durand, Fredo
errShare
errSave
researcher View more