arrow
Return

Instant Neural Graphics Primitives with a Multiresolution Hash Encoding

delete2022-07-22
delete1.1K
delete
OA
AI
T
Thomas Müller *
A
Alex Evans
A
Alexander Keller
DOI:10.1145/3528223.3530127delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Neural graphics primitives, parameterized by fully connected neural networks, can be costly to train and evaluate. We reduce this cost with a versatile new input encoding that permits the use of a smaller network without sacrificing quality, thus significantly reducing the number of floating point and memory access operations: a small neural network is augmented by a multiresolution hash table of trainable feature vectors whose values are optimized through stochastic gradient descent. The multiresolution structure allows the network to disambiguate hash collisions, making for a simple architecture that is trivial to parallelize on modern GPUs. We leverage this parallelism by implementing the whole system using fully-fused CUDA kernels with a focus on minimizing wasted bandwidth and compute operations. We achieve a combined speedup of several orders of magnitude, enabling training of high-quality neural graphics primitives in a matter of seconds, and rendering in tens of milliseconds at a resolution of 1920x1080.
Keywords:
Image Synthesis
Neural Networks
Encodings
Hashing
GPUs
Parallel Computation
Function Approximation

Journal

ACM Transactions on Graphics cover
ACM Transactions on Graphics
IF:
9.5
Papers:
4.8K
Citations:
3.6W

Organization

No organization information available
Cited Papers

Cited Papers

Acorn: Adaptive Coordinate Networks for Neural Scene Representation
err2021-07-19
err84
PREAI
errMartel, Julien N. P.; Lindell, David B.; Lin, Connor Z.; Chan, Eric R.; Monteiro, Marco; Wetzstein, Gordon
errShare
errSave
Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelines
err2019-07-12
err612
errOAAI
errMildenhall, Ben; Srinivasan, Pratul P.; Ortiz-Cayon, Rodrigo; Kalantari, Nima Khademi; Ramamoorthi, Ravi; Ng, Ren; Kar, Abhishek
errShare
errSave
Real-time Neural Radiance Caching for Path Tracing
err2021-07-19
err64
errOAAI
errMuller, Thomas; Rousselle, Fabrice; Novak, Jan; Keller, Alexander
errShare
errSave
Combined Brønsted Base-Promoted CO2 Fixation into Benzylic C–H Bonds of Alkylarenes
err2022-06-28
err0
PREAI
errMasanori Shigeno; Itsuki Tohara; Keita Sasaki; Kanako Nozawa-Kumada; Yoshinori Kondo
errShare
errSave
Redundancy in Ecosystems
err1994-01-01
err0
PREAI
errJ. H. Lawton; V. K. Brown
errShare
errSave
Neural Control Variates
err2020-11-27
err42
PREAI
errMuller, Thomas; Rousselle, Fabrice; Keller, Alexander; Novak, Jan
errShare
errSave
Real-time Compression and Streaming of 4D Performances
err2018-12-04
err9
errOAAI
errTang, Danhang; Dou, Mingsong; Lincoln, Peter; Davidson, Philip; Guo, Kaiwen; Taylor, Jonathan; Fanello, Sean; Keskin, Cem; Kowdle, Adarsh; Bouaziz, Sofien; Izadi, Shahram; Tagliasacchi, Andrea
errShare
errSave
errShare
errSave
researcher View more