Dictionary Fields: Learning a Neural Basis Decomposition

Anpei Chen

doi:10.1145/3592135

Dictionary Fields: Learning a Neural Basis Decomposition

2023-07-26

6

PRE

AI

DOI：10.1145/3592135

Original request for help

Save

Abstract

En 中文

We present Dictionary Fields, a novel neural representation which decomposes a signal into a product of factors, each represented by a classical or neural field representation, operating on transformed input coordinates. More specifically, we factorize a signal into a coefficient field and a basis field, and exploit periodic coordinate transformations to apply the same basis functions across multiple locations and scales. Our experiments show that Dictionary Fields lead to improvements in approximation quality, compactness, and training time when compared to previous fast reconstruction methods. Experimentally, our representation achieves better image approximation quality on 2D image regression tasks, higher geometric quality when reconstructing 3D signed distance fields, and higher compactness for radiance field reconstruction tasks. Furthermore, Dictionary Fields enable generalization to unseen images/3D scenes by sharing bases across signals during training which greatly benefits use cases such as image regression from partial observations and few-shot radiance field reconstruction.

Keywords:

Neural Representation

Reconstruction

Neural Radiance Fields

Dictionary Fields: Learning a Neural Basis Decomposition

Abstract

Journal

Organization