arrow
Return

Dictionary Fields: Learning a Neural Basis Decomposition

delete2023-07-26
delete6
PRE
AI
A
Anpei Chen *
Z
Zexiang Xu
X
Xinyue Wei
S
Siyu Tang
H
Hao Su
A
Andreas Geiger
DOI:10.1145/3592135delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We present Dictionary Fields, a novel neural representation which decomposes a signal into a product of factors, each represented by a classical or neural field representation, operating on transformed input coordinates. More specifically, we factorize a signal into a coefficient field and a basis field, and exploit periodic coordinate transformations to apply the same basis functions across multiple locations and scales. Our experiments show that Dictionary Fields lead to improvements in approximation quality, compactness, and training time when compared to previous fast reconstruction methods. Experimentally, our representation achieves better image approximation quality on 2D image regression tasks, higher geometric quality when reconstructing 3D signed distance fields, and higher compactness for radiance field reconstruction tasks. Furthermore, Dictionary Fields enable generalization to unseen images/3D scenes by sharing bases across signals during training which greatly benefits use cases such as image regression from partial observations and few-shot radiance field reconstruction.
Keywords:
Neural Representation
Reconstruction
Neural Radiance Fields

Journal

ACM Transactions on Graphics cover
ACM Transactions on Graphics
IF:
9.5
Papers:
4.8K
Citations:
3.6W

Organization

A
adobe systems inc.
Scholars:
273
Papers: 305
Citations: 0
E
eberhard karls university of tubingen
Scholars:
3.3W
Papers: 2.5W
Citations: 38
E
ETH Zurich
Scholars:
3.0W
Papers: 2.4W
Citations: 8.4W
S
swiss federal institutes of technology domain
Scholars:
9.0W
Papers: 8.0W
Citations: 163
University of California System cover
University of California System
Scholars:
37.7W
Papers: 33.8W
Citations: 6.6K
U
University of California San Diego
Scholars:
4.6W
Papers: 3.5W
Citations: 924
researcher View more organizations
Cited Papers

Cited Papers

Neural Volumes: Learning Dynamic Renderable Volumes from images
err2019-07-12
err478
errOAAI
errLombardi, Stephen; Simon, Tomas; Saragih, Jason; Schwartz, Gabriel; Lehrmann, Andreas; Sheikh, Yaser
errShare
errSave
Tanks and Temples: Benchmarking Large-Scale Scene Reconstruction
err2017-07-20
err636
PREAI
errKnapitsch, Arno; Park, Jaesik; Zhou, Qian-Yi; Koltun, Vladlen
errShare
errSave
CD133-targeted delivery of self-assembled PEGylated carboxymethylcellulose-SN38 nanoparticles to colorectal cancer
err2018-03-08
err0
errOAAI
errMona Alibolandi; Khalil Abnous; Sajjad Anvari; Marzieh Mohammadi; Mohammad Ramezani; Seyed Mohammad Taghdisi
errShare
errSave
errShare
errSave
err1998-01-01
err0
PREAI
errMin-Ling Chung; Fang-Yuan Lee; Li-Chun Lin; Chi-Jung Su; Min-Yen Chen; Yuh-Sheng Wen; Han-Mou Gau; Kuang-Lieh Lu
errShare
errSave
Redox-dependent structure and dynamics of macrophage migration inhibitory factor reveal sites of latent allostery
err2022-06-01
err0
errOAAI
errErin Skeens; Meagan Gadzuk-Shea; Dilip Shah; Vineet Bhandari; Devin K. Schweppe; Rebecca B. Berlow; George P. Lisi
errShare
errSave
researcher View more