arrow
Return

Hierarchical Bayesian Guided Spatial-, Angular- and Temporal-Consistent View Synthesis

delete2025-11-12
delete0
PRE
AI
J
Junyu Zhu
朱
朱浩 (Hao Zhu)
王盛 cover
王盛 (Sheng Wang)
Z
Zhan Ma
X
Xun Cao
DOI:10.1109/TVCG.2025.3631702delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Neural Radiance Fields (NeRF) have gained significant attention due to their precise reconstruction and rapid inference capabilities, making them highly promising for applications in virtual reality and gaming. However, extending NeRF’s capabilities to dynamic scenes remains underexplored, particularly in ensuring consistent and coherent reconstructions across space, time, and viewing angles. To address this challenge, we propose Scale-NeRF, a novel approach that organizes the training of dynamic NeRFs as a progressive, scale-based refinement process, grounded in hierarchical Bayesian theory. Scale-NeRF begins by reconstructing the radiance fields using coarse, large-scale frames and iteratively refines them with progressively smaller-scale frames. This hierarchical strategy, combined with a corresponding sampling approach and a newly introduced structural loss, ensures consistency and integrity throughout the reconstruction process. Experiments on public datasets validate the superiority of Scale-NeRF over traditional methods, especially in terms of the proposed metrics evaluating spatial, angular, and temporal consistency. Furthermore, Scale-NeRF demonstrates excellent dynamic reconstruction capabilities with real-time rendering, offering a significant advancement for applications demanding both high fidelity and real-time performance.
Keywords:
Dynamic NeRF
inconsistent reconstruction
hierarchical bayesian theory
structural loss
consistent metrics

Journal

IEEE Transactions on Visualization and Computer Graphics cover
IEEE Transactions on Visualization and Computer Graphics
IF:
6.5
Papers:
353
Citations:
2.2W

Organization

Y
yilan tech
Scholars:
2
Papers: 1
Citations: 0
N
Nanjing University
Scholars:
7.0K
Papers: 2.6K
Citations: 8.1W
Cited Papers

Cited Papers

errShare
errSave
FINER: Flexible Spectral-Bias Tuning in Implicit NEural Representation by Variableperiodic Activation Functions
err
IF0
err2024-06-16
err0
PREAI
errZhen Liu; Hao Zhu; Qi Zhang; Jingde Fu; Weibing Deng; Zhan Ma; Yanwen Guo; Xun Cao
errShare
errSave
Pyramid NeRF: Frequency Guided Fast Radiance Field Optimization
err2023-06-16
err1
PREAI
errZhu, Junyu; Zhu, Hao; Zhang, Qi; Zhu, Fang; Ma, Zhan; Cao, Xun
errShare
errSave
Advances in Neural Rendering
err2022-05-24
err0
errOAAI
errA. Tewari; J. Thies; B. Mildenhall; P. Srinivasan; E. Tretschk; W. Yifan; C. Lassner; V. Sitzmann; R. Martin‐Brualla; S. Lombardi; T. Simon; C. Theobalt; M. Nießner; J. T. Barron; G. Wetzstein; M. Zollhöfer; V. Golyanik
errShare
errSave
NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstruction
err2023-10-01
err0
errOAAI
errYiming Wang; Qin Han; Marc Habermann; Kostas Daniilidis; Christian Theobalt; Lingjie Liu
errShare
errSave
Three-dimensional scene flow
err1999-01-01
err0
PREAI
errS. Vedula; S. Baker; P. Rander; R. Collins; T. Kanade
errShare
errSave
Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields
err2021-10-01
err0
errOAAI
errJonathan T. Barron; Ben Mildenhall; Matthew Tancik; Peter Hedman; Ricardo Martin-Brualla; Pratul P. Srinivasan
errShare
errSave
Neural 3D Video Synthesis from Multi-view Video
err2022-06-01
err0
errOAAI
errTianye Li; Mira Slavcheva; Michael Zollhoefer; Simon Green; Christoph Lassner; Changil Kim; Tanner Schmidt; Steven Lovegrove; Michael Goesele; Richard Newcombe; Zhaoyang Lv
errShare
errSave
researcher View more