.png){kind=icon}
Return
Dense Depth-Guided Generalizable NeRF
.png){kind=icon}
PRE
AI
DOI：10.1109/LSP.2023.3240370.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Neural rendering approaches enable photo-realistic rendering on novel view synthesis tasks while their per-scene optimization remains an issue for scalability. Recent methods introduce novel neural radiance field (NeRF) frameworks that generalize to unseen scenes on-the-fly by combining multi-view stereo with differentiable volume rendering. These generalizable NeRF methods synthesize the colors of 3D ray points by learning the consistency of image features projected from given nearby views. Since the consistency is computed on the 2D projected image space, it is vulnerable to occlusion and local shape variation by viewing direction. To solve this problem, we present dense depth-guided generalizable NeRF that leverages the depth as the signed distance between the ray point and the object surface of the scene. We first generate the dense depth maps from sparse 3D points of structure from motion (SfM) which is an inevitable step to obtain camera poses. Next, the dense depth maps are exploited as complementary features invariant to the sparsity of nearby views and mask for occlusion handling. Experiments demonstrate that our approach outperforms existing generalizable NeRF methods for widely used real and synthetic datasets.
Keywords:
Three-dimensional displays
Rendering (computer graphics)
Image color analysis
Cameras
Feature extraction
Training
Optimization
Deep learning
neural radiance field
novel view synthesis
Journal
IF:
9.6
Papers:
1.1W
Citations:
1.7W
Organization
Cited Papers
Different Forms of Vigilance in Response to the Presence of Predators and Conspecifics in a Group‐Living Mammal, the European Rabbit.png)
Ethology
EthologyIF0
PREAI
ShareSave
ShareSaveShareSaveShareSave
View more