.png){kind=icon}
返回
Dense Depth-Guided Generalizable NeRF
.png){kind=icon}
PRE
AI
DOI：10.1109/LSP.2023.3240370.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Neural rendering approaches enable photo-realistic rendering on novel view synthesis tasks while their per-scene optimization remains an issue for scalability. Recent methods introduce novel neural radiance field (NeRF) frameworks that generalize to unseen scenes on-the-fly by combining multi-view stereo with differentiable volume rendering. These generalizable NeRF methods synthesize the colors of 3D ray points by learning the consistency of image features projected from given nearby views. Since the consistency is computed on the 2D projected image space, it is vulnerable to occlusion and local shape variation by viewing direction. To solve this problem, we present dense depth-guided generalizable NeRF that leverages the depth as the signed distance between the ray point and the object surface of the scene. We first generate the dense depth maps from sparse 3D points of structure from motion (SfM) which is an inevitable step to obtain camera poses. Next, the dense depth maps are exploited as complementary features invariant to the sparsity of nearby views and mask for occlusion handling. Experiments demonstrate that our approach outperforms existing generalizable NeRF methods for widely used real and synthetic datasets.
Keyword:
Three-dimensional displays
Rendering (computer graphics)
Image color analysis
Cameras
Feature extraction
Training
Optimization
Deep learning
neural radiance field
novel view synthesis
期刊
IF:
9.6
论文数:
1.1W
被引数:
1.7W
机构
引用论文
Different Forms of Vigilance in Response to the Presence of Predators and Conspecifics in a Group‐Living Mammal, the European Rabbit.png)
Ethology
EthologyIF0
PREAI
分享收藏Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelines局部光场融合: 具有规定采样指南的实用视图合成
OAAI
OAAI分享收藏An Ultra-Trace Analysis Technique for SF6 Using Gas Chromatography with Negative Ion Chemical Ionization Mass Spectrometry使用气相色谱-负离子化学电离质谱对SF6的超痕量分析技术OAAI
OAAI分享收藏
查看更多内容