.png){kind=icon}
返回
Structure-aware neural radiance fields without posed camera
.png){kind=icon}
PRE
AI
DOI：10.1016/j.patcog.2024.110419.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The neural radiance fields (NeRF) for realistic novel view synthesis require camera poses to be pre -acquired by a structure -from -motion (SfM) approach. This two -stage strategy is not convenient to use and degrades the performance because the error in the pose extraction can propagate to the view synthesis. We integrate pose extraction and view synthesis into a jointly optimized process so that they can benefit from each other. For network training, only images are given without pre -known camera poses. The camera poses are obtained by the depth -consistent constraint in which the identical feature in different views has the same world coordinates transformed from the local camera coordinates according to the extracted poses. The depth -consistent constraint is jointly optimized with the pixel color constraint. The poses are represented by a CNN -based deep network, whose input is the related frames. This joint optimization enables NeRF to be aware of the scene's structure, resulting in improved generalization performance. Experiments on three datasets demonstrate the effectiveness of camera pose estimation and novel view synthesis. Code is available at https://github.com/XTU-PR-LAB/SaNerf.
Keyword:
Neural radiance fields
Depth consistent constraint
Novel view synthesis
期刊
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
Different Forms of Vigilance in Response to the Presence of Predators and Conspecifics in a Group‐Living Mammal, the European Rabbit.png)
Ethology
EthologyIF0
PREAI
分享收藏The weak link of democracy and the challenges of educating toward global citizenshipPROSPECTS
OAAI
PROSPECTSIF0
OAAI分享收藏Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelines局部光场融合: 具有规定采样指南的实用视图合成
OAAI
OAAI分享收藏Effect of poly(lactic acid) crystallization on its mechanical and heat resistance performancesPolymer
PolymerIF0
PREAI
分享收藏Effects of feeding rates on growth, body composition and nutrient metabolism in striped bass (Morone saxatilis) fingerlingsAquaculture
AquacultureIF0
PREAI
分享收藏Attachment and early brain development – neuroprotective interventions in infant–caregiver therapyOAAI
OAAI分享收藏
查看更多内容