返回
Geometry-guided generalizable NeRF for human rendering
DOI:10.1007/s11042-024-18410-w.png)
摘要
En 中文
It is challenging to render photo-realistic novel views of humans from sparse input views. On one hand, recent works for human rendering are confined to person-specific cases and thus are not generalized to new performers. On the other hand, the algorithms, which are generalizable to novel targets, are developed for scenes or objects and are not directly applicable to novel performers with complex body poses. To this end, we propose a new human rendering pipeline that just takes sparse views of a target performer who never shows up in the training data as the input. Then, it synthesizes high-quality captures at arbitrary viewpoints. The core of our framework is to leverage geometric priors to guide neural radiance fields for human rendering with multi-view images as input. This can not only help deal with the self-occlusion problem caused by skeleton motion when aggregating multi-view features, but also contribute to reasoning about the geometry of the performers. Results of qualitative and quantitative evaluations both show that our method exhibits stronger generalization ability than the current state-of-the-art techniques.
Keyword:
Novel view synthesis
Neural rendering
Image-based rendering
期刊
IF:
3
论文数:
2.0W
被引数:
3.2W
机构
引用论文
Significance of the Protein Interface Configuration for Allostery in Imidazole Glycerol Phosphate Synthase
Biochemistry
IF0
Does the Complexity of the Task Influence Manual Laterality in De Brazza’s Monkeys (Cercopithecus neglectus)?
Ethology
IF0
An Ultra-Trace Analysis Technique for SF6 Using Gas Chromatography with Negative Ion Chemical Ionization Mass Spectrometry使用气相色谱-负离子化学电离质谱对SF6的超痕量分析技术

