arrow
返回

Geometry-guided generalizable NeRF for human rendering

delete2024-02-08
delete0
PRE
AI
J
Jiu-Cheng Xie
Y
Yiqin Yao
L
Lv Xun
S
Shuliang Zhu
Y
Yijing Guo *
H
Hao Gao *
DOI:10.1007/s11042-024-18410-wdelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
It is challenging to render photo-realistic novel views of humans from sparse input views. On one hand, recent works for human rendering are confined to person-specific cases and thus are not generalized to new performers. On the other hand, the algorithms, which are generalizable to novel targets, are developed for scenes or objects and are not directly applicable to novel performers with complex body poses. To this end, we propose a new human rendering pipeline that just takes sparse views of a target performer who never shows up in the training data as the input. Then, it synthesizes high-quality captures at arbitrary viewpoints. The core of our framework is to leverage geometric priors to guide neural radiance fields for human rendering with multi-view images as input. This can not only help deal with the self-occlusion problem caused by skeleton motion when aggregating multi-view features, but also contribute to reasoning about the geometry of the performers. Results of qualitative and quantitative evaluations both show that our method exhibits stronger generalization ability than the current state-of-the-art techniques.
Keyword:
Novel view synthesis
Neural rendering
Image-based rendering

期刊

Multimedia Tools and Applications 封面图
Multimedia Tools and Applications
IF:
3
论文数:
2.0W
被引数:
3.2W

机构

S
southeast university - china
学者数:
5.3W
论文数: 4.9W
被引数: 57
H
Hosei University
学者数:
953
论文数: 1.1K
被引数: 718
引用论文

引用论文

err分享
err收藏
Significance of the Protein Interface Configuration for Allostery in Imidazole Glycerol Phosphate Synthase
err2020-07-07
err0
PREAI
errAndrea C. Kneuttinger; Chitra Rajendran; Nadja A. Simeth; Astrid Bruckmann; Burkhard König; Reinhard Sterner
err分享
err收藏
ABA signaling plays a key role in regulated deficit irrigation-driven anthocyanins accumulation in ‘Cabernet Sauvignon’ grape berries
err2021-01-01
err0
PREAI
errShui-Huan Guo; Bo-Han Yang; Xiao-Wei Wang; Jun-Nan Li; Shuai Li; Xin Yang; Rui-Hua Ren; Yu-Lin Fang; Teng-Fei Xu; Zhen-Wen Zhang; Jiang-Fei Meng
err分享
err收藏
err分享
err收藏
err分享
err收藏
Alpha globin gene duplications in beta thalassemia patients with intact beta globin gene
err2010-03-01
err0
PREAI
errValeria Faà; Maddalena Masala; Antonio Cao; Maria Cristina Rosatelli
err分享
err收藏
err分享
err收藏
学者 查看更多内容