arrow
返回

SNeRF: Stylized Neural Implicit Representations for 3D Scenes

delete2022-07-22
delete25
delete
OA
AI
刘枫 封面图
刘枫 (Feng Liu)
L
Lei Xiao
DOI:10.1145/3528223.3530107delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This paper presents a stylized novel view synthesis method. Applying state-of-the-art stylization methods to novel views frame by frame often causes jittering artifacts due to the lack of cross-view consistency. Therefore, this paper investigates 3D scene stylization that provides a strong inductive bias for consistent novel view synthesis. Specifically, we adopt the emerging neural radiance fields (NeRF) as our choice of 3D scene representation for their capability to render high-quality novel views for a variety of scenes. However, as rendering a novel view from a NeRF requires a large number of samples, training a stylized NeRF requires a large amount of GPU memory that goes beyond an off-the-shelf GPU capacity. We introduce a new training method to address this problem by alternating the NeRF and stylization optimization steps. Such a method enables us to make full use of our hardware memory capacity to both generate images at higher resolution and adopt more expressive image style transfer methods. Our experiments show that our method produces stylized NeRFs for a wide range of content, including indoor, outdoor and dynamic scenes, and synthesizes high-quality novel views with cross-view consistency.
Keyword:
neural style transfer
implicit scene representations
view synthesis
stylization

期刊

ACM Transactions on Graphics 封面图
ACM Transactions on Graphics
IF:
9.5
论文数:
4.8K
被引数:
3.6W

机构

暂无机构信息
引用论文

引用论文

Single crystals of hydrogenase from Desulfovibrio vulgaris Miyazaki F.
err1987-02-01
err0
errOAAI
errY. Higuchi; N. Yasuoka; M. Kakudo; Y. Katsube; T. Yagi; H. Inokuchi
err分享
err收藏
Exploring complex CIDEP ofp-benzosemiquinones with time resolved CW-EPR
err2002-05-10
err0
PREAI
errMARTIN JÄGER; BRIAN C. YU; JAMES R. NORRIS
err分享
err收藏
Mutation in SAM domain of TP63 is associated with nonsyndromic cleft lip and palate and cleft palate
err2011-05-12
err0
errOAAI
errPiranit N. Kantaputra; Sutti Malaivijitnond; Alexandre R. Vieira; Jan Heering; Volker Dötsch; Theerapong Khankasikum; Warissara Sripathomsawat
err分享
err收藏
StyLit: Illumination-Guided Example-Based Stylization of 3D Renderings
err2016-07-11
err89
PREAI
errFiser, Jakub; Jamriska, Ondrej; Lukac, Michal; Shechtman, Eli; Asente, Paul; Lu, Jingwan; Sykora, Daniel
err分享
err收藏
Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelines局部光场融合: 具有规定采样指南的实用视图合成
err2019-07-12
err612
errOAAI
errMildenhall, Ben; Srinivasan, Pratul P.; Ortiz-Cayon, Rodrigo; Kalantari, Nima Khademi; Ramamoorthi, Ravi; Ng, Ren; Kar, Abhishek
err分享
err收藏
err分享
err收藏
学者 查看更多内容