arrow
返回

Compositional Neural Scene Representations for Shading Inference

delete2020-08-12
delete18
PRE
AI
J
Jonathan Granskog *
F
Fabrice Rousselle
M
Marios Papas
J
Jan Novák
DOI:10.1145/3386569.3392475delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
We present a technique for adaptively partitioning neural scene representations. Our method disentangles lighting, material, and geometric information yielding a scene representation that preserves the orthogonality of these components, improves interpretability of the model, and allows compositing new scenes by mixing components of existing ones. The proposed adaptive partitioning respects the uneven entropy of individual components and permits compressing the scene representation to lower its memory footprint and potentially reduce the evaluation cost of the model. Furthermore, the partitioned representation enables an in-depth analysis of existing image generators. We compare the flow of information through individual partitions, and by contrasting it to the impact of additional inputs (G-buffer), we are able to identify the roots of undesired visual artifacts, and propose one possible solution to remedy the poor performance. We also demonstrate the benefits of complementing traditional forward renderers by neural representations and synthesis, e.g. to infer expensive shading effects, and show how these could improve production rendering in the future if developed further.
Keyword:
rendering
neural networks
neural scene representations
disentanglement
attribution
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

ACM Transactions on Graphics 封面图
ACM Transactions on Graphics
IF:
9.5
论文数:
4.7K
被引数:
3.6W

机构

N
nvidia corporation
学者数:
767
论文数: 439
被引数: 1
E
ETH Zurich
学者数:
3.0W
论文数: 2.4W
被引数: 8.4W
S
swiss federal institutes of technology domain
学者数:
9.0W
论文数: 8.0W
被引数: 163
学者 查看更多机构
引用论文

引用论文

Neural Volumes: Learning Dynamic Renderable Volumes from images神经体积: 从图像中学习动态可渲染体积
err2019-07-12
err478
errOAAI
errLombardi, Stephen; Simon, Tomas; Saragih, Jason; Schwartz, Gabriel; Lehrmann, Andreas; Sheikh, Yaser
err分享
err收藏
Multi-view Relighting using a Geometry-Aware Network
err2019-07-12
err66
errOAAI
errPhilip, Julien; Gharbi, Michael; Zhou, Tinghui; Efros, Alexei A.; Drettakis, George
err分享
err收藏
Deep Video Portraits
err2018-07-30
err279
errOAAI
errKim, Hyeongwoo; Garrido, Pablo; Tewari, Ayush; Xu, Weipeng; Thies, Justus; Niessner, Matthias; Perez, Patrick; Richardt, Christian; Zollhofer, Michael; Theobalt, Christian
err分享
err收藏
Acute kidney injury: epidemiology and course in critically ill children
err2021-06-02
err0
PREAI
errChian Wern Tai; Kristen Gibbons; Andreas Schibler; Luregn J. Schlapbach; Sainath Raman
err分享
err收藏
Neural Importance Sampling
err2019-10-10
err180
errOAAI
errMueller, Thomas; Mcwilliams, Brian; Rousselle, Fabrice; Gross, Markus; Novak, Jan
err分享
err收藏
Global Illumination with Radiance Regression Functions
err2013-07-21
err70
PREAI
errRen, Peiran; Wang, Jiaping; Gong, Minmin; Lin, Stephen; Tong, Xin; Guo, Baining
err分享
err收藏
学者 查看更多内容