arrow
返回

Image Based Relighting Using Neural Networks

delete2015-07-27
delete78
PRE
AI
P
Peiran Ren
Y
Yue Dong
S
Stephen Lin
X
Xin Tong
B
Baining Guo
DOI:10.1145/2766899delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
We present a neural network regression method for relighting real-world scenes from a small number of images. The relighting in this work is formulated as the product of the scene's light transport matrix and new lighting vectors, with the light transport matrix reconstructed from the input images. Based on the observation that there should exist non-linear local coherence in the light transport matrix, our method approximates matrix segments using neural networks that model light transport as a non-linear function of light source position and pixel coordinates. Central to this approach is a proposed neural network design which incorporates various elements that facilitate modeling of light transport from a small image set. In contrast to most image based relighting techniques, this regression-based approach allows input images to be captured under arbitrary illumination conditions, including light sources moved freely by hand. We validate our method with light transport data of real scenes containing complex lighting effects, and demonstrate that fewer input images are required in comparison to related techniques.
Keyword:
image based relighting
light transport
neural network
clustering
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

ACM Transactions on Graphics 封面图
ACM Transactions on Graphics
IF:
9.5
论文数:
4.7K
被引数:
3.6W

机构

暂无机构信息
引用论文

引用论文

err分享
err收藏
Performance relighting and reflectance transformation with time-multiplexed illumination
err2005-07-01
err189
PREAI
errWenger, A; Gardner, A; Tchou, C; Unger, J; Hawkins, T; Debevec, P
err分享
err收藏
Scanning electron microscopy and X-ray microanalysis of reconstructive hair fibers
err2017-01-01
err0
errOAAI
errAndrea Combalia; Albert Brugués; FJavier García-Veigas; Juan Ferrando
err分享
err收藏
Compressive Light Field Photography using Overcomplete Dictionaries and Optimized Projections
err2013-07-21
err274
errOAAI
errMarwah, Kshitij; Wetzstein, Gordon; Bando, Yosuke; Raskar, Ramesh
err分享
err收藏
Compressive Light Transport Sensing
err2009-02-09
err111
PREAI
errPeers, Pieter; Mahajan, Dhruv K.; Lamond, Bruce; Ghosh, Abhijeet; Matusik, Wojciech; Ramamoorthi, Ravi; Debevec, Paul
err分享
err收藏
TensorTextures: Multilinear image-based rendering
err2004-08-01
err115
PREAI
errVasilescu, MAO; Terzopoulos, D
err分享
err收藏
Development and validation of risk stratification trees for incident slow gait speed in persons at high risk for knee osteoarthritis
err2019-10-01
err0
errOAAI
errLeena Sharma; Kent Kwoh; Jungwha (Julia) Lee; Jane Cauley; Rebecca Jackson; Marc Hochberg; Alison H Chang; Charles Eaton; Michael Nevitt; Jing Song; Orit Almagor; Joan S Chmiel
err分享
err收藏
学者 查看更多内容