arrow
返回

Deep Image-Based Relighting from Optimal Sparse Samples

delete2018-07-30
delete135
PRE
AI
K
Kalyan Sunkavalli
R
Ravi Ramamoorthi
DOI:10.1145/3197517.3201313delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
We present an image-based relighting method that can synthesize scene appearance under novel, distant illumination from the visible hemisphere, from only five images captured under pre-defined directional lights. Our method uses a deep convolutional neural network to regress the relit image from these five images; this relighting network is trained on a large synthetic dataset comprised of procedurally generated shapes with real-world reflectances. We show that by combining a custom-designed sampling network with the relighting network, we can jointly learn both the optimal input light directions and the relighting function. We present an extensive evaluation of our network, including an empirical analysis of reconstruction quality, optimal lighting configurations for different scenarios, and alternative network architectures. We demonstrate, on both synthetic and real scenes, that our method is able to reproduce complex, high-frequency lighting effects like specularities and cast shadows, and outperforms other image-based relighting methods that require an order of magnitude more images.
Keyword:
Image-based relighting
Illumination
Convolutional Neural Network
Sparse sampling
Appearance capture
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

ACM Transactions on Graphics 封面图
ACM Transactions on Graphics
IF:
9.5
论文数:
4.7K
被引数:
3.6W

机构

University of California System 封面图
University of California System
学者数:
37.6W
论文数: 33.8W
被引数: 6.6K
U
University of California San Diego
学者数:
4.6W
论文数: 3.5W
被引数: 924
引用论文

引用论文

Learning to Predict Indoor Illumination from a Single Image学习从单个图像预测室内照明
err2017-11-20
err148
errOAAI
errGardner, Marc-Andre; Sunkavalli, Kalyan; Yumer, Ersin; Shen, Xiaohui; Gambaretto, Emiliano; Gagne, Christian; Lalonde, Jean-Francois
err分享
err收藏
Compressive Light Transport Sensing
err2009-02-09
err111
PREAI
errPeers, Pieter; Mahajan, Dhruv K.; Lamond, Bruce; Ghosh, Abhijeet; Matusik, Wojciech; Ramamoorthi, Ravi; Debevec, Paul
err分享
err收藏
Development and validation of risk stratification trees for incident slow gait speed in persons at high risk for knee osteoarthritis
err2019-10-01
err0
errOAAI
errLeena Sharma; Kent Kwoh; Jungwha (Julia) Lee; Jane Cauley; Rebecca Jackson; Marc Hochberg; Alison H Chang; Charles Eaton; Michael Nevitt; Jing Song; Orit Almagor; Joan S Chmiel
err分享
err收藏
err分享
err收藏
学者 查看更多内容