arrow
返回

DeepLight: light source estimation for augmented reality using deep learning

delete2019-05-07
delete29
delete
OA
AI
P
Peter Kán *
H
Hannes Kafumann
DOI:10.1007/s00371-019-01666-xdelete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
This paper presents a novel method for illumination estimation from RGB-D images. The main focus of the proposed method is to enhance visual coherence in augmented reality applications by providing accurate and temporally coherent estimates of real illumination. For this purpose, we designed and trained a deep neural network which calculates a dominant light direction from a single RGB-D image. Additionally, we propose a novel method for real-time outlier detection to achieve temporally coherent estimates. Our method for light source estimation in augmented reality was evaluated on the set of real scenes. Our results demonstrate that the neural network can successfully estimate light sources even in scenes which were not seen by the network during training. Moreover, we compared our results with illumination estimates calculated by the state-of-the-art method for illumination estimation. Finally, we demonstrate the applicability of our method on numerous augmented reality scenes.
Keyword:
Light source estimation
Augmented reality
Photometric registration
Deep learning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Visual Computer 封面图
Visual Computer
IF:
2.9
论文数:
4.6K
被引数:
6.5K

机构

T
Technische Universitat Wien
学者数:
1.3W
论文数: 1.1W
被引数: 21
引用论文

引用论文

Electrical, optical and structural properties of transparent conducting Al doped ZnO (AZO) deposited by sol-gel spin coating
err2018-06-08
err0
errOAAI
errKaniz Naila Tonny; Rosaleena Rafique; Afrina Sharmin; Muhammad Shahriar Bashar; Zahid Hasan Mahmood
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
ElasticFusion: Real-time dense SLAM and light source estimation
err2016-09-30
err509
errOAAI
errWhelan, Thomas; Salas-Moreno, Renato F.; Glocker, Ben; Davison, Andrew J.; Leutenegger, Stefan
err分享
err收藏
Gram Staining
err2005-10-15
err0
PREAI
errRichard Coico
err分享
err收藏
Learning to Predict Indoor Illumination from a Single Image学习从单个图像预测室内照明
err2017-11-20
err148
errOAAI
errGardner, Marc-Andre; Sunkavalli, Kalyan; Yumer, Ersin; Shen, Xiaohui; Gambaretto, Emiliano; Gagne, Christian; Lalonde, Jean-Francois
err分享
err收藏
学者 查看更多内容