返回
DeepLight: light source estimation for augmented reality using deep learning
DOI:10.1007/s00371-019-01666-x.png)
摘要
En 中文
This paper presents a novel method for illumination estimation from RGB-D images. The main focus of the proposed method is to enhance visual coherence in augmented reality applications by providing accurate and temporally coherent estimates of real illumination. For this purpose, we designed and trained a deep neural network which calculates a dominant light direction from a single RGB-D image. Additionally, we propose a novel method for real-time outlier detection to achieve temporally coherent estimates. Our method for light source estimation in augmented reality was evaluated on the set of real scenes. Our results demonstrate that the neural network can successfully estimate light sources even in scenes which were not seen by the network during training. Moreover, we compared our results with illumination estimates calculated by the state-of-the-art method for illumination estimation. Finally, we demonstrate the applicability of our method on numerous augmented reality scenes.
Keyword:
Light source estimation
Augmented reality
Photometric registration
Deep learning
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
2.9
论文数:
4.6K
被引数:
6.5K
机构
引用论文
Electrical, optical and structural properties of transparent conducting Al doped ZnO (AZO) deposited by sol-gel spin coating
AIP Advances
IF0

