arrow
返回

Physics-based learning: Adaptive structured light for active stereo depth estimation

delete2024-01-01
delete1
PRE
AI
贾
贾同 (Tong Jia)
X
Xiao Yang *
Y
Yizhe Liu
X
Xiaofang Li
D
Dongyue Chen
S
Shizhuo Deng
王
王昊 (Hao Wang)
DOI:10.1016/j.optlaseng.2023.107883delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Active stereo systems based on structured light are widely used for 3D vision in various applications, which project specially designed patterns onto object surfaces to encode each position in space for accurate 3D measurements. However, existing approaches use pre-determined patterns that are isolated from the scene properties (object reflectivity, distance, ambient light, inter-reflection), equipment (projector, camera), and reconstruction. Meanwhile, the parameters of the structured light are determined through empirical analysis or several experiments. In this paper, we propose a novel structured light design approach, named Physics-Based Learning Adaptive Structured Light (PBL-ASL), which directly learns the optimal structured light patterns from the scene. To this end, (1) we design a decoder with a non-sinusoidal error suppression module for PBL-ASL, which can accurately estimate the disparity during structured light optimization; (2) we propose a physics-based learning algorithm consisting of a self-supervised objective function and a differentiable imaging model, which computes the disparity error and back-propagates the gradient to the encoding vector to optimize the structured light. Our experiments demonstrate that PBL-ASL can significantly improve the depth estimation accuracy of active stereo systems over several state-of-art methods.
Keyword:
Adaptive structured light
Depth estimation
Physics-based learning

期刊

Optics and Lasers in Engineering 封面图
Optics and Lasers in Engineering
IF:
3.7
论文数:
7.3K
被引数:
1.7W

机构

N
northeastern university - china
学者数:
3.2W
论文数: 2.7W
被引数: 37
引用论文

引用论文

High probability of disrupting a disulphide bridge mediated by an endogenous excited tryptophan residue
err2009-04-13
err0
errOAAI
errMaria Teresa Neves‐Petersen; Zygmunt Gryczynski; Joseph Lakowicz; Peter Fojan; Shona Pedersen; Evamaria Petersen; Steffen Bjørn Petersen
err分享
err收藏
Optimal biologic dose of metronomic chemotherapy regimens is associated with maximum antiangiogenic activity
err2005-11-01
err0
errOAAI
errYuval Shaked; Urban Emmenegger; Shan Man; Dave Cervi; Francesco Bertolini; Yaacov Ben-David; Robert S. Kerbel
err分享
err收藏
err分享
err收藏
Generalized framework for non-sinusoidal fringe analysis using deep learning
err2021-05-27
err110
PREAI
errFeng, Shijie; Zuo, Chao; Zhang, Liang; Yin, Wei; Chen, Qian
err分享
err收藏
A state of the art in structured light patterns for surface profilometry
err2010-08-01
err759
PREAI
errSalvi, Joaquim; Fernandez, Sergio; Pribanic, Tomislav; Llado, Xavier
err分享
err收藏
High-efficiency dynamic three-dimensional shape measurement based on misaligned Gray-code light
err2022-03-01
err22
PREAI
errLu, Lilian; Wu, Zhoujie; Zhang, Qican; Chen, Chaowen; Li, Yueyang; Li, Fengjiao
err分享
err收藏
err分享
err收藏
学者 查看更多内容