arrow
Return

Physics-based learning: Adaptive structured light for active stereo depth estimation

delete2024-01-01
delete1
PRE
AI
贾
贾同 (Tong Jia)
X
Xiao Yang *
Y
Yizhe Liu
X
Xiaofang Li
D
Dongyue Chen
S
Shizhuo Deng
王
王昊 (Hao Wang)
DOI:10.1016/j.optlaseng.2023.107883delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Active stereo systems based on structured light are widely used for 3D vision in various applications, which project specially designed patterns onto object surfaces to encode each position in space for accurate 3D measurements. However, existing approaches use pre-determined patterns that are isolated from the scene properties (object reflectivity, distance, ambient light, inter-reflection), equipment (projector, camera), and reconstruction. Meanwhile, the parameters of the structured light are determined through empirical analysis or several experiments. In this paper, we propose a novel structured light design approach, named Physics-Based Learning Adaptive Structured Light (PBL-ASL), which directly learns the optimal structured light patterns from the scene. To this end, (1) we design a decoder with a non-sinusoidal error suppression module for PBL-ASL, which can accurately estimate the disparity during structured light optimization; (2) we propose a physics-based learning algorithm consisting of a self-supervised objective function and a differentiable imaging model, which computes the disparity error and back-propagates the gradient to the encoding vector to optimize the structured light. Our experiments demonstrate that PBL-ASL can significantly improve the depth estimation accuracy of active stereo systems over several state-of-art methods.
Keywords:
Adaptive structured light
Depth estimation
Physics-based learning

Journal

Optics and Lasers in Engineering cover
Optics and Lasers in Engineering
IF:
3.7
Papers:
7.3K
Citations:
1.7W

Organization

N
northeastern university - china
Scholars:
3.2W
Papers: 2.7W
Citations: 37
Cited Papers

Cited Papers

High probability of disrupting a disulphide bridge mediated by an endogenous excited tryptophan residue
err2009-04-13
err0
errOAAI
errMaria Teresa Neves‐Petersen; Zygmunt Gryczynski; Joseph Lakowicz; Peter Fojan; Shona Pedersen; Evamaria Petersen; Steffen Bjørn Petersen
errShare
errSave
Optimal biologic dose of metronomic chemotherapy regimens is associated with maximum antiangiogenic activity
err2005-11-01
err0
errOAAI
errYuval Shaked; Urban Emmenegger; Shan Man; Dave Cervi; Francesco Bertolini; Yaacov Ben-David; Robert S. Kerbel
errShare
errSave
errShare
errSave
Generalized framework for non-sinusoidal fringe analysis using deep learning
err2021-05-27
err110
PREAI
errFeng, Shijie; Zuo, Chao; Zhang, Liang; Yin, Wei; Chen, Qian
errShare
errSave
A state of the art in structured light patterns for surface profilometry
err2010-08-01
err759
PREAI
errSalvi, Joaquim; Fernandez, Sergio; Pribanic, Tomislav; Llado, Xavier
errShare
errSave
High-efficiency dynamic three-dimensional shape measurement based on misaligned Gray-code light
err2022-03-01
err22
PREAI
errLu, Lilian; Wu, Zhoujie; Zhang, Qican; Chen, Chaowen; Li, Yueyang; Li, Fengjiao
errShare
errSave
errShare
errSave
researcher View more