Self-Supervised Monocular Depth Estimation via Binocular Geometric Correlation Learning

Peng, Bo

doi:10.1145/3663570

Self-Supervised Monocular Depth Estimation via Binocular Geometric Correlation Learning

2024-06-13

2

PRE

AI

DOI：10.1145/3663570

Original request for help

Save

Abstract

En 中文

Monocular depth estimation aims to infer a depth map from a single image. Although supervised learning- based methods have achieved remarkable performance, they generally rely on a large amount of labor- intensively annotated data. Self-supervised methods, on the other hand, do not require any annotation of ground-truth depth and have recently attracted increasing attention. In this work, we propose a self- supervised monocular depth estimation network via binocular geometric correlation learning. Specifically, considering the inter-view geometric correlation, a binocular cue prediction module is presented to generate the auxiliary vision cue for the self-supervised learning of monocular depth estimation. Then, to deal with the occlusion in depth estimation, an occlusion interference attenuated constraint is developed to guide the supervision of the network by inferring the occlusion region and producing paired occlusion masks. Experimental results on two popular benchmark datasets have demonstrated that the proposed network obtains competitive results compared to state-of-the-art self-supervised methods and achieves comparable results to some popular supervised methods.

Keywords:

Multimedia applications

monocular depth estimation

self-supervised learning

binocular cue

occlusion-guided constraint

Self-Supervised Monocular Depth Estimation via Binocular Geometric Correlation Learning

Abstract

Journal

Organization