arrow
Return

Unsupervised Scale-Consistent Depth Learning from Video

delete2021-06-18
delete111
delete
OA
AI
J
Jia-Wang Bian *
H
Huangying Zhan
N
Naiyan Wang
Z
Zhichao Li
张乐 cover
张乐 (Le Zhang)
C
Chunhua Shen
M
Ming‐Ming Cheng
I
Ian Reid
DOI:10.1007/s11263-021-01484-6delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
We propose a monocular depth estimation method SC-Depth, which requires only unlabelled videos for training and enables the scale-consistent prediction at inference time. Our contributions include: (i) we propose a geometry consistency loss, which penalizes the inconsistency of predicted depths between adjacent views; (ii) we propose a self-discovered mask to automatically localize moving objects that violate the underlying static scene assumption and cause noisy signals during training; (iii) we demonstrate the efficacy of each component with a detailed ablation study and show high-quality depth estimation results in both KITTI and NYUv2 datasets. Moreover, thanks to the capability of scale-consistent prediction, we show that our monocular-trained deep networks are readily integrated into ORB-SLAM2 system for more robust and accurate tracking. The proposed hybrid Pseudo-RGBD SLAM shows compelling results in KITTI, and it generalizes well to the KAIST dataset without additional training. Finally, we provide several demos for qualitative evaluation. The source code is released on GitHub.
Keywords:
Unsupervised depth estimation
Scale consistency
Visual SLAM
Pseudo-RGBD SLAM
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

International Journal of Computer Vision cover
International Journal of Computer Vision
IF:
9.3
Papers:
3.9K
Citations:
2.8W

Organization

U
University of Adelaide
Scholars:
2.3W
Papers: 2.4W
Citations: 4.2W
A
agency for science technology & research (a*star)
Scholars:
2.2W
Papers: 1.9W
Citations: 57
N
nankai university
Scholars:
4.8W
Papers: 3.3W
Citations: 74
researcher View more organizations
Cited Papers

Cited Papers

Gas Hydrate System Offshore Chile
err2021-01-30
err0
errOAAI
errIvan Vargas-Cordero; Michela Giustiniani; Umberta Tinivella; Lucia Villar-Muñoz; Giulia Alessandrini
errShare
errSave
Dietary Menhaden Oil Contributes to Hepatic Lipidosis in Laying Hens
err1994-05-01
err0
errOAAI
errM.E. VAN ELSWYK; B.M. HARGIS; J.D. WILLIAMS; P.S. HARGIS
errShare
errSave
Microperimetric Assessment after Epiretinal Membrane Surgery: 4-Year Follow-Up
err2016-01-01
err0
errOAAI
errMarco Dal Vecchio; Carlo Lavia; Marco Nassisi; Federico M. Grignolo; Antonio M. Fea
errShare
errSave
Isolation and experimental infection with Vibrio alginolyticus in the sea horse, Hippocampus reidi Ginsburg, 1933 (Osteichthyes: Syngnathidae) in Brazil
err2010-02-01
err0
errOAAI
errML. Martins; JLP. Mouriño; GF. Fezer; CC. Buglione Neto; P. Garcia; BC. Silva; A. Jatobá; FN. Vieira
errShare
errSave
Consistent Video Depth Estimation
err2020-08-12
err196
errOAAI
errLuo, Xuan; Huang, Jia-Bin; Szeliski, Richard; Matzen, Kevin; Kopf, Johannes
errShare
errSave
researcher View more