arrow
返回

SENSE: Self-Evolving Learning for Self-Supervised Monocular Depth Estimation

delete2024-01-01
delete1
PRE
AI
G
Guanbin Li
R
Ricong Huang
H
Haofeng Li *
Z
Zunzhi You
W
Weikai Chen
DOI:10.1109/TIP.2023.3338053delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Self-supervised depth estimation methods can achieve competitive performance using only unlabeled monocular videos, but they suffer from the uncertainty of jointly learning depth and pose without any ground truths of both tasks. Supervised framework provides robust and superior performance but is limited by the scope of the labeled data. In this paper, we introduce SENSE, a novel learning paradigm for self-supervised monocular depth estimation that progressively evolves the prediction result using supervised learning, but without requiring labeled data. The key contribution of our approach stems from the novel use of the pseudo labels - the noisy depth estimation from the self-supervised methods. We surprisingly find that a fully supervised depth estimation network trained using the pseudo labels can produce even better results than its ground truth. To push the envelope further, we then evolve the self-supervised backbone by replacing its depth estimation branch with that fully supervised network. Based on this idea, we devise a comprehensive training pipeline that alternatively enhances the two key branches (depth and pose estimation) of the self-supervised backbone network. Our proposed approach can effectively ease the difficulty of multi-task training in self-supervised depth estimation. Experimental results have shown that our proposed approach achieves state-of-the-art results on the KITTI dataset.
Keyword:
Self-supervised
monocular depth estimation
pseudo labels
learning paradigm

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

S
Sun Yat Sen University
学者数:
9.9W
论文数: 7.2W
被引数: 95
T
The Chinese University of Hong Kong, Shenzhen
学者数:
4.3K
论文数: 4.0K
被引数: 7
S
Shenzhen Research Institute of Big Data
学者数:
256
论文数: 352
被引数: 357
学者 查看更多机构
引用论文

引用论文

Gas Hydrate System Offshore Chile
err2021-01-30
err0
errOAAI
errIvan Vargas-Cordero; Michela Giustiniani; Umberta Tinivella; Lucia Villar-Muñoz; Giulia Alessandrini
err分享
err收藏
Variability Associated with Sampling, Sample Preparation, and Chemical Testing for Aflatoxin in Farmers' Stock Peanuts
err2020-01-14
err0
errOAAI
errThomas B Whitaker; Floyd E Dowell; Winston M Hagler; Francis G Giesbrecht; Jeremy Wu
err分享
err收藏
Multiple Sclerosis: Epidemiology, Genetics, Symptoms, and Unmet Needs
err2019-06-28
err0
PREAI
errIrene Moreno-Torres; Julia Sabín-Muñoz; Antonio García-Merino
err分享
err收藏
MRI findings in people with epilepsy and nodding syndrome in an area endemic for onchocerciasis: An observational study
err2013-09-05
err0
errOAAI
errAS Winkler; K Friedrich; S Velicheti; J Dharsee; R König; L Jilek-Aall; A Nassri; M Meindl; A Kidunda; TH Müller; W Matuja; T Gotwald; E Schmutzhard
err分享
err收藏
err分享
err收藏
Altered control of self-reactive IgG by autologous IgM in patients with warm autoimmune hemolytic anemia
err2000-01-01
err0
PREAI
errDorothea Stahl; Sébastien Lacroix-Desmazes; Didier Heudes; Luc Mouthon; Srini V. Kaveri; Michel D. Kazatchkine
err分享
err收藏
Synthesis of Novel Ag Modified MCM-41 Mesoporous Molecular Sieve and Beta Zeolite Catalysts for Ozone Decomposition at Ambient Temperature
err2004-10-01
err0
PREAI
errNarendra Kumar; Petya M. Konova; Anton Naydenov; Teemu Heikill�; Tapio Salmi; Dmitry Yu. Murzin
err分享
err收藏
err分享
err收藏
Ontop-spatial: Ontop of geospatial databases
err2019-10-01
err0
PREAI
errKonstantina Bereta; Guohui Xiao; Manolis Koubarakis
err分享
err收藏
学者 查看更多内容