arrow
返回

Self-supervised learning of monocular depth using quantized networks

delete2022-06-01
delete3
PRE
AI
K
Keyu Lu *
C
Chengyi Zeng
Y
Yonghu Zeng
DOI:10.1016/j.neucom.2021.11.071delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Learning monocular depth in a self-supervised manner is desirable for numerous applications ranging from autonomous driving, robotics to augmented reality. However, the current challenges lie in the problems of scale ambiguity, dynamic scene and hardware limitations. To this end, a self-supervised approach is proposed in this work for monocular depth learning and estimation. Specifically, we first introduce a self-supervised depth learning framework that learns a part of the camera intrinsics and the stereo extrinsics, which ensures the absoluteness of the predicted depth while achieving enhanced performance (i.e., lower error between the predicted depth and the ground-truth) on depth estimation. Besides, we further improve the accuracy and the efficiency (i.e., shorter inference time and lower weight/activation footprints) via a specially-designed network that exploits multi-scale context across multi-level feature maps. In addition, we propose a quantization scheme for our depth estimation networks. The scheme allows the network inference to be carried out using INT4-INT8 arithmetic while keeping a high performance on depth estimation. Extensive experiments on KITTI and Make3D datasets demonstrate that our approach substantially boosts the performance compared to the existing state-of-the-art methods on monocular depth estimation. (C) 2021 Elsevier B.V. All rights reserved.
Keyword:
Monocular depth estimation
Absolute scale
Self-supervised learning
Quantized depth networks

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

N
national university of defense technology - china
学者数:
1.8W
论文数: 1.4W
被引数: 9
引用论文

引用论文

Robot teaching by teleoperation based on visual interaction and extreme learning machine
err2018-01-01
err38
PREAI
errXu, Yang; Yang, Chenguang; Zhong, Junpei; Wang, Ning; Zhao, Lijun
err分享
err收藏
ImageNet Large Scale Visual Recognition ChallengeImageNet大规模视觉识别挑战
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
err分享
err收藏
没有更多内容