arrow
Return

Unsupervised Monocular Depth Estimation Using Attention and Multi-Warp Reconstruction

delete2022-01-01
delete25
PRE
AI
C
Chuanwu Ling
X
Xiaogang Zhang *
陈华 cover
陈华 (Hua Chen)
DOI:10.1109/TMM.2021.3091308delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Monocular depth estimation has become one of the most studied topics in computer vision. Most approaches treat depth prediction as a fully supervised regression problem requiring vast amounts of corresponding ground-truth depth and image pairs for training. Unsupervised monocular depth estimation has emerged as a promising alternative that eliminates dataset limitations. This paper proposes an end-to-end unsupervised deep learning framework integrating attention blocks and multi-warp loss for monocular depth estimation. In this framework, to explore more general contextual information among the feature volumes, an attention block that sequentially refines the feature maps along the channel and spatial dimensions is inserted after the first and last stages of the network encoder. Additionally, to further utilize the errors in the original disparity estimation from the network, a novel multi-warp reconstruction strategy is designed for the loss function. The experimental results evaluated on the KITTI, CityScapes and Make3D datasets demonstrate the state-of-the-art performance and satisfactory generalization ability of our proposed method.
Keywords:
Estimation
Image reconstruction
Convolution
Task analysis
Training
Videos
Unsupervised learning
Monocular depth estimation
unsupervised
attention
multi-Warp reconstruction

Journal

IEEE Transactions on Multimedia cover
IEEE Transactions on Multimedia
IF:
9.7
Papers:
4.5K
Citations:
2.4W

Organization

H
hunan university
Scholars:
4.5W
Papers: 3.3W
Citations: 70