arrow
Return

Progressive Hard-Mining Network for Monocular Depth Estimation

delete2018-08-01
delete40
PRE
AI
Z
Zhenyu Zhang
徐春艳 cover
徐春艳 (Chunyan Xu)
J
Jian Yang *
J
Junbin Gao
崔振 (Zhen Cui)
DOI:10.1109/TIP.2018.2821979delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Depth estimation from the monocular RGB image is a challenging task for computer vision due to no reliable cues as the prior knowledge. Most existing monocular depth estimation works including various geometric or network learning methods lack of an effective mechanism to preserve the cross-border details of depth maps, which yet is very important for the performance promotion. In this paper, we propose a novel end-to-end progressive hard-mining network (PHN) framework to address this problem. Specifically, we construct the hard-mining objective function, the intra-scale and inter-scale refinement subnetworks to accurately localize and refine those hard-mining regions. The intra-scale refining block recursively recovers details of depth maps from different semantic features in the same receptive field while the inter-scale block favors a complementary interaction among multi-scale depth cues of different receptive fields. For further reducing the uncertainty of the network, we design a difficulty-ware refinement loss function to guide the depth learning process, which can adaptively focus on mining these hard-regions where accumulated errors easily occur. All three modules collaborate together to progressively reduce the error propagation in the depth learning process, and then, boost the performance of monocular depth estimation to some extent. We conduct comprehensive evaluations on several public benchmark data sets (including NYU Depth V2, KITTI, and Make3D). The experiment results well demonstrate the superiority of our proposed PHN framework over other state of the arts for monocular depth estimation task.
Keywords:
Monocular depth estimation
intra-scale and inter-scale refining
recursive learning
hard-mining network
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

U
University of Sydney
Scholars:
6.5W
Papers: 6.2W
Citations: 90
Cited Papers

Cited Papers

Seismic profiles of the offshore Gulf of Alaska Tertiary Province, R/V Thompson, Sept.-Oct. 1974
err1975-01-01
err0
errOAAI
errRoland E. von Huene; B. F. Molnia; T. R. Bruns; P. R. Carlson
errShare
errSave
Macrophage migration inhibitory factor (MIF): mechanisms of action and role in disease
err2002-04-01
err0
PREAI
errHongqi Lue; Robert Kleemann; Thierry Calandra; Thierry Roger; Jürgen Bernhagen
errShare
errSave
Psoriatic arthritis
err
IF0
err2023-10-31
err0
PREAI
errDafna D Gladman; Vinod Chandran
errShare
errSave
In Situ Detection of Inflammatory Cytokines and Apoptosis in Pemphigus Foliaceus Patients
err2009-01-01
err0
PREAI
errDenise Bertulucci Rocha Rodrigues; Sanivia Aparecida Lima Pereira; Marlene Antônia dos Reis; Sheila Jorge Adad; João Eduardo Caixeta; Angélica Maeda Chiba; RichardÁtila Sousa; ; Virmondes Rodrigues, Jr
errShare
errSave
Factors Influencing Speech Production in Elementary and High School-Aged Cochlear Implant Users
err2011-02-01
err0
errOAAI
errEmily A. Tobey; Ann E. Geers; Madhu Sundarrajan; Sujin Shin
errShare
errSave
researcher View more