arrow
返回

DepthCut: improved depth edge estimation using multiple unreliable channels

delete2018-05-12
delete4
delete
OA
AI
P
Paul Guerrero *
H
Holger Winnemöller
W
Wilmot Li
N
Niloy J. Mitra
DOI:10.1007/s00371-018-1551-5delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
In the context of scene understanding, a variety of methods exists to estimate different information channels from mono or stereo images, including disparity, depth, and normals. Although several advances have been reported in the recent years for these tasks, the estimated information is often imprecise particularly near depth discontinuities or creases. Studies have however shown that precisely such depth edges carry critical cues for the perception of shape, and play important roles in tasks like depth-based segmentation or foreground selection. Unfortunately, the currently extracted channels often carry conflicting signals, making it difficult for subsequent applications to effectively use them. In this paper, we focus on the problem of obtaining high-precision depth edges (i.e., depth contours and creases) by jointly analyzing such unreliable information channels. We propose DepthCut, a data-driven fusion of the channels using a convolutional neural network trained on a large dataset with known depth. The resulting depth edges can be used for segmentation, decomposing a scene into depth layers with relatively flat depth, or improving the accuracy of the depth estimate near depth edges by constraining its gradients to agree with these edges. Quantitatively, we compare against 18 variants of baselines and demonstrate that our depth edges result in an improved segmentation performance and an improved depth estimate near depth edges compared to data-agnostic channel fusion. Qualitatively, we demonstrate that the depth edges result in superior segmentation and depth orderings. (Code and datasets will be made available.).
Keyword:
Depth estimation
Monocular
Stereo
Deep learning
Depth layering
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Visual Computer 封面图
Visual Computer
IF:
2.9
论文数:
4.6K
被引数:
6.5K

机构

U
University College London
学者数:
7.9W
论文数: 6.2W
被引数: 15.7W
U
university of london
学者数:
21.5W
论文数: 19.7W
被引数: 305
引用论文

引用论文

Retromer localizes to autophagosomes during HCV replication
err2017-04-13
err0
errOAAI
errPeiqi Yin; Zhi Hong; Leiliang Zhang; Youyang Ke
err分享
err收藏
Local Layering
err2009-07-27
err26
PREAI
errMcCann, James; Pollard, Nancy
err分享
err收藏
Prevalence of prostate adenocarcinoma according to race in an university hospital
err2003-08-01
err0
errOAAI
errMilton S Barros; Venceslau R.S Silva; Gladston B Santos; Alexandre Hughes; Marco A Silveira
err分享
err收藏
err分享
err收藏
Molecular Basis of Filamin A-FilGAP Interaction and Its Impairment in Congenital Disorders Associated with Filamin A Mutations
err2009-03-18
err0
errOAAI
errFumihiko Nakamura; Outi Heikkinen; Olli T. Pentikäinen; Teresia M. Osborn; Karen E. Kasza; David A. Weitz; Olga Kupiainen; Perttu Permi; Ilkka Kilpeläinen; Jari Ylänne; John H. Hartwig; Thomas P. Stossel
err分享
err收藏
Multiferroicity in the YFeO3 crystal
err2019-08-22
err0
PREAI
errMingyu Shang; Haochuan Liu; Lin Zhang; Fengyue Sun; Hongming Yuan; Chao Zhao
err分享
err收藏
学者 查看更多内容