arrow
返回

Learning Joint Intensity-Depth Sparse Representations

delete2014-05-01
delete38
delete
OA
AI
I
Ivana Tošić *
S
Sarah Drewes
DOI:10.1109/TIP.2014.2312645delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This paper presents a method for learning overcomplete dictionaries of atoms composed of two modalities that describe a 3D scene: 1) image intensity and 2) scene depth. We propose a novel joint basis pursuit (JBP) algorithm that finds related sparse features in two modalities using conic programming and we integrate it into a two-step dictionary learning algorithm. The JBP differs from related convex algorithms because it finds joint sparsity models with different atoms and different coefficient values for intensity and depth. This is crucial for recovering generative models where the same sparse underlying causes (3D features) give rise to different signals (intensity and depth). We give a bound for recovery error of sparse coefficients obtained by JBP, and show numerically that JBP is superior to the group lasso algorithm. When applied to the Middlebury depth-intensity database, our learning algorithm converges to a set of related features, such as pairs of depth and intensity edges or image textures and depth slants. Finally, we show that JBP outperforms state of the art methods on depth inpainting for time-of-flight and Microsoft Kinect 3D data.
Keyword:
Sparse approximations
dictionary learning
hybrid image-depth sensors

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

U
University of California Berkeley
学者数:
3.5W
论文数: 2.8W
被引数: 11.3W
University of California System 封面图
University of California System
学者数:
37.7W
论文数: 33.8W
被引数: 6.6K
引用论文

引用论文

Increasing expertise to a novel script modulates the visual N1 ERP in healthy adults
err2017-09-18
err0
PREAI
errSilvia Brem; Eliane Hunkeler; Markus Mächler; Jens Kronschnabel; Iliana Irini Karipidis; Georgette Pleisch; Daniel Brandeis
err分享
err收藏
err分享
err收藏
学者 查看更多内容