arrow
Return

Learned Collaborative Stereo Refinement

delete2021-06-20
delete2
delete
OA
AI
P
Patrick Knöbelreiter *
T
Thomas Pock
DOI:10.1007/s11263-021-01485-5delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
In this work, we propose a learning-based method to denoise and refine disparity maps. The proposed variational network arises naturally from unrolling the iterates of a proximal gradient method applied to a variational energy defined in a joint disparity, color, and confidence image space. Our method allows to learn a robust collaborative regularizer leveraging the joint statistics of the color image, the confidence map and the disparity map. Due to the variational structure of our method, the individual steps can be easily visualized, thus enabling interpretability of the method. We can therefore provide interesting insights into how our method refines and denoises disparity maps. To this end, we can visualize and interpret the learned filters and activation functions and prove the increased reliability of the predicted pixel-wise confidence maps. Furthermore, the optimization based structure of our refinement module allows us to compute eigen disparity maps, which reveal structural properties of our refinement module. The efficiency of our method is demonstrated on the publicly available stereo benchmarks Middlebury 2014 and Kitti 2015.
Keywords:
Stereo
Refinement
Deep learning
Optimization
Interpretable AI
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

International Journal of Computer Vision cover
International Journal of Computer Vision
IF:
9.3
Papers:
3.9K
Citations:
2.8W

Organization

G
Graz University of Technology
Scholars:
6.7K
Papers: 6.3K
Citations: 8.5K
Cited Papers

Cited Papers

errShare
errSave
Retromer localizes to autophagosomes during HCV replication
err2017-04-13
err0
errOAAI
errPeiqi Yin; Zhi Hong; Leiliang Zhang; Youyang Ke
errShare
errSave
Neural and behavioral effects of early eye rotation on the optokinetic system in the wallaby, Macropus eugenii
err1995-02-01
err0
PREAI
errK. P. Hoffmann; C. Distler; R. F. Mark; L. R. Marotte; G. H. Henry; M. R. Ibbotson
errShare
errSave
researcher View more