arrow
返回

Finite Aperture Stereo

delete2022-09-13
delete0
delete
OA
AI
M
Matthew Bailey *
A
Adrian Hilton
J
Jean‐Yves Guillemaut
DOI:10.1007/s11263-022-01658-wdelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Multi-view stereo remains a popular choice when recovering 3D geometry, despite performance varying dramatically according to the scene content. Moreover, typical pinhole camera assumptions fail in the presence of shallow depth of field inherent to macro-scale scenes; limiting application to larger scenes with diffuse reflectance. However, the presence of defocus blur can itself be considered a useful reconstruction cue, particularly in the presence of view-dependent materials. With this in mind, we explore the complimentary nature of stereo and defocus cues in the context of multi-view 3D reconstruction; and propose a complete pipeline for scene modelling from a finite aperature camera that encompasses image formation, camera calibration and reconstruction stages. As part of our evaluation, an ablation study reveals how each cue contributes to the higher performance observed over a range of complex materials and geometries. Though of lesser concern with large apertures, the effects of image noise are also considered. By introducing pre-trained deep feature extraction into our cost function, we show a step improvement over per-pixel comparisons; as well as verify the cross-domain applicability of networks using largely in-focus training data applied to defocused images. Finally, we compare to a number of modern multi-view stereo methods, and demonstrate how the use of both cues leads to a significant increase in performance across several synthetic and real datasets.
Keyword:
3D reconstruction
Depth from defocus
Multi-view stereo

期刊

International Journal of Computer Vision 封面图
International Journal of Computer Vision
IF:
9.3
论文数:
3.9K
被引数:
2.8W

机构

U
University of Surrey
学者数:
1.2W
论文数: 1.3W
被引数: 22
引用论文

引用论文

Detail-Preserving and Content-Aware Variational Multi-View Stereo Reconstruction
err2016-02-01
err43
errOAAI
errLi, Zhaoxin; Wang, Kuanquan; Zuo, Wangmeng; Meng, Deyu; Zhang, Lei
err分享
err收藏
Confocal Stereo
err2008-09-10
err50
PREAI
errHasinoff, Samuel W.; Kutulakos, Kiriakos N.
err分享
err收藏
err分享
err收藏
Neural grafting to ischemic lesions of the adult rat hippocampus
err1989-02-01
err0
PREAI
errN. T�nder; T. S�rensen; J. Zimmer; M.B. J�rgensen; F.F. Johansen; N.H. Diemer
err分享
err收藏
Coordinate induction of hepatic fatty acyl-CoA oxidase and P4504A1 in rat after activation of the peroxisome proliferator-activated receptor (PPAR) by sulphur-substituted fatty acid analogues
err2009-08-27
err0
PREAI
errA. Demoz; H. Vaagenes; N. Aarsaether; E. Hvattum; J. Skorve; M. Gottlicher; J. R. Lillehaug; G. G. Gibson; J.-å. Gustafsson; S. Hood; R. K. Berge
err分享
err收藏
A Test Strip for Diamines in Tuna
err2020-01-14
err0
errOAAI
errMargot Hall; Paul A Sykes; Diane L Fairclough; Leonard J Lucchese; Patricia Rogers; Walter Staruszkiewicz; Robert C Bateman
err分享
err收藏
Depression, Anxiety and Stress Among Indians in Times of Covid-19 Lockdown
err2020-06-23
err0
errOAAI
errUsama Rehman; Mohammad G. Shahnawaz; Neda H. Khan; Korsi D. Kharshiing; Masrat Khursheed; Kaveri Gupta; Drishti Kashyap; Ritika Uniyal
err分享
err收藏
学者 查看更多内容