arrow
Return

Deep Depth from Focal Stack with Defocus Model for Camera-Setting Invariance

delete2023-12-27
delete0
delete
OA
AI
Y
Yuki Fujimura *
M
Masaaki Iiyama
T
Takuya Funatomi
Y
Yasuhiro Mukaigawa
DOI:10.1007/s11263-023-01964-xdelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We propose deep depth from focal stack (DDFS), which takes a focal stack as input of a neural network for estimating scene depth. Defocus blur is a useful cue for depth estimation. However, the size of the blur depends on not only scene depth but also camera settings such as focus distance, focal length, and f-number. Current learning-based methods without any defocus models cannot estimate a correct depth map if camera settings are different at training and test times. Our method takes a plane sweep volume as input for the constraint between scene depth, defocus images, and camera settings, and this intermediate representation enables depth estimation with different camera settings at training and test times. This camera-setting invariance can enhance the applicability of DDFS. The experimental results also indicate that our method is robust against a synthetic-to-real domain gap.
Keywords:
Depth from focus/defocus
Deep learning
Focal stack
Cost volume

Journal

International Journal of Computer Vision cover
International Journal of Computer Vision
IF:
9.3
Papers:
3.9K
Citations:
2.8W

Organization

N
nara institute of science & technology
Scholars:
4.1K
Papers: 3.1K
Citations: 7
Shiga University cover
Shiga University
Scholars:
340
Papers: 341
Citations: 233