arrow
Return

Light Field Rectification Based on Relative Pose Estimation

delete2024-01-01
delete2
delete
OA
AI
X
Xiao Huo
D
Dongyang Jin
S
Saiping Zhang
F
Fuzheng Yang *
DOI:10.1109/TIM.2023.3328070delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Hand-held light field (LF) cameras have unique advantages in computer vision such as 3-D scene reconstruction and depth estimation. However, the related applications are limited by the ultra-small baseline, leading to the extremely low depth resolution in reconstruction. To solve this problem, we propose to rectify LF to obtain a large baseline. Specifically, the proposed method aligns two LFs captured by two hand-held LF cameras with a random relative pose, and extracts the corresponding row-aligned subaperture images (SAIs) to obtain an LF with a large baseline. For an accurate rectification, a method for pose estimation is also proposed, where the relative rotation and translation between the two LF cameras are estimated. The proposed pose estimation minimizes the degree of freedom (DoF) in the LF-point-LF-point correspondence model and explicitly solves this model in a linear way. The proposed pose estimation outperforms the state-of-the-art algorithms by providing more accurate results to support rectification. The row-aligned SAIs and significantly improved depth resolution in 3-D reconstruction demonstrate the effectiveness of the proposed LF rectification.
Keywords:
Cameras
Pose estimation
Three-dimensional displays
Solid modeling
Light fields
Feature extraction
Image reconstruction
Baseline
depth estimation
light field (LF) cameras
LF rectification
relative pose estimation

Journal

IEEE Transactions on Instrumentation and Measurement cover
IEEE Transactions on Instrumentation and Measurement
IF:
5.9
Papers:
1.9W
Citations:
5.8W

Organization

X
Xidian University
Scholars:
2.4W
Papers: 1.9W
Citations: 9.7K
G
Guilin University of Electronic Technology
Scholars:
7.4K
Papers: 5.2K
Citations: 5.4K