arrow
Return

Deep learning integral imaging for three-dimensional visualization, object detection, and segmentation

delete2021-11-01
delete12
delete
OA
AI
F
Faliu Yi
O
Ongee Jeong
I
Inkyu Moon *
B
Bahram Javidi
DOI:10.1016/j.optlaseng.2021.106695delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
A depth slice image that is computationally reconstructed from an integral imaging system consists of focused and out of focus areas. The unfocused areas affect three-dimensional (3D) image analyses and visualization including 3D object detection, extraction, and tracking. In this work, we present a deep learning integral imaging system that can reconstruct a 3D image without the out of focus areas and can accomplish target detection and segmentation at the same time. A Mask-Regional Convolutional Neural Network (Mask-RCNN) deep learning algorithm was trained using a public dataset and applied to detect and segment multiple targets in two-dimensional (2D) elemental images in the integral imaging system. The 3D images were then reconstructed using segmented elemental images with the target detected. The proposed method works well in the presence of partial occlusions. Experimental results show the performance of the proposed scheme.
Keywords:
3D integral imaging
3D image reconstruction
Target visualization
Instance segmentation
Convolutional neural networks
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Optics and Lasers in Engineering cover
Optics and Lasers in Engineering
IF:
3.7
Papers:
7.1K
Citations:
1.7W

Organization

U
University of Connecticut
Scholars:
2.4W
Papers: 2.2W
Citations: 2.5W