arrow
Return

Data-Driven Variable Synthetic Aperture Imaging Based on Semantic Feedback

delete2019-01-01
delete0
delete
OA
AI
李聪聪 (Congcong Li)
J
Jing Li *
Y
Yanran Dai
T
Tao Yang
Y
Yuguang Xie
Z
Zhaoyang Lu
DOI:10.1109/ACCESS.2019.2953560delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Synthetic aperture imaging, which has been proved to be an effective approach for occluded object imaging, is one of the challenging problems in the field of computational imaging. Currently most of the related researches focus on fixed synthetic aperture which usually accompanies with mixed observation angle and foreground de-focus blur. But the existence of them is frequently a source of perspective effect decrease and occluded object imaging quality degradation. In order to solve this problem, we propose a novel data-driven variable synthetic aperture imaging based on semantic feedback. The semantic content we concerned for better de-occluded imaging is the foreground occlusions rather than the whole scene. Therefore, unlike other methods worked on pixel-level, we start from semantic layer and present a semantic labeling method based on feedback. Semantic labeling map deeply mines visual data in synthetic image and preserves the semantic information of foreground occluder. On the basis of semantic feedback strategy, semantic labeling map will conversely pass to synthetic imaging process. The proposed data-driven variable synthetic aperture imaging contains two levels: one is adaptive changeable imaging aperture driven by synthetic depth and perspective angle, the other is light ray screening driven by visual information in semantic labeling map. On this basis, the hybrid camera view and superimposition of foreground occlusion can be removed. Evaluations on several complex indoor scenes and real outdoor environments demonstrate the superiority and robustness performance of our proposed approach.
Keywords:
Synthetic aperture imaging
data-driven variable synthetic aperture
semantic feedback imaging
multi-camera array
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

N
Northwestern Polytechnical University
Scholars:
4.6W
Papers: 3.7W
Citations: 5.3W
X
Xidian University
Scholars:
2.4W
Papers: 1.9W
Citations: 9.7K