.png){kind=icon}
返回
Seeing Through Obstructions with Diffractive Cloaking
.png){kind=icon}
OA
AI
DOI：10.1145/3528223.3530185.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Unwanted camera obstruction can severely degrade captured images, including both scene occluders near the camera and partial occlusions of the camera cover glass. Such occlusions can cause catastrophic failures for various scene understanding tasks such as semantic segmentation, object detection, and depth estimation. Existing camera arrays capture multiple redundant views of a scene to see around thin occlusions. Such multi-camera systems effectively form a large synthetic aperture, which can suppress nearby occluders with a large defocus blur, but significantly increase the overall form factor of the imaging setup. In this work, we propose a monocular single-shot imaging approach that optically cloaks obstructions by emulating a large array. Instead of relying on different camera views, we learn a diffractive optical element (DOE) that performs depth-dependent optical encoding, scattering nearby occlusions while allowing paraxial wavefronts to be focused. We computationally reconstruct unobstructed images from these superposed measurements with a neural network that is trained jointly with the optical layer of the proposed imaging system. We assess the proposed method in simulation and with an experimental prototype, validating that the proposed computational camera is capable of recovering occluded scene information in the presence of severe camera obstruction.
Keyword:
Computational Imaging
End-to-End Optics Design
期刊
IF:
9.5
论文数:
4.8K
被引数:
3.6W
机构
引用论文
Single-Image Fence Removal Using Deep Convolutional Neural Network基于深度卷积神经网络的单幅图像栅栏去除.png)
IEEE ACCESS
OAAI
IEEE ACCESSIF3.6
OAAI分享收藏Differentiable Compound Optics and Processing Pipeline Optimization for End-to-end Camera Design用于端到端相机设计的可区分复合光学和处理管道优化
PREAI
分享收藏分享收藏Pressure-Based Bioassay Perceived by a Flexible Pressure Sensor with Synergistic Enhancement of the Photothermal Effect通过具有协同增强光热效应的柔性压力传感器感知的基于压力的生物测定
PREAI
分享收藏
查看更多内容