.png){kind=icon}
返回
Learning Time-multiplexed phase-coded apertures for snapshot spectral-depth imaging
.png){kind=icon}
OA
AI
DOI：10.1364/OE.501096.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Depth and spectral imaging are essential technologies for a myriad of applications but have been conventionally studied as individual problems. Recent efforts have been made to optically encode spectral-depth (SD) information jointly in a single image sensor measurement, subsequently decoded by a computational algorithm. The performance of single snapshot SD imaging systems mainly depends on the optical modulation function, referred to as codification, and the computational methods used to recover the SD information from the coded measurement. The optical modulation has been conventionally realized using coded apertures (CAs), phase masks, prisms or gratings, active illumination, and many others. In this work, we propose an optical modulation (codification) strategy that employs a color-coded aperture (CCA) in conjunction with a time-varying phase-coded aperture and a spatially-varying pixel shutter, thus yielding an effective time-multiplexed coded aperture (TMCA). We show that the proposed TMCA entails a spatially-variant point spread function (PSF) for a constant depth in a scene, which, in turn, facilitates the distinguishability, and therefore, better recovery of the depth information. Further, the selective filtering of specific spectral bands by the CCA encodes relevant spectral information that is disentangled using a reconstruction algorithm. We leverage the advances of deep learning techniques to jointly learn the optical modulation and the computational decoding algorithm in an end-to-end (E2E) framework. We demonstrate via simulations and with a real testbed prototype that the proposed TMCA strategy outperforms state-of-the-art snapshot SD imaging alternatives in both spectral and depth reconstruction quality.
期刊
IF:
3.3
论文数:
6.1W
被引数:
14.3W
机构
引用论文
.png){kind=icon}
分享收藏Supramolecular Approaches for Taming the Chemo- and Regiochemistry of C60 Addition Reactions驯服C60加成反应的化学和区域化学的超分子方法
OAAI
OAAI分享收藏End-to-end Optimization of Optics and Image Processing for Achromatic Extended Depth of Field and Super-resolution Imaging用于消色差扩展景深和超分辨率成像的光学和图像处理的端到端优化OAAI
OAAI分享收藏HyperReconNet: Joint Coded Aperture Optimization and Image Reconstruction for Compressive Hyperspectral ImagingHyperReconNet: 用于压缩高光谱成像的联合编码孔径优化和图像重建
PREAI
分享收藏
查看更多内容