.png){kind=icon}
返回
Deep Optical Coding Design in Computational Imaging: A data-driven framework
.png){kind=icon}
OA
AI
DOI：10.1109/MSP.2022.3200173.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Computational optical imaging (COI) systems leverage optical coding elements (CEs) in their setups to encode a high-dimensional scene in a single or in multiple snapshots and decode it by using computational algorithms. The performance of COI systems highly depends on the design of its main components: the CE pattern and the computational method used to perform a given task. Conventional approaches rely on random patterns or analytical designs to set distribution of the CE. However, the available data and algorithm capabilities of deep neural networks (DNNs) have opened a new horizon in CE data-driven designs that jointly consider the optical and computational decoders. Specifically, by modeling the COI measurements through a fully differentiable image-formation model that considers the physics-based propagation of light and its interaction with the CEs, the parameters that define the CE and the computational decoder can be optimized in an end-to-end (E2E) manner. Moreover, by optimizing just CEs in the same framework, inference tasks can be performed from pure optics. This work surveys the recent advances in CE data-driven design and provides guidelines on how to parameterize different optical elements to include them in the E2E framework. As the E2E framework can handle different inference applications by changing the loss function and the DNN, we present low-level tasks such as spectral imaging reconstruction or high-level tasks such as pose estimation with privacy preservation enhanced by using optimal task-based optical architectures. Finally, we illustrate classification and 3D object-recognition applications performed at the speed of the light using all-optics DNNs.
Keyword:
Privacy
Three-dimensional displays
Optical design
Computational modeling
Signal processing algorithms
Optical imaging
Encoding
期刊
IF:
9.6
论文数:
1.1W
被引数:
1.7W
机构
引用论文
Optimal biologic dose of metronomic chemotherapy regimens is associated with maximum antiangiogenic activity.png)
Blood
OAAI
BloodIF0
OAAI分享收藏End-to-end Optimization of Optics and Image Processing for Achromatic Extended Depth of Field and Super-resolution Imaging用于消色差扩展景深和超分辨率成像的光学和图像处理的端到端优化OAAI
OAAI分享收藏分享收藏
查看更多内容