arrow
Return

Single-pixel imaging using physics enhanced deep learning

delete2021-12-13
delete107
PRE
AI
王飞 (Fei Wang)
C
Chenglong Wang
C
Chenjin Deng
S
Shensheng Han
G
Guohai Situ *
DOI:10.1364/PRJ.440123delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Single-pixel imaging (SPI) is a typical computational imaging modality that allows two- and three-dimensional image reconstruction from a one-dimensional bucket signal acquired under structured illumination. It is in particular of interest for imaging under low light conditions and in spectral regions where good cameras are unavailable. However, the resolution of the reconstructed image in SPI is strongly dependent on the number of measurements in the temporal domain. Data-driven deep learning has been proposed for high-quality image reconstruction from a undersampled bucket signal. But the generalization issue prohibits its practical application. Here we propose a physics-enhanced deep learning approach for SPI. By blending a physics-informed layer and a model-driven fine-tuning process, we show that the proposed approach is generalizable for image reconstruction. We implement the proposed method in an in-house SPI system and an outdoor single-pixel LiDAR system, and demonstrate that it outperforms some other widespread SPI algorithms in terms of both robustness and fidelity. The proposed method establishes a bridge between data-driven and model-driven algorithms, allowing one to impose both data and physics priors for inverse problem solvers in computational imaging, ranging from remote sensing to microscopy. (C) 2021 Chinese Laser Press

Journal

Photonics Research cover
Photonics Research
IF:
7.2
Papers:
2.4K
Citations:
1.3W

Organization

C
chinese academy of sciences
Scholars:
56.0W
Papers: 44.8W
Citations: 704