Large model enhanced computational ghost imaging

Yifan Chen

doi:10.1007/s11431-025-3062-3

Large model enhanced computational ghost imaging

2025-10-27

0

PRE

AI

DOI：10.1007/s11431-025-3062-3

Original

Original request for help

Save

Abstract

En 中文

Ghost imaging (GI) enables 2D image reconstruction by leveraging high-order correlation between 1D bucket signals and 2D light field information. It demonstrates enhanced detection sensitivity and high-quality image reconstruction via efficient photon collection in scattering media. Recent studies have established that deep learning (DL) can substantially enhance the GI reconstruction quality. Furthermore, with the emergence of large models such as SDXL and GPT-4, the constraints of conventional DL in parameters and architecture have been transcended, enabling models to comprehensively explore relationships among all distinct positions within feature sequences. This paradigm shift has significantly advanced the capability of DL in restoring severely degraded and low-resolution imagery, making it particularly advantageous for noise-robust image reconstruction in GI applications. In this paper, we propose the first large imaging model with 1.4 billion parameters that incorporates the physical principles of GI (GILM). The proposed GILM implements a skip connection mechanism to mitigate gradient explosion challenges inherent in deep architectures, ensuring sufficient parametric capacity to capture intricate correlations between single-pixel measurements and the object. Moreover, GILM leverages multi-head attention mechanism to learn spatial dependencies across pixel points during image reconstruction, facilitating the extraction of comprehensive object information for subsequent reconstruction. We validated the effectiveness of GILM through a series of experiments, including simulated object imaging, imaging objects in free space, and imaging objects located 52 m away in an underwater environment. The experimental results demonstrate that GILM effectively captures the fluctuation trends of the collected signals, thereby facilitating accurate reconstruction of the object's image from the acquired data. Finally, GILM was successfully deployed on a portable computing platform, demonstrating its feasibility for practical engineering applications.

Keywords:

computational ghost imaging

large model

speckle pattern

Large model enhanced computational ghost imaging

Abstract

Journal

Organization

Cited Papers