.png){kind=icon}
返回
High-resolution single-photon imaging with physics-informed deep learning
.png){kind=icon}
OA
AI
DOI：10.1038/s41467-023-41597-9.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
High-resolution single-photon imaging remains a big challenge due to the complex hardware manufacturing craft and noise disturbances. Here, we introduce deep learning into SPAD, enabling super-resolution single-photon imaging with enhancement of bit depth and imaging quality. We first studied the complex photon flow model of SPAD electronics to accurately characterize multiple physical noise sources, and collected a real SPAD image dataset (64 x 32 pixels, 90 scenes, 10 different bit depths, 3 different illumination flux, 2790 images in total) to calibrate noise model parameters. With this physical noise model, we synthesized a large-scale realistic single-photon image dataset (image pairs of 5 different resolutions with maximum megapixels, 17250 scenes, 10 different bit depths, 3 different illumination flux, 2.6 million images in total) for subsequent network training. To tackle the severe super-resolution challenge of SPAD inputs with low bit depth, low resolution, and heavy noise, we further built a deep transformer network with a content-adaptive self-attention mechanism and gated fusion modules, which can dig global contextual features to remove multi-source noise and extract full-frequency details. We applied the technique in a series of experiments including microfluidic inspection, Fourier ptychography, and high-speed imaging. The experiments validate the technique's state-of-the-art super-resolution SPAD imaging performance. High-resolution single-photon imaging is challenging due to complex hardware and noise disturbances. Here, the authors realise simultaneous single-photon denoising and super-resolution enhancement by physics-informed deep learning, with a physical multi-source noise model, two single-photon image datasets, and a deep transformer network.
Keyword:
ROOM-TEMPERATURE
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
15.7
论文数:
9.4W
被引数:
91.2W
机构
引用论文
Inflexibility of mental planning: A characteristic disorder with prefrontal lobe lesions?心理计划的僵化: 前额叶病变的特征性障碍？
PREAI
分享收藏A robust and versatile platform for image scanning microscopy enabling super-resolution FLIM用于图像扫描显微镜的强大且多功能的平台，可实现超分辨率FLIM.png)
NATURE METHODS
OAAI
NATURE METHODSIF32.1
OAAI分享收藏Approaching coupled cluster accuracy with a general-purpose neural network potential through transfer learning通过迁移学习接近具有通用神经网络潜力的耦合聚类精度NATURE COMMUNICATIONSOAAI
NATURE COMMUNICATIONSIF15.7
OAAI分享收藏On the experimental verification of quantum complexity in linear optics关于线性光学中量子复杂性的实验验证NATURE PHOTONICSOAAI
NATURE PHOTONICSIF32.9
OAAI分享收藏
查看更多内容