arrow
Return

Photon-efficient camera with in-sensor computing

delete2025-04-03
delete2
delete
OA
AI
Y
Yanqiu Guan
H
Haochen Li
Y
Yi Zhang
Y
Yuchen Qiu
L
Labao Zhang *
季
季向阳 (Xiangyang Ji) *
王皓 cover
王皓 (Hao Wang)
Q
Qi Chen
L
Liang Ma
X
Xiaohan Wang
Z
Zhuolin Yang
X
Xuecou Tu
Q
Qingyuan Zhao
贾
贾小氢 (Xiaoqing Jia)
陈剑 cover
陈剑 (Jian Chen)
L
Lin Kang
P
Peiheng Wu
DOI:10.1038/s41467-025-58501-2delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Image sensors with internal computing capabilities fuse sensing and computing to significantly reduce the power consumption and latency of machine vision tasks. Linear photodetectors such as 2D semiconductors with tunable electrical and optical properties enable in-sensor computing for multiple functions. In-sensor computing at the single-photon level is much more plausible but has not yet been achieved. Here, we demonstrate a photon-efficient camera with in-sensor computing based on a superconducting nanowire array detector with four programmable dimensions including photon count rate, response time, pulse amplitude, and spectral responsivity. At the same time, the sensor features saturated (100%) quantum efficiency in the range of 405-1550 nm. Benefiting from the multidimensional modulation and ultra-high sensitivity, a classification accuracy of 92.22% for three letters is achieved with only 0.12 photons per pixel per pattern. Furthermore, image preprocessing and spectral classification are demonstrated. Photon-efficient in-sensor computing is beneficial for vision tasks in extremely low-light environments such as covert imaging, biological imaging and space exploration. The single-photon image sensor can be scaled up to construct more complex neural networks, enabling more complex real-time vision tasks with high sensitivity.
Keywords:
SINGLE
DETECTORS

Journal

Nature Communications cover
Nature Communications
IF:
15.7
Papers:
9.4W
Citations:
91.2W

Organization

H
Hefei Natl Lab
Scholars:
231
Papers: 126
Citations: 60
Cited Papers

Cited Papers

A Low-Power, Inductorless Wideband Cryogenic Amplifier for Superconducting Nanowire Single Photon Detector
err2019-09-01
err0
PREAI
errLong He; Lianming Li; Xiaokang Niu; Haiyang Xia; Min Xie; Xu Wu; Labao Zhang; Lin Kang; Zhigong Wang
errShare
errSave
Single-photon detection using high-temperature superconductors
err2023-03-20
err47
errOAAI
errCharaev, I.; Bandurin, D. A.; Bollinger, A. T.; Phinney, I. Y.; Drozdov, I.; Colangelo, M.; Butters, B. A.; Taniguchi, T.; Watanabe, K.; He, X.; Medeiros, O.; Bozovic, I.; Jarillo-Herrero, P.; Berggren, K. K.
errShare
errSave
Imaging with a small number of photons
err2015-01-05
err364
errOAAI
errMorris, Peter A.; Aspden, Reuben S.; Bell, Jessica E. C.; Boyd, Robert W.; Padgett, Miles J.
errShare
errSave
UV superconducting nanowire single-photon detectors with high efficiency, low noise, and 4 K operating temperature
err2017-10-18
err95
errOAAI
errWollman, E. E.; Verma, V. B.; Beyer, A. D.; Briggs, R. M.; Korzh, B.; Allmaras, J. P.; Marsili, F.; Lita, A. E.; Mirin, R. P.; Nam, S. W.; Shaw, M. D.
errShare
errSave
Geometric deep optical sensing
err2023-03-17
err0
PREAI
errShaofan Yuan; Chao Ma; Ethan Fetaya; Thomas Mueller; Doron Naveh; Fan Zhang; Fengnian Xia
errShare
errSave
Ultrafast machine vision with 2D material neural network image sensors
err2020-03-04
err0
PREAI
errLukas Mennel; Joanna Symonowicz; Stefan Wachter; Dmitry K. Polyushkin; Aday J. Molina-Mendoza; Thomas Mueller
errShare
errSave
All-optical machine learning using diffractive deep neural networks
err2018-09-07
err0
errOAAI
errXing Lin; Yair Rivenson; Nezih T. Yardimci; Muhammed Veli; Yi Luo; Mona Jarrahi; Aydogan Ozcan
errShare
errSave
Detecting telecom single photons with (99.5+0.5-2.07)% system detection efficiency and high time resolution
err2021-03-30
err155
errOAAI
errChang, J.; Los, J. W. N.; Tenorio-Pearl, J. O.; Noordzij, N.; Gourgues, R.; Guardiani, A.; Zichi, J. R.; Pereira, S. F.; Urbach, H. P.; Zwiller, V.; Dorenbos, S. N.; Esmaeil Zadeh, I.
errShare
errSave
Approaching pixel-level readout of SNSPD array by inductor-shaping pulse
err2023-07-25
err3
PREAI
errGuan, Yanqiu; Li, Haochen; Zhang, Labao; Dong, Daxing; Wang, Hao; Chen, Qi; Guo, Shuya; Zhang, Biao; Zhang, Xiao; Yang, Zhuolin; Tu, Xuecou; Zhao, Qingyuan; Jia, Xiaoqing; Chen, Jian; Kang, Lin; Wu, Peiheng
errShare
errSave
Saturating quantum efficiency of SNSPDs with disorder manipulation of NbN films
err2023-09-07
err7
PREAI
errYin, Rui; Wang, Hao; Zhang, Labao; Wang, Xiaohan; Ma, Liang; Guan, Yanqiu; Yang, Zhuolin; Chen, Qi; Tu, Xuecou; Zhao, Qingyuan; Jia, Xiaoqing; Chen, Jian; Kang, Lin; Wu, Peiheng
errShare
errSave
researcher View more