arrow
Return

Super-resolution time-resolved imaging using computational sensor fusion

delete2021-01-18
delete16
delete
OA
AI
A
Ashley Lyons
D
Dennis den Brok
A
Areeba Fatima
A
Alex Turpin
Z
Zickus, V.
L
Laura M. Machesky
J
Jamie Whitelaw
D
Daniele Faccio *
M
Matthias B. Hullin *
DOI:10.1038/s41598-021-81159-xdelete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Imaging across both the full transverse spatial and temporal dimensions of a scene with high precision in all three coordinates is key to applications ranging from LIDAR to fluorescence lifetime imaging. However, compromises that sacrifice, for example, spatial resolution at the expense of temporal resolution are often required, in particular when the full 3-dimensional data cube is required in short acquisition times. We introduce a sensor fusion approach that combines data having low-spatial resolution but high temporal precision gathered with a single-photon-avalanche-diode (SPAD) array with data that has high spatial but no temporal resolution, such as that acquired with a standard CMOS camera. Our method, based on blurring the image on the SPAD array and computational sensor fusion, reconstructs time-resolved images at significantly higher spatial resolution than the SPAD input, upsampling numerical data by a factor 12x12, and demonstrating up to 4x4 upsampling of experimental data. We demonstrate the technique for both LIDAR applications and FLIM of fluorescent cancer cells. This technique paves the way to high spatial resolution SPAD imaging or, equivalently, FLIM imaging with conventional microscopes at frame rates accelerated by more than an order of magnitude.
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Scientific Reports cover
Scientific Reports
IF:
3.9
Papers:
28.3W
Citations:
83.5W

Organization

U
university of bonn
Scholars:
3.3W
Papers: 2.6W
Citations: 29
U
university of glasgow
Scholars:
3.5W
Papers: 3.1W
Citations: 37
C
cancer research uk
Scholars:
7.1K
Papers: 4.1K
Citations: 22
researcher View more organizations
Cited Papers

Cited Papers

Single-Photon 3D Imaging with Deep Sensor Fusion
err2018-07-30
err141
PREAI
errLindell, David B.; O'Toole, Matthew; Wetzstein, Gordon
errShare
errSave
Single-photon sensitive light-in-fight imaging
err2015-01-27
err211
errOAAI
errGariepy, Genevieve; Krstajic, Nikola; Henderson, Robert; Li, Chunyong; Thomson, Robert R.; Buller, Gerald S.; Heshmat, Barmak; Raskar, Ramesh; Leach, Jonathan; Faccio, Daniele
errShare
errSave
Continuous variable polarization entanglement, experiment and analysis
err2003-08-07
err0
errOAAI
errWarwick P Bowen; Nicolas Treps; Roman Schnabel; Timothy C Ralph; Ping Koy Lam
errShare
errSave
Megapixel time-gated SPAD image sensor for 2D and 3D imaging applications
errOPTICA
IF8.5
err2020-04-16
err241
errOAAI
errMorimoto, Kazuhiro; Ardelean, Andrei; Wu, Ming-Lo; Ulku, Arin Can; Antolovic, Ivan Michel; Bruschini, Claudio; Charbon, Edoardo
errShare
errSave
Femto-photography: capturing and visualizing the propagation of light
err2013-07-21
err117
errOAAI
errVelten, Andreas; Wu, Di; Jarabo, Adrian; Masia, Belen; Barsi, Christopher; Joshi, Chinmaya; Lawson, Everett; Bawendi, Moungi; Gutierrez, Diego; Raskar, Ramesh
errShare
errSave
Single-shot real-time video recording of a photonic Mach cone induced by a scattered light pulse
err2017-01-06
err123
errOAAI
errLiang, Jinyang; Ma, Cheng; Zhu, Liren; Chen, Yujia; Gao, Liang; Wang, Lihong V.
errShare
errSave
Computational time-of-flight diffuse optical tomography
err2019-05-20
err82
PREAI
errLyons, Ashley; Tonolini, Francesco; Boccolini, Alessandro; Repetti, Audrey; Henderson, Robert; Wiaux, Yves; Faccio, Daniele
errShare
errSave
End-to-end Learned, Optically Coded Super-resolution SPAD Camera
err2020-03-17
err56
PREAI
errSun, Qilin; Zhang, Jian; Dun, Xiong; Ghanem, Bernard; Peng, Yifan; Heidrich, Wolfgang
errShare
errSave
researcher View more