arrow
Return

A compressive hyperspectral video imaging system using a single-pixel detector

delete2024-02-17
delete12
delete
OA
AI
徐怡博 (Yibo Xu) *
L
Liyang Lu
V
Vishwanath Saragadam
K
Kevin F. Kelly
DOI:10.1038/s41467-024-45856-1delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Capturing fine spatial, spectral, and temporal information of the scene is highly desirable in many applications. However, recording data of such high dimensionality requires significant transmission bandwidth. Current computational imaging methods can partially address this challenge but are still limited in reducing input data throughput. In this paper, we report a video-rate hyperspectral imager based on a single-pixel photodetector which can achieve high-throughput hyperspectral video recording at a low bandwidth. We leverage the insight that 4-dimensional (4D) hyperspectral videos are considerably more compressible than 2D grayscale images. We propose a joint spatial-spectral capturing scheme encoding the scene into highly compressed measurements and obtaining temporal correlation at the same time. Furthermore, we propose a reconstruction method relying on a signal sparsity model in 4D space and a deep learning reconstruction approach greatly accelerating reconstruction. We demonstrate reconstruction of 128 x 128 hyperspectral images with 64 spectral bands at more than 4 frames per second offering a 900x data throughput compared to conventional imaging, which we believe is a first-of-its kind of a single-pixel-based hyperspectral imager. The authors showcase a video-rate hyperspectral imager based on a single-pixel photodetector that can achieve high-throughput hyperspectral video recording at a low bandwidth. Specifically, they propose a joint spatial-spectral encoding scheme which can encode the scene into highly compressed single-pixel measurements and obtain temporal correlation at the same time.
Keywords:
SIGNAL RECOVERY
CLASSIFICATION
MICROSCOPY
CAMERA
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Nature Communications cover
Nature Communications
IF:
15.7
Papers:
9.3W
Citations:
91.2W

Organization

R
Rice University
Scholars:
1.4W
Papers: 1.2W
Citations: 2.6W
B
beijing institute of technology
Scholars:
5.5W
Papers: 4.0W
Citations: 63
G
Google Incorporated
Scholars:
3.5K
Papers: 1.8K
Citations: 8
researcher View more organizations