arrow
Return

Shift-variant color-coded diffractive spectral imaging system

delete2021-11-04
delete65
delete
OA
AI
H
Henry Argüello *
S
Samuel Pinilla
Y
Yifan Peng
H
Hayato Ikoma
J
Jorge Bacca
G
Gordon Wetzstein
DOI:10.1364/OPTICA.439142delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
State-of-the-art snapshot spectral imaging (SI) systems introduce color-coded apertures (CCAs) into their setups to obtain a flexible spatial-spectral modulation, allowing spectral information to be reconstructed from a set of coded measurements. Besides the CCA, other optical elements, such as lenses, prisms, or beam splitters, are usually employed, making systems large and impractical. Recently, diffractive optical elements (DOEs) have partially replaced refractive lenses to drastically reduce the size of the SI devices. The sensing model of these systems is represented as a projection modeled by a spatially shift-invariant convolution between the unknownscene and a point spread function (PSF) at each spectral band. However, the height maps of theDOEare the only free parameters that offer changes in the spectral modulation, which causes the ill-posedness of the reconstruction to increase significantly. To overcome this challenge, our work explores the advantages of the spectral modulation of an optical setup composed of aDOEand aCCA. Specifically, the light is diffracted by theDOEand then filtered by theCCA, located close to the sensor. A shift-variant property of the proposed system is clearly evidenced, resulting in a different PSF for each pixel, where a symmetric structure constraint is imposed on the CCAto reduce the high number of resulting PSFs. Additionally, we jointly design theDOEand theCCA parameters with a fully differentiable image formation model using an end-to-end approach to minimize the deviation between the true and reconstructed image over a large set of images. Simulation shows that the proposed system improves the spectral reconstruction quality in up to 4 dB compared with current state-of-the-art systems. Finally, experimental results with a fabricated prototype in indoor and outdoor scenes validate the proposed system, where it can recover up to 49 high-fidelity spectral bands in the 420-660 nm. (C) 2021 Optical Society of America under the terms of the OSA Open Access Publishing Agreement.
Keywords:
APERTURE DESIGN

Journal

Optica cover
Optica
IF:
8.5
Papers:
2.4K
Citations:
2.1W

Organization

S
Stanford University
Scholars:
9.6W
Papers: 8.2W
Citations: 17.0W
U
universidad industrial de santander
Scholars:
2.6K
Papers: 1.6K
Citations: 1
Cited Papers

Cited Papers

High probability of disrupting a disulphide bridge mediated by an endogenous excited tryptophan residue
err2009-04-13
err0
errOAAI
errMaria Teresa Neves‐Petersen; Zygmunt Gryczynski; Joseph Lakowicz; Peter Fojan; Shona Pedersen; Evamaria Petersen; Steffen Bjørn Petersen
errShare
errSave
Flashover strength improvement and multipactor suppression in vacuum using surface charge pre-conditioning on insulator
err2018-10-05
err0
PREAI
errGuang-Yu Sun; Bao-Hong Guo; Hai-Bao Mu; Bai-Peng Song; Run-Dong Zhou; Shu Zhang; Guan-Jun Zhang
errShare
errSave
errShare
errSave
Development of a digital-micromirror-device-based multishot snapshot spectral imaging system
err2011-07-14
err157
PREAI
errWu, Yuehao; Mirza, Iftekhar O.; Arce, Gonzalo R.; Prather, Dennis W.
errShare
errSave
End-to-end Optimization of Optics and Image Processing for Achromatic Extended Depth of Field and Super-resolution Imaging
err2018-07-30
err292
errOAAI
errSitzmann, Vincent; Diamond, Steven; Peng, Yifan; Dun, Xiong; Boyd, Stephen; Heidrich, Wolfgang; Heide, Felix; Wetzstein, Gordon
errShare
errSave
errShare
errSave
Coupled deep learning coded aperture design for compressive image classification
err2020-03-10
err40
errOAAI
errBacca, Jorge; Galvis, Laura; Arguello, Henry
errShare
errSave
Compact Single-Shot Hyperspectral Imaging Using a Prism
err2017-11-20
err72
errOAAI
errBaek, Seung-Hwan; Kim, Incheol; Gutierrez, Diego; Kim, Min H.
errShare
errSave
researcher View more