arrow
Return

Convolutional Sparse Coding for RGB plus NIR Imaging

delete2018-04-01
delete32
delete
OA
AI
X
Xuemei Hu
F
Felix Heide
戴琼海 (Qionghai Dai) *
G
Gordon Wetzstein
DOI:10.1109/TIP.2017.2781303delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Emerging sensor designs increasingly rely on novel color filter arrays (CFAs) to sample the incident spectrum in unconventional ways. In particular, capturing a near-infrared (NIR) channel along with conventional RGB color is an exciting new imaging modality. RGB+NIR sensing has broad applications in computational photography, such as low-light denoising, it has applications in computer vision, such as facial recognition and tracking, and it paves the way toward low-cost single-sensor RGB and depth imaging using structured illumination. However, cost-effective commercial CFAs suffer from severe spectral cross talk. This cross talk represents a major challenge in high-quality RGB+NIR imaging, rendering existing spatially multiplexed sensor designs impractical. In this work, we introduce a new approach to RGB+NIR image reconstruction using learned convolutional sparse priors. We demonstrate high-quality color and NIR imaging for challenging scenes, even including high-frequency structured NIR illumination. The effectiveness of the proposed method is validated on a large data set of experimental captures, and simulated benchmark results which demonstrate that this work achieves unprecedented reconstruction quality.
Keywords:
Computational photography
convolutional sparse coding
structured illumination
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

T
tsinghua university
Scholars:
11.7W
Papers: 10.0W
Citations: 137
S
Stanford University
Scholars:
9.6W
Papers: 8.2W
Citations: 17.0W