arrow
返回

Learned reconstructions for practical mask-based lensless imaging

delete2019-09-19
delete137
delete
OA
AI
K
Kristina Monakhova *
J
Joshua Yurtsever
G
Grace Kuo
N
Nick Antipa
Y
Yanny, Kyrollos
L
Laura Waller
DOI:10.1364/OE.27.028075delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Mask-based lensless imagers are smaller and lighter than traditional lensed cameras. In these imagers, the sensor does not directly record an image of the scene; rather, a computational algorithm reconstructs it. Typically, mask-based lensless imagers use a model-based reconstruction approach that suffers from long compute times and a heavy reliance on both system calibration and heuristically chosen denoisers. In this work, we address these limitations using a bounded-compute, trainable neural network to reconstruct the image. We leverage our knowledge of the physical system by unrolling a traditional model-based optimization algorithm, whose parameters we optimize using experimentally gathered ground-truth data. Optionally, images produced by the unrolled network are then fed into a jointly-trained denoiser. As compared to traditional methods, our architecture achieves better perceptual image quality and runs 20x faster, enabling interactive previewing of the scene. We explore a spectrum between model-based and deep learning methods, showing the benefits of using an intermediate approach. Finally, we test our network on images taken in the wild with a prototype mask-based camera, demonstrating that our network generalizes to natural images. (C) 2019 Optical Society of America under the terms of the OSA Open Access Publishing Agreement

期刊

Optics Express 封面图
Optics Express
IF:
3.3
论文数:
6.1W
被引数:
14.3W

机构

U
University of California Berkeley
学者数:
3.5W
论文数: 2.8W
被引数: 11.3W
University of California System 封面图
University of California System
学者数:
37.7W
论文数: 33.8W
被引数: 6.6K
引用论文

引用论文

err分享
err收藏
Deep learning approach to Fourier ptychographic microscopy
err2018-09-26
err235
errOAAI
errThanh Nguyen; Xue, Yujia; Li, Yunzhe; Tian, Lei; Nehmetallah, George
err分享
err收藏
DiffuserCam: lensless single-exposure 3D imaging
errOPTICA
IF8.5
err2017-12-22
err440
errOAAI
errAntipa, Nick; Kuo, Grace; Heckel, Reinhard; Mildenhall, Ben; Bostan, Emrah; Ng, Ren; Waller, Laura
err分享
err收藏
Imaging through glass diffusers using densely connected convolutional networks
errOPTICA
IF8.5
err2018-07-06
err353
errOAAI
errLi, Shuai; Deng, Mo; Lee, Justin; Sinha, Ayan; Barbastathis, George
err分享
err收藏
Single-frame 3D fluorescence microscopy with ultraminiature lensless FlatScope
err2017-12-01
err185
errOAAI
errAdams, Jesse K.; Boominathan, Vivek; Avants, Benjamin W.; Vercosa, Daniel G.; Ye, Fan; Baraniuk, Richard G.; Robinson, Jacob T.; Veeraraghavan, Ashok
err分享
err收藏
没有更多内容