arrow
Return

Deep-learning-augmented computational miniature mesoscope

delete2022-08-29
delete31
delete
OA
AI
Y
Yujia Xue
G
Guorong Hu
K
Kehan Guo
田磊 cover
田磊 (Lei Tian) *
DOI:10.1364/OPTICA.464700delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Fluorescence microscopy is essential to study biological structures and dynamics. However, existing systems suffer from a trade-off between field of view (FOV), resolution, and system complexity, and thus cannot fulfill the emerging need for miniaturized platforms providing micron-scale resolution across centimeter-scale FOVs. To overcome this challenge, we developed a computational miniature mesoscope (CM2) that exploits a computational imaging strategy to enable single-shot, 3D high-resolution imaging across a wide FOV in a miniaturized platform. Here, we present CM2 V2, which significantly advances both the hardware and computation. We complement the 3 x 3 microlens array with a hybrid emission filter that improves the imaging contrast by 5x, and design a 3D-printed free-form collimator for the LED illuminator that improves the excitation efficiency by 3x. To enable high-resolution reconstruction across a large volume, we develop an accurate and efficient 3D linear shift-variant (LSV) model to characterize spatially varying aberrations. We then train a multimodule deep learning model called CM(2)Net, using only the 3D-LSV simulator. We quantify the detection performance and localization accuracy of CM(2)Net to reconstruct fluorescent emitters under different conditions in simulation. We then show that CM(2)Net generalizes well to experiments and achieves accurate 3D reconstruction across a similar to 7-mm FOV and 800-mu m depth, and provides similar to 6-mu m lateral and similar to 25-mu m axial resolution. This provides an similar to 8x better axial resolution and similar to 1400x faster speed compared to the previous model-based algorithm. We anticipate this simple, low-cost computational miniature imaging system will be useful for many large-scale 3D fluorescence imaging applications. (C) 2022 Optica Publishing Group under the terms of the Optica Open Access Publishing Agreement
Keywords:
LIGHT-FIELD MICROSCOPY
RESOLUTION

Journal

Optica cover
Optica
IF:
8.5
Papers:
2.4K
Citations:
2.1W

Organization

B
boston university
Scholars:
3.8W
Papers: 3.2W
Citations: 67
Cited Papers

Cited Papers

On the use of deep learning for computational imaging
errOPTICA
IF8.5
err2019-07-25
err611
errOAAI
errBarbastathis, George; Ozcan, Aydogan; Situ, Guohai
errShare
errSave
Imaging Cortical Dynamics in GCaMP Transgenic Rats with a Head-Mounted Widefield Macroscope
errNEURON
IF15
err2018-12-01
err122
errOAAI
errScott, Benjamin B.; Thiberge, Stephan Y.; Guo, Caiying; Tervo, D. Gowanlock R.; Brody, Carlos D.; Karpova, Alla Y.; Tank, David W.
errShare
errSave
High-speed volumetric imaging of neuronal activity in freely moving rodents
err2018-05-07
err169
errOAAI
errSkocek, Oliver; Nobauer, Tobias; Weilguny, Lukas; Traub, Francisca Martinez; Xia, Chuying Naomi; Molodtsov, Maxim, I; Grama, Abhinav; Yamagata, Masahito; Aharoni, Daniel; Cox, David D.; Golshani, Peyman; Vaziri, Alipasha
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
Burden of Rotavirus Disease in Norway
err2016-04-01
err0
errOAAI
errTone Bruun; Beatriz Valcarcel Salamanca; Terese Bekkevold; Kirsti Vainio; Moustafa Gibory; Kirsti Egge Haugstad; Astrid Rojahn; Kirsti Jakobsen; Gunnar Størvold; Anette Lunde; Ketil Størdal; Anita Kanestrøm; Magnhild Owesen Eidem; Henrik Døllner; Lars Høsøien Skanke; Svein Arne Nordbø; Heidi Christin Sivertsen; Ann Marit Gilje; Elisebet Haarr; Elmira Flem
errShare
errSave
MODEL PSYCHOSES AND SCHIZOPHRENIA
err1962-07-01
err0
PREAI
errELLIOT D. LUBY; JACQUES S. GOTTLIEB; BERTRAM D. COHEN; GERALD ROSENBAUM; EDWARD F. DOMINO
errShare
errSave
researcher View more