arrow
Return

Deep learning multi-shot 3D localization microscopy using hybrid optical electronic computing

delete2021-12-13
delete6
delete
OA
AI
H
Hayato Ikoma
K
Kudo, Takamasa
Y
Yifan Peng
B
Broxton, Michael
G
Gordon Wetzstein *
DOI:10.1364/OL.441743delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Current 3D localization microscopy approaches are fundamentally limited in their ability to image thick, densely labeled specimens. Here, we introduce a hybrid optical-electronic computing approach that jointly optimizes an optical encoder (a set of multiple, simultaneously imaged. 3D point spread functions) and an electronic decoder (a neural-network-based localization algorithm) to optimize 3D localization performance under these conditions. With extensive simulations and biological experiments, we demonstrate that our deep-learning-based microscope achieves significantly higher 3D localization accuracy than existing approaches, especially in challenging scenarios with high molecular density over large depth ranges. (C) 2021 Optical Society of America
Keywords:
DIFFRACTION-LIMIT
PARTICLE TRACKING
SUPERRESOLUTION

Journal

Optics Letters cover
Optics Letters
IF:
3.3
Papers:
4.0W
Citations:
7.6W

Organization

S
Stanford University
Scholars:
9.6W
Papers: 8.2W
Citations: 17.0W
Cited Papers

Cited Papers

High probability of disrupting a disulphide bridge mediated by an endogenous excited tryptophan residue
err2009-04-13
err0
errOAAI
errMaria Teresa Neves‐Petersen; Zygmunt Gryczynski; Joseph Lakowicz; Peter Fojan; Shona Pedersen; Evamaria Petersen; Steffen Bjørn Petersen
errShare
errSave
Three-dimensional sub-100 nm resolution fluorescence microscopy of thick samples
err2008-05-11
err764
PREAI
errJuette, Manuel F.; Gould, Travis J.; Lessard, Mark D.; Mlodzianoski, Michael J.; Nagpure, Bhupendra S.; Bennett, Brian T.; Hess, Samuel T.; Bewersdorf, Joerg
errShare
errSave
A convex 3D deconvolution algorithm for low photon count fluorescence imaging
err2018-07-31
err24
errOAAI
errIkoma, Hayato; Broxton, Michael; Kudo, Takamasa; Wetzstein, Gordon
errShare
errSave
Sub-diffraction-limit imaging by stochastic optical reconstruction microscopy (STORM)
err2006-08-09
err7.1K
errOAAI
errRust, Michael J.; Bates, Mark; Zhuang, Xiaowei
errShare
errSave
Deep-STORM: super-resolution single-molecule microscopy by deep learning
errOPTICA
IF8.5
err2018-04-12
err472
errOAAI
errNehme, Elias; Weiss, Lucien E.; Michaeli, Tomer; Shechtman, Yoav
errShare
errSave
Super-resolution fight club: assessment of 2D and 3D single-molecule localization microscopy software
err2019-04-08
err236
errOAAI
errSage, Daniel; Thanh-An Pham; Babcock, Hazen; Lukes, Tomas; Pengo, Thomas; Chao, Jerry; Velmurugan, Ramraj; Herbert, Alex; Agrawal, Anurag; Colabrese, Silvia; Wheeler, Ann; Archetti, Anna; Rieger, Bernd; Ober, Raimund; Hagen, Guy M.; Sibarita, Jean-Baptiste; Ries, Jonas; Henriques, Ricardo; Unser, Michael; Holden, Seamus
errShare
errSave
Precise Three-Dimensional Scan-Free Multiple-Particle Tracking over Large Axial Ranges with Tetrapod Point Spread Functions
err2015-05-18
err226
errOAAI
errShechtman, Yoav; Weiss, Lucien E.; Backer, Adam S.; Sahl, Steffen J.; Moemer, W. E.
errShare
errSave
err
IF0
err
err0
errOAAI
err
errShare
errSave
3D single-molecule super-resolution microscopy with a tilted light sheet
err2018-01-09
err172
errOAAI
errGustavsson, Anna-Karin; Petrov, Petar N.; Lee, Maurice Y.; Shechtman, Yoav; Moerner, W. E.
errShare
errSave
researcher View more