arrow
Return

Deep learning-based point-scanning super-resolution imaging

delete2021-03-08
delete96
delete
OA
AI
L
Linjing Fang
F
Fred Monroe
S
Sammy Weiser Novak
L
Lyndsey M. Kirk
C
Cara R. Schiavon
S
Seungyoon B. Yu
T
Tong Zhang
M
Melissa Wu
K
Kyle Kastner
A
Alaa Abdel Latif
Z
Zijun Lin
A
Andrew Shaw
Y
Yoshiyuki Kubota
J
John M. Mendenhall
Z
Zhao Zhang
G
Gülçin Pekkurnaz
K
Kristen M. Harris
J
Jeremy Howard
U
Uri Manor *
DOI:10.1038/s41592-021-01080-zdelete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Point-scanning imaging systems are among the most widely used tools for high-resolution cellular and tissue imaging, benefiting from arbitrarily defined pixel sizes. The resolution, speed, sample preservation and signal-to-noise ratio (SNR) of point-scanning systems are difficult to optimize simultaneously. We show these limitations can be mitigated via the use of deep learning-based supersampling of undersampled images acquired on a point-scanning system, which we term point-scanning super-resolution (PSSR) imaging. We designed a 'crappifier' that computationally degrades high SNR, high-pixel resolution ground truth images to simulate low SNR, low-resolution counterparts for training PSSR models that can restore real-world undersampled images. For high spatiotemporal resolution fluorescence time-lapse data, we developed a 'multi-frame' PSSR approach that uses information in adjacent frames to improve model predictions. PSSR facilitates point-scanning image acquisition with otherwise unattainable resolution, speed and sensitivity. All the training data, models and code for PSSR are publicly available at 3DEM.org.
Keywords:
RESTORATION
MICROSCOPY
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Nature Methods cover
Nature Methods
IF:
32.1
Papers:
7.2K
Citations:
12.7W

Organization

N
national institutes of natural sciences (nins) - japan
Scholars:
8.6K
Papers: 9.1K
Citations: 3
U
universite de montreal
Scholars:
4.6W
Papers: 3.8W
Citations: 46
S
salk institute
Scholars:
3.1K
Papers: 2.2K
Citations: 8
U
university of texas austin
Scholars:
2.4W
Papers: 2.0W
Citations: 54
U
University of San Francisco
Scholars:
1.1K
Papers: 874
Citations: 1.0K
University of California System cover
University of California System
Scholars:
37.5W
Papers: 33.7W
Citations: 6.6K
U
university of texas system
Scholars:
18.5W
Papers: 15.6W
Citations: 210
U
University of California San Diego
Scholars:
4.6W
Papers: 3.5W
Citations: 924
researcher View more organizations