arrow
Return

SmartEM: machine learning-guided electron microscopy

delete2025-12-29
delete0
PRE
AI
Y
Yaron Meirovitch *
I
Ishaan Singh Chandok
C
Core Francisco Park
P
Pavel Potocek
L
Lu Mi
S
Shashata Sawmya
Y
Yicong Li
T
Thomas L. Athey
V
Vladislav Susoy
N
Neha Karlupia
Y
Yuelong Wu
D
Daniel R. Berger
R
Richard Schalek
C
Caitlyn Bishop
D
Daniel Xenes
H
H. Martínez
J
Jordan Matelsky
B
Brock A. Wester
H
Hanspeter Pfister
R
Remco Schoenmakers
M
Maurice Peemen
J
Jeff W. Lichtman *
A
Aravinthan D. T. Samuel *
N
Nir N Shavit *
DOI:10.1038/s41592-025-02929-3delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Connectomics provides nanometer-resolution, synapse-level maps of neural circuits to understand brain activity and behavior. However, few researchers have access to the high-throughput electron microscopes necessary to generate enough data for whole-brain or even whole-circuit reconstruction. To date, machine learning methods have been used after the collection of images by electron microscopy (EM) to accelerate and improve neuronal segmentation, synapse reconstruction and other data analysis. With the continual computational improvements in processing EM images, acquiring EM images will become the rate-limiting step in automated connectomics. Here, in order to speed up EM imaging, we integrate machine learning into real-time image acquisition in a single-beam scanning electron microscope. This SmartEM approach allows an electron microscope to perform data-aware imaging of specimens. SmartEM saves time by allocating the proper imaging time for each region of interest—first scanning all pixels rapidly and then rescanning more slowly only the small subareas where a higher quality signal is required. We demonstrate that SmartEM achieves up to an ~7-fold acceleration of image acquisition time for connectomic samples using a commercial single-beam SEM in samples from nematodes, mice and human brain. We apply this fast imaging method to reconstruct a portion of mouse cerebral cortex with an accuracy comparable to traditional electron microscopy. SmartEM is a ‘smart’ pipeline for electron microscopy-based data acquisition for connectomics. In order to efficiently image large datasets, the approach involves imaging at short pixel dwell times and identifying problematic regions that are then imaged with longer dwell times and therefore higher quality.
Keywords:
SmartEM
machine learning
electron microscopy
connectomics
image acquisition

Journal

Nature Methods cover
Nature Methods
IF:
32.1
Papers:
7.2K
Citations:
12.7W

Organization

T
thermo fisher scientific
Scholars:
4.0K
Papers: 2.5K
Citations: 34
H
Harvard University
Scholars:
26.5W
Papers: 22.0W
Citations: 28.7W
M
Massachusetts Institute of Technology
Scholars:
2.4K
Papers: 1.1K
Citations: 8
J
Johns Hopkins University Applied Physics Laboratory
Scholars:
1.9K
Papers: 1.4K
Citations: 3.1K
researcher View more organizations
Cited Papers

Cited Papers

Whole-brain serial-section electron microscopy in larval zebrafish
err2017-05-10
err0
errOAAI
errDavid Grant Colburn Hildebrand; Marcelo Cicconet; Russel Miguel Torres; Woohyuk Choi; Tran Minh Quan; Jungmin Moon; Arthur Willis Wetzel; Andrew Scott Champion; Brett Jesse Graham; Owen Randlett; George Scott Plummer; Ruben Portugues; Isaac Henry Bianco; Stephan Saalfeld; Alexander David Baden; Kunal Lillaney; Randal Burns; Joshua Tzvi Vogelstein; Alexander Franz Schier; Wei-Chung Allen Lee; Won-Ki Jeong; Jeff William Lichtman; Florian Engert
errShare
errSave
A Complete Electron Microscopy Volume of the Brain of Adult Drosophila melanogaster
errCell
IF0
err2018-07-01
err0
errOAAI
errZhihao Zheng; J. Scott Lauritzen; Eric Perlman; Camenzind G. Robinson; Matthew Nichols; Daniel Milkie; Omar Torrens; John Price; Corey B. Fisher; Nadiya Sharifi; Steven A. Calle-Schuler; Lucia Kmecova; Iqbal J. Ali; Bill Karsh; Eric T. Trautman; John A. Bogovic; Philipp Hanslovsky; Gregory S.X.E. Jefferis; Michael Kazhdan; Khaled Khairy; Stephan Saalfeld; Richard D. Fetter; Davi D. Bock
errShare
errSave
Convolutional nets for reconstructing neural circuits from brain images acquired by serial section electron microscopy
err2019-04-01
err0
errOAAI
errKisuk Lee; Nicholas Turner; Thomas Macrina; Jingpeng Wu; Ran Lu; H Sebastian Seung
errShare
errSave
Network anatomy and in vivo physiology of visual cortical neurons
err2011-03-09
err0
errOAAI
errDavi D. Bock; Wei-Chung Allen Lee; Aaron M. Kerlin; Mark L. Andermann; Greg Hood; Arthur W. Wetzel; Sergey Yurgenson; Edward R. Soucy; Hyon Suk Kim; R. Clay Reid
errShare
errSave
Neuronal wiring diagram of an adult brain
err2024-10-02
err0
errOAAI
errSven Dorkenwald; Arie Matsliah; Amy R. Sterling; Philipp Schlegel; Szi-chieh Yu; Claire E. McKellar; Albert Lin; Marta Costa; Katharina Eichler; Yijie Yin; Will Silversmith; Casey Schneider-Mizell; Chris S. Jordan; Derrick Brittain; Akhilesh Halageri; Kai Kuehner; Oluwaseun Ogedengbe; Ryan Morey; Jay Gager; Krzysztof Kruk; Eric Perlman; Runzhe Yang; David Deutsch; Doug Bland; Marissa Sorek; Ran Lu; Thomas Macrina; Kisuk Lee; J. Alexander Bae; Shang Mu; Barak Nehoran; Eric Mitchell; Sergiy Popovych; Jingpeng Wu; Zhen Jia; Manuel A. Castro; Nico Kemnitz; Dodam Ih; Alexander Shakeel Bates; Nils Eckstein; Jan Funke; Forrest Collman; Davi D. Bock; Gregory S. X. E. Jefferis; H. Sebastian Seung; Mala Murthy; Zairene Lenizo; Austin T. Burke; Kyle Patrick Willie; Nikitas Serafetinidis; Nashra Hadjerol; Ryan Willie; Ben Silverman; John Anthony Ocho; Joshua Bañez; Rey Adrian Candilada; Anne Kristiansen; Nelsie Panes; Arti Yadav; Remer Tancontian; Shirleyjoy Serona; Jet Ivan Dolorosa; Kendrick Joules Vinson; Dustin Garner; Regine Salem; Ariel Dagohoy; Jaime Skelton; Mendell Lopez; Laia Serratosa Capdevila; Griffin Badalamente; Thomas Stocks; Anjali Pandey; Darrel Jay Akiatan; James Hebditch; Celia David; Dharini Sapkal; Shaina Mae Monungolh; Varun Sane; Mark Lloyd Pielago; Miguel Albero; Jacquilyn Laude; Márcia dos Santos; Zeba Vohra; Kaiyu Wang; Allien Mae Gogo; Emil Kind; Alvin Josh Mandahay; Chereb Martinez; John David Asis; Chitra Nair; Dhwani Patel; Marchan Manaytay; Imaan F. M. Tamimi; Clyde Angelo Lim; Philip Lenard Ampo; Michelle Darapan Pantujan; Alexandre Javier; Daril Bautista; Rashmita Rana; Jansen Seguido; Bhargavi Parmar; John Clyde Saguimpa; Merlin Moore; Markus William Pleijzier; Mark Larson; Joseph Hsu; Itisha Joshi; Dhara Kakadiya; Amalia Braun; Cathy Pilapil; Marina Gkantia; Kaushik Parmar; Quinn Vanderbeck; Irene Salgarella; Christopher Dunne; Eva Munnelly; Chan Hyuk Kang; Lena Lörsch; Jinmook Lee; Lucia Kmecova; Gizem Sancer; Christa Baker; Jenna Joroff; Steven Calle; Yashvi Patel; Olivia Sato; Siqi Fang; Janice Salocot; Farzaan Salman; Sebastian Molina-Obando; Paul Brooks; Mai Bui; Matthew Lichtenberger; Edward Tamboboy; Katie Molloy; Alexis E. Santana-Cruz; Anthony Hernandez; Seongbong Yu; Arzoo Diwan; Monika Patel; Travis R. Aiken; Sarah Morejohn; Sanna Koskela; Tansy Yang; Daniel Lehmann; Jonas Chojetzki; Sangeeta Sisodiya; Selden Koolman; Philip K. Shiu; Sky Cho; Annika Bast; Brian Reicher; Marlon Blanquart; Lucy Houghton; Hyungjun Choi; Maria Ioannidou; Matt Collie; Joanna Eckhardt; Benjamin Gorko; Li Guo; Zhihao Zheng; Alisa Poh; Marina Lin; István Taisz; Wes Murfin; Álvaro Sanz Díez; Nils Reinhard; Peter Gibb; Nidhi Patel; Sandeep Kumar; Minsik Yun; Megan Wang; Devon Jones; Lucas Encarnacion-Rivera; Annalena Oswald; Akanksha Jadia; Mert Erginkaya; Nik Drummond; Leonie Walter; Ibrahim Tastekin; Xin Zhong; Yuta Mabuchi; Fernando J. Figueroa Santiago; Urja Verma; Nick Byrne; Edda Kunze; Thomas Crahan; Ryan Margossian; Haein Kim; Iliyan Georgiev; Fabianna Szorenyi; Atsuko Adachi; Benjamin Bargeron; Tomke Stürner; Damian Demarest; Burak Gür; Andrea N. Becker; Robert Turnbull; Ashley Morren; Andrea Sandoval; Anthony Moreno-Sanchez; Diego A. Pacheco; Eleni Samara; Haley Croke; Alexander Thomson; Connor Laughland; Suchetana B. Dutta; Paula Guiomar Alarcón de Antón; Binglin Huang; Patricia Pujols; Isabel Haber; Amanda González-Segarra; Daniel T. Choe; Veronika Lukyanova; Nino Mancini; Zequan Liu; Tatsuo Okubo; Miriam A. Flynn; Gianna Vitelli; Meghan Laturney; Feng Li; Shuo Cao; Carolina Manyari-Diaz; Hyunsoo Yim; Anh Duc Le; Kate Maier; Seungyun Yu; Yeonju Nam; Daniel Bąba; Amanda Abusaif; Audrey Francis; Jesse Gayk; Sommer S. Huntress; Raquel Barajas; Mindy Kim; Xinyue Cui; Gabriella R. Sterne; Anna Li; Keehyun Park; Georgia Dempsey; Alan Mathew; Jinseong Kim; Taewan Kim; Guan-ting Wu; Serene Dhawan; Margarida Brotas; Cheng-hao Zhang; Shanice Bailey; Alexander Del Toro; Runzhe Yang; Stephan Gerhard; Andrew Champion; David J. Anderson; Rudy Behnia; Salil S. Bidaye; Alexander Borst; Eugenia Chiappe; Kenneth J. Colodner; Andrew Dacks; Barry Dickson; Denise Garcia; Stefanie Hampel; Volker Hartenstein; Bassem Hassan; Charlotte Helfrich-Forster; Wolf Huetteroth; Jinseop Kim; Sung Soo Kim; Young-Joon Kim; Jae Young Kwon; Wei-Chung Lee; Gerit A. Linneweber; Gaby Maimon; Richard Mann; Stéphane Noselli; Michael Pankratz; Lucia Prieto-Godino; Jenny Read; Michael Reiser; Katie von Reyn; Carlos Ribeiro; Kristin Scott; Andrew M. Seeds; Mareike Selcho; Marion Silies; Julie Simpson; Scott Waddell; Mathias F. Wernet; Rachel I. Wilson; Fred W. Wolf; Zepeng Yao; Nilay Yapici; Meet Zandawala
errShare
errSave
Local shape descriptors for neuron segmentation
err2022-12-30
err14
errOAAI
errSheridan, Arlo; Nguyen, Tri M. M.; Deb, Diptodip; Lee, Wei-Chung Allen; Saalfeld, Stephan; Turaga, Srinivas C. C.; Manor, Uri; Funke, Jan
errShare
errSave
Imaging ATUM ultrathin section libraries with WaferMapper: a multi-scale approach to EM reconstruction of neural circuits
err2014-06-27
err203
errOAAI
errHayworth, Kenneth J.; Morgan, Josh L.; Schalek, Richard; Berger, Daniel R.; Hildebrand, David G. C.; Lichtman, Jeff W.
errShare
errSave
researcher View more