Return
A Robust Parallel Computing Data Extraction Framework for Nanopore Experiments
DOI:10.1002/smtd.202400045.png)
Abstract
En 中文
The success of a nanopore experiment relies not only on the quality of the experimental design but also on the performance of the analysis program utilized to decipher the ionic perturbations necessary for understanding the fundamental molecular intricacies. An event extraction framework is developed that leverages parallel computing, efficient memory management, and vectorization, yielding significant performance enhancement. The newly developed abf-ultra-simple function extracts key parameters from the header critical for the operation of open-seek-read-close data loading architecture running on multiple cores. This underpins the swift analysis of large files where an approximate to x 18 improvement is found for a 100 min-long file (approximate to 4.5 GB) compared to the more traditional single (cell) array data loading method. The application is benchmarked against five other analysis platforms showcasing significant performance enhancement (>2 x-1120 x). The integrated provisions for batch analysis enable concurrently analyzing multiple files (vital for high-bandwidth experiments). Furthermore, the application is equipped with multi-level data fitting based on abrupt changes in the event waveform. The application condenses the extracted events to a single binary file improving data portability (e.g., 16 GB file with 28 182 events reduces to 47.9 MB-343 x size reduction) and enables a multitude of post-analysis extractions to be done efficiently.
Keywords:
event extraction
fast analysis
nanopores
parallel computing
single molecule sensing
Journal
IF:
9.1
Papers:
4.3K
Citations:
2.2W
Organization
Cited Papers
Nanopore Data Analysis: Baseline Construction and Abrupt Change-Based Multilevel Fitting
ANALYTICAL CHEMISTRY
IF6.7
Combining machine learning and nanopore construction creates an artificial intelligence nanopore for coronavirus detection
NATURE COMMUNICATIONS
IF15.7
Highly accurate classification of Watson-Crick basepairs on termini of single DNA molecules
BIOPHYSICAL JOURNAL
IF3.1

