返回
A Robust Parallel Computing Data Extraction Framework for Nanopore Experiments
DOI:10.1002/smtd.202400045.png)
摘要
En 中文
The success of a nanopore experiment relies not only on the quality of the experimental design but also on the performance of the analysis program utilized to decipher the ionic perturbations necessary for understanding the fundamental molecular intricacies. An event extraction framework is developed that leverages parallel computing, efficient memory management, and vectorization, yielding significant performance enhancement. The newly developed abf-ultra-simple function extracts key parameters from the header critical for the operation of open-seek-read-close data loading architecture running on multiple cores. This underpins the swift analysis of large files where an approximate to x 18 improvement is found for a 100 min-long file (approximate to 4.5 GB) compared to the more traditional single (cell) array data loading method. The application is benchmarked against five other analysis platforms showcasing significant performance enhancement (>2 x-1120 x). The integrated provisions for batch analysis enable concurrently analyzing multiple files (vital for high-bandwidth experiments). Furthermore, the application is equipped with multi-level data fitting based on abrupt changes in the event waveform. The application condenses the extracted events to a single binary file improving data portability (e.g., 16 GB file with 28 182 events reduces to 47.9 MB-343 x size reduction) and enables a multitude of post-analysis extractions to be done efficiently.
Keyword:
event extraction
fast analysis
nanopores
parallel computing
single molecule sensing
期刊
IF:
9.1
论文数:
4.3K
被引数:
2.2W
机构
引用论文
Nanopore Data Analysis: Baseline Construction and Abrupt Change-Based Multilevel Fitting
ANALYTICAL CHEMISTRY
IF6.7
Combining machine learning and nanopore construction creates an artificial intelligence nanopore for coronavirus detection
NATURE COMMUNICATIONS
IF15.7
Highly accurate classification of Watson-Crick basepairs on termini of single DNA molecules
BIOPHYSICAL JOURNAL
IF3.1
Wavelet Denoising of High-Bandwidth Nanopore and Ion-Channel Signals高带宽纳米孔和离子通道信号的小波去噪
NANO LETTERS
IF9.1

