arrow
Return

A Robust Parallel Computing Data Extraction Framework for Nanopore Experiments

delete2024-07-05
delete0
delete
OA
AI
B
Bandara, Y. M. N. D. Y.
S
Shankar Dutt
K
Karawdeniya, Buddini I.
S
Saharia, Jugal
P
P. Kluth *
A
Antonio Tricoli *
DOI:10.1002/smtd.202400045delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The success of a nanopore experiment relies not only on the quality of the experimental design but also on the performance of the analysis program utilized to decipher the ionic perturbations necessary for understanding the fundamental molecular intricacies. An event extraction framework is developed that leverages parallel computing, efficient memory management, and vectorization, yielding significant performance enhancement. The newly developed abf-ultra-simple function extracts key parameters from the header critical for the operation of open-seek-read-close data loading architecture running on multiple cores. This underpins the swift analysis of large files where an approximate to x 18 improvement is found for a 100 min-long file (approximate to 4.5 GB) compared to the more traditional single (cell) array data loading method. The application is benchmarked against five other analysis platforms showcasing significant performance enhancement (>2 x-1120 x). The integrated provisions for batch analysis enable concurrently analyzing multiple files (vital for high-bandwidth experiments). Furthermore, the application is equipped with multi-level data fitting based on abrupt changes in the event waveform. The application condenses the extracted events to a single binary file improving data portability (e.g., 16 GB file with 28 182 events reduces to 47.9 MB-343 x size reduction) and enables a multitude of post-analysis extractions to be done efficiently.
Keywords:
event extraction
fast analysis
nanopores
parallel computing
single molecule sensing

Journal

Small Methods cover
Small Methods
IF:
9.1
Papers:
4.3K
Citations:
2.2W

Organization

A
Australian National University
Scholars:
2.1W
Papers: 2.3W
Citations: 3.9W
U
university of houston system
Scholars:
1.4W
Papers: 1.4W
Citations: 16
Cited Papers

Cited Papers

errShare
errSave
Identifying Single Viruses Using Biorecognition Solid-State Nanopores
err2018-11-26
err90
PREAI
errArima, Akihide; Harlisa, Ilva Hanun; Yoshida, Takeshi; Tsutsui, Makusu; Tanaka, Masayoshi; Yokota, Kazumichi; Tonomura, Wataru; Yasuda, Jiro; Taniguchi, Masateru; Washio, Takashi; Okochi, Mina; Kawai, Tomoji
errShare
errSave
On the origins of conductive pulse sensing inside a nanopore
err2022-05-13
err23
errOAAI
errLastra, Lauren S.; Bandara, Y. M. Nuwan D. Y.; Nguyen, Michelle; Farajpour, Nasim; Freedman, Kevin J.
errShare
errSave
Nanopore Data Analysis: Baseline Construction and Abrupt Change-Based Multilevel Fitting
err2021-08-17
err20
errOAAI
errBandara, Y. M. Nuwan D. Y.; Saharia, Jugal; Karawdeniya, Buddini, I; Kluth, Patrick; Kim, Min Jun
errShare
errSave
Combining machine learning and nanopore construction creates an artificial intelligence nanopore for coronavirus detection
err2021-06-17
err89
errOAAI
errTaniguchi, Masateru; Minami, Shohei; Ono, Chikako; Hamajima, Rina; Morimura, Ayumi; Hamaguchi, Shigeto; Akeda, Yukihiro; Kanai, Yuta; Kobayashi, Takeshi; Kamitani, Wataru; Terada, Yutaka; Suzuki, Koichiro; Hatori, Nobuaki; Yamagishi, Yoshiaki; Washizu, Nobuei; Takei, Hiroyasu; Sakamoto, Osamu; Naono, Norihiko; Tatematsu, Kenji; Washio, Takashi; Matsuura, Yoshiharu; Tomono, Kazunori
errShare
errSave
Highly accurate classification of Watson-Crick basepairs on termini of single DNA molecules
err2003-02-01
err123
errOAAI
errWinters-Hilt, S; Vercoutere, W; DeGuzman, VS; Deamer, D; Akeson, M; Haussler, D
errShare
errSave
Wavelet Denoising of High-Bandwidth Nanopore and Ion-Channel Signals
err2019-01-02
err31
errOAAI
errShekar, Siddharth; Chien, Chen-Chi; Hartel, Andreas; Ong, Peijie; Clarke, Oliver B.; Marks, Andrew; Drndic, Marija; Shepard, Kenneth L.
errShare
errSave
Fast and automatic processing of multi-level events in nanopore translocation experiments
err2012-01-01
err178
errOAAI
errRaillon, C.; Granjon, P.; Graf, M.; Steinbock, L. J.; Radenovic, A.
errShare
errSave
researcher View more