Back to Search
Start Over
A Robust Parallel Computing Data Extraction Framework for Nanopore Experiments.
- Source :
-
Small Methods . Jul2024, p1. 13p. 7 Illustrations. - Publication Year :
- 2024
-
Abstract
- The success of a nanopore experiment relies not only on the quality of the experimental design but also on the performance of the analysis program utilized to decipher the ionic perturbations necessary for understanding the fundamental molecular intricacies. An event extraction framework is developed that leverages parallel computing, efficient memory management, and vectorization, yielding significant performance enhancement. The newly developed <italic>abf‐ultra‐simple function</italic> extracts key parameters from the header critical for the operation of open‐seek‐read‐close data loading architecture running on multiple cores. This underpins the swift analysis of large files where an ≈ × 18 improvement is found for a 100 min‐long file (≈4.5 GB) compared to the more traditional single (cell) array data loading method. The application is benchmarked against five other analysis platforms showcasing significant performance enhancement (>2 ×–1120 ×). The integrated provisions for batch analysis enable concurrently analyzing multiple files (vital for high‐bandwidth experiments). Furthermore, the application is equipped with multi‐level data fitting based on abrupt changes in the event waveform. The application condenses the extracted events to a single binary file improving data portability (e.g., 16 GB file with 28 182 events reduces to 47.9 MB–343 × size reduction) and enables a multitude of post‐analysis extractions to be done efficiently. [ABSTRACT FROM AUTHOR]
- Subjects :
- *PARALLEL programming
*DATA extraction
*EXPERIMENTAL design
*SINGLE molecules
Subjects
Details
- Language :
- English
- ISSN :
- 23669608
- Database :
- Academic Search Index
- Journal :
- Small Methods
- Publication Type :
- Academic Journal
- Accession number :
- 178266819
- Full Text :
- https://doi.org/10.1002/smtd.202400045