1. Evaluation of taxonomic classification and profiling methods for long-read shotgun metagenomic sequencing datasets
- Author
-
Portik, Daniel M, Brown, C Titus, and Pierce-Ward, N Tessa
- Subjects
Nanopore ,PacBio ,Bioinformatics ,Taxonomic classifier ,High-Throughput Nucleotide Sequencing ,Mock community ,DNA ,Long reads ,Biological Sciences ,Sourmash ,Taxonomic profiler ,Mathematical Sciences ,Benchmarking ,Good Health and Well Being ,Information and Computing Sciences ,Genetics ,Metagenome ,Metagenomics ,Generic health relevance ,Sequence Analysis - Abstract
BackgroundLong-read shotgun metagenomic sequencing is gaining in popularity and offers many advantages over short-read sequencing. The higher information content in long reads is useful for a variety of metagenomics analyses, including taxonomic classification and profiling. The development of long-read specific tools for taxonomic classification is accelerating, yet there is a lack of information regarding their relative performance. Here, we perform a critical benchmarking study using 11 methods, including five methods designed specifically for long reads. We applied these tools to several mock community datasets generated using Pacific Biosciences (PacBio) HiFi or Oxford Nanopore Technology sequencing, and evaluated their performance based on read utilization, detection metrics, and relative abundance estimates.ResultsOur results show that long-read classifiers generally performed best. Several short-read classification and profiling methods produced many false positives (particularly at lower abundances), required heavy filtering to achieve acceptable precision (at the cost of reduced recall), and produced inaccurate abundance estimates. By contrast, two long-read methods (BugSeq, MEGAN-LR & DIAMOND) and one generalized method (sourmash) displayed high precision and recall without any filtering required. Furthermore, in the PacBio HiFi datasets these methods detected all species down to the 0.1% abundance level with high precision. Some long-read methods, such as MetaMaps and MMseqs2, required moderate filtering to reduce false positives to resemble the precision and recall of the top-performing methods. We found read quality affected performance for methods relying on protein prediction or exact k-mer matching, and these methods performed better with PacBio HiFi datasets. We also found that long-read datasets with a large proportion of shorter reads (
- Published
- 2022