Taxonomic classification of DNA sequences beyond sequence similarity using deep neural networks
PNAS · 2022 · PNAS 119(35):e2122636119, published 2022-08-26; PMC9436379 full-text XML · Peer-reviewed
What this source contributed
Records in this release that cite this source. A record can cite several sources.
Results
Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.
Claims
Statements this source supports, each with where in the source it was checked.
- comparison_design: dna-pathogen-20261012-bertax-benchmark: Comparison design All methods compared have exactly the same reference or training data as BERTax; whole reference genomes are not included, which the authors call a necessary deviation from the designed use of database methods. (Results 'Comparison to Other Classification Approaches' paragraph 1)
- Evidence summary: DNA pathogen identification workflows: Summary Most workflow comparisons in the reviewed evidence use mock communities, constructed metagenomes or simulated sequences. Two compare workflows on patient specimens, and in both the reference standard draws partly on sequencing: in Hu et al. 2026 only the culture comparison is independent of the sequencing results, and in Huang et al. 2026 the reference was built mainly from BALF mNGS and the conventional tests that are themselves scored. Both are author-reported and have co-authors from sequencing companies (Genskey Medical Technology for Hu; Geneplus-Beijing, which supplies the targeted assay's probes, for Huang). For the Karius plasma cell-free DNA assay, the developers report 93.7% (59 of 63) agreement with initial blood culture in a sepsis-alert cohort, and blood culture does not detect every infection. A prospective study in children and young adults with high-risk leukaemia, with Karius taking part in sample processing and analysis, found every blood-culture organism in 81.3% (65 of 80) of evaluable bloodstream infection episodes on the day of or after onset and in 51.9% (42 of 81) during the three days before; 82.7% (134 of 162) of control samples from patients without fever or infection had no bacterium or yeast detected. In 62 bronchoalveolar lavage specimens (Hu et al. 2026), a short-read MGI workflow and a host-depleted nanopore workflow both had 95.2% positive agreement with culture but 44.6% and 46.4% negative agreement, because they found organisms culture did not; against a composite reference that adds organisms found by both workflows, positive agreement was 93.3% and 90.7%. In 122 intensive-care patients with pneumonia-associated sepsis (Huang et al. 2026), a targeted probe-capture assay on plasma had 63.46% sensitivity against the reference diagnosis, against 35.58% for untargeted blood mNGS, 49.04% for conventional tests and 9.62% for blood culture, with specificity of 44.44% and 61.11% for the two blood sequencing assays. In mock communities (Portik et al. 2022), Kraken2 and Bracken called 44 to 204 absent species at a 0.001% read threshold (precision 0.05 to 0.21), while long-read MEGAN-LR and BugSeq-V2 called 0 to 2; the first author is a PacBio employee. In seven pathogen-free libraries scored against one shared virus database by the EsViritu developers (preprint), the median number of false virus species was 0 for EsViritu, Centrifuger and Sylph, 6 for Kraken2 and 18 for Metabuli. For M. tuberculosis reads in constructed metagenomes (Hall and Coin 2024), kraken with its standard database classified 0.07 to 0.74 of the M. tuberculosis reads as M. tuberculosis, against 0.97 to 0.995 with a Mycobacterium database. Two papers by the developers of trained classifiers compare them with the baseline tools, on simulated or isolate-derived data rather than clinical specimens. On simulated 1,500-nt genome fragments (Mock et al. 2022, BERTax), Kraken2 and minimap2 assigned a superkingdom to 76.11% and 75.59% of fragments, with 99.82% and 99.95% accuracy on the fragments they assigned, when relatives were in the reference, and to 21.56% and 19.88% with 90.71% and 94.42% accuracy when each fragment's genus was absent from it; BERTax assigned every fragment, with 94.78% and 88.95% accuracy in the two settings. On in silico mixtures of nanopore isolate reads from species absent from the reference (Peres da Silva et al. 2024, MetageNN), MetageNN assigned a genus to 93.26% of reads on average across 30 mixtures, against 64.90% for Kraken2 and 53.06% for MEGAN-LR (on minimap2 alignments); MMseqs2, a reference-based tool not in the baseline, assigned 85.49%. These shares count reads assigned, not reads assigned correctly. Each study used its own reference database and reporting rules, and none of these results is clinical validation. (amp-20261007-dna-pathogens-source: result amp-20261007-dna-pathogens-result; dna-pathogen-20261009-source-portik2022: Table 4; dna-pathogen-20261009-source-hall2024: Tables 5-8; dna-pathogen-20261011-wolf2026-source: Tables 2 and 3; dna-pathogen-20261011-hu2026-source: Table 2; dna-pathogen-20261011-huang2026-source: Table 2; rna-pathogen-20261011-tisza2026-source-supp: Supplemental Table S6; dna-pathogen-20261012-bertax-source: Materials and Methods 'Preparing Data for Fine-Tuning' (1,500-nt fragments; closely and distantly related selection); dna-pathogen-20261012-bertax-source-si: SI Table S2 (superkingdom acc. and prop.); dna-pathogen-20261012-metagenn-source: Results 'Read classification results' paragraph 1 and the pseudo-mock 'Experimental setup' paragraph)
- printed_value_conflict: dna-pathogen-20261012-bertax-source: Printed value conflict Results 'Performance of Final BERTax Model' prints 95.20% for BERTax phylum AveP on the final dataset; Table 1 and SI Table S7 print 95.10. (Results 'Performance of Final BERTax Model' paragraph 1; Table 1; SI Table S7)
- Relevance of the BERTax closely related dataset protocol (Mock et al. 2022) to "Select a DNA pathogen-identification workflow for diagnostic testing": Assessed by BERTax Closely related dataset: taxonomic classification at superkingdom and phylum (Mock et al. 2022) (dna-pathogen-20261012-bertax-source-pdf: Table 1; dna-pathogen-20261012-bertax-source-si: Tables S2 and S5; dna-pathogen-20261012-bertax-source: Materials and Methods)
- Relevance of the BERTax distantly related dataset protocol (Mock et al. 2022) to "Select a DNA pathogen-identification workflow for diagnostic testing": Assessed by BERTax Distantly related dataset: taxonomic classification at superkingdom and phylum (Mock et al. 2022) (dna-pathogen-20261012-bertax-source-pdf: Table 1; dna-pathogen-20261012-bertax-source-si: Tables S2 and S5; dna-pathogen-20261012-bertax-source: Materials and Methods)
- Relevance of the BERTax final model dataset protocol (Mock et al. 2022) to "Select a DNA pathogen-identification workflow for diagnostic testing": Assessed by BERTax Final model dataset: taxonomic classification at superkingdom and phylum, and genus (Mock et al. 2022) (dna-pathogen-20261012-bertax-source-pdf: Table 1; dna-pathogen-20261012-bertax-source-si: Details to PR-curve plots; dna-pathogen-20261012-bertax-source: Materials and Methods)
- training_data: dna-pathogen-20261012-bertax-model-bertax: Training data Pretrained on about 2.5 million (2,492,474) 1,500-nt fragments from NCBI RefSeq genomes of archaea, bacteria, eukaryotes and viruses, clustered at 80% identity; fine-tuned on phylum classes with at least 10,000 fragments. (Results opening paragraph 3 ('The unsupervised pretraining was performed...'); Materials and Methods 'Pretraining Dataset', 'Preparing Data for Fine-Tuning')
Models, benchmarks and other records
Models (2)
Configurations (27)
- BERTax (Closely related dataset, Mock et al. 2022)
- BERTax (Distantly related dataset, Mock et al. 2022)
- BERTax (Final model dataset, Mock et al. 2022)
- DeepMicrobes (Closely related dataset, Mock et al. 2022)
- DeepMicrobes (Distantly related dataset, Mock et al. 2022)
- DeepMicrobes (Final model dataset, Mock et al. 2022)
- Kraken2 (Closely related dataset, Mock et al. 2022)
- Kraken2 (Distantly related dataset, Mock et al. 2022)
- Kraken2 (Final model dataset, Mock et al. 2022)
- minimap2 (Closely related dataset, Mock et al. 2022)
- minimap2 (Distantly related dataset, Mock et al. 2022)
- minimap2 (Final model dataset, Mock et al. 2022)
- MMseqs2 (Closely related dataset, Mock et al. 2022)
- MMseqs2 (Distantly related dataset, Mock et al. 2022)
- MMseqs2 (Final model dataset, Mock et al. 2022)
- MMseqs2 + BERTax (Closely related dataset, Mock et al. 2022)
- MMseqs2 + BERTax (Distantly related dataset, Mock et al. 2022)
- MMseqs2 + BERTax (Final model dataset, Mock et al. 2022)
- MMseqs2 + DeepMicrobes (Closely related dataset, Mock et al. 2022)
- MMseqs2 + DeepMicrobes (Distantly related dataset, Mock et al. 2022)
- MMseqs2 + DeepMicrobes (Final model dataset, Mock et al. 2022)
- MMseqs2 taxonomy* (Closely related dataset, Mock et al. 2022)
- MMseqs2 taxonomy* (Distantly related dataset, Mock et al. 2022)
- MMseqs2 taxonomy* (Final model dataset, Mock et al. 2022)
- sourmash (Closely related dataset, Mock et al. 2022)
Pipelines (2)
Benchmarks (1)
Protocols (3)
- BERTax Closely related dataset: taxonomic classification at superkingdom and phylum (Mock et al. 2022)
- BERTax Distantly related dataset: taxonomic classification at superkingdom and phylum (Mock et al. 2022)
- BERTax Final model dataset: taxonomic classification at superkingdom and phylum, and genus (Mock et al. 2022)
Datasets (3)
Evaluations (27)
- BERTax on the BERTax closely related dataset
- BERTax on the BERTax distantly related dataset
- BERTax on the BERTax final model dataset
- DeepMicrobes on the BERTax closely related dataset
- DeepMicrobes on the BERTax distantly related dataset
- DeepMicrobes on the BERTax final model dataset
- Kraken2 on the BERTax closely related dataset
- Kraken2 on the BERTax distantly related dataset
- Kraken2 on the BERTax final model dataset
- minimap2 on the BERTax closely related dataset
- minimap2 on the BERTax distantly related dataset
- minimap2 on the BERTax final model dataset
- MMseqs2 + BERTax on the BERTax closely related dataset
- MMseqs2 + BERTax on the BERTax distantly related dataset
- MMseqs2 + BERTax on the BERTax final model dataset
- MMseqs2 + DeepMicrobes on the BERTax closely related dataset
- MMseqs2 + DeepMicrobes on the BERTax distantly related dataset
- MMseqs2 + DeepMicrobes on the BERTax final model dataset
- MMseqs2 on the BERTax closely related dataset
- MMseqs2 on the BERTax distantly related dataset
- MMseqs2 on the BERTax final model dataset
- MMseqs2 taxonomy* on the BERTax closely related dataset
- MMseqs2 taxonomy* on the BERTax distantly related dataset
- MMseqs2 taxonomy* on the BERTax final model dataset
- sourmash on the BERTax closely related dataset
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
29 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| Access note Open access under CC BY-NC-ND 4.0. Full text is not archived in the batch; only factual table excerpts are. Source metadata | Taxonomic classification of DNA sequences beyond sequence similarity using deep neural networks No field-specific location recorded Version: PNAS 119(35):e2122636119, published 2022-08-26; PMC9436379 full-text XML | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| attributes.artifact_sha256 c0bb2f1bba8680b300076292389b39346ae58bea4bdf28647dd9462333b3bcd7 Source metadata | Taxonomic classification of DNA sequences beyond sequence similarity using deep neural networks No field-specific location recorded Version: PNAS 119(35):e2122636119, published 2022-08-26; PMC9436379 full-text XML | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Artifact url https://www.ebi.ac.uk/europepmc/webservices/rest/PMC9436379/fullTextXML Source metadata | Taxonomic classification of DNA sequences beyond sequence similarity using deep neural networks No field-specific location recorded Version: PNAS 119(35):e2122636119, published 2022-08-26; PMC9436379 full-text XML | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Doi 10.1073/pnas.2122636119 Source metadata | Taxonomic classification of DNA sequences beyond sequence similarity using deep neural networks No field-specific location recorded Version: PNAS 119(35):e2122636119, published 2022-08-26; PMC9436379 full-text XML | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Licence CC-BY-NC-ND-4.0 Source metadata | Taxonomic classification of DNA sequences beyond sequence similarity using deep neural networks No field-specific location recorded Version: PNAS 119(35):e2122636119, published 2022-08-26; PMC9436379 full-text XML | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Limitations1 values
| Taxonomic classification of DNA sequences beyond sequence similarity using deep neural networks No field-specific location recorded Version: PNAS 119(35):e2122636119, published 2022-08-26; PMC9436379 full-text XML | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Media type application/xml Source metadata | Taxonomic classification of DNA sequences beyond sequence similarity using deep neural networks No field-specific location recorded Version: PNAS 119(35):e2122636119, published 2022-08-26; PMC9436379 full-text XML | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Publication status peer_reviewed Source metadata | Taxonomic classification of DNA sequences beyond sequence similarity using deep neural networks No field-specific location recorded Version: PNAS 119(35):e2122636119, published 2022-08-26; PMC9436379 full-text XML | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Retrieved at 2026-10-12T20:51:54Z Source metadata | Taxonomic classification of DNA sequences beyond sequence similarity using deep neural networks No field-specific location recorded Version: PNAS 119(35):e2122636119, published 2022-08-26; PMC9436379 full-text XML | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| attributes.review.artifact_sha256 c0bb2f1bba8680b300076292389b39346ae58bea4bdf28647dd9462333b3bcd7 Source metadata | Taxonomic classification of DNA sequences beyond sequence similarity using deep neural networks No field-specific location recorded Version: PNAS 119(35):e2122636119, published 2022-08-26; PMC9436379 full-text XML | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Sources and history
Release 2026-10-22-1b7cf027e4f6 · Record review: source checked
Primary source (Europe PMC full-text XML) retrieved and hashed for the 2026-10-12 ML-versus-baseline pass.
Technical metadata and extraction receipts
Stable ID: dna-pathogen-20261012-bertax-source
- areas
- microbes-communities
- contexts
- research
- url
- https://doi.org/10.1073/pnas.2122636119
- artifact url
- https://www.ebi.ac.uk/europepmc/webservices/rest/PMC9436379/fullTextXML
- version
- PNAS 119(35):e2122636119, published 2022-08-26; PMC9436379 full-text XML
- retrieved at
- 2026-10-12T20:51:54Z
- artifact sha256
- c0bb2f1bba8680b300076292389b39346ae58bea4bdf28647dd9462333b3bcd7
- doi
- 10.1073/pnas.2122636119
- publication status
- peer_reviewed
- licence
- CC-BY-NC-ND-4.0
- media type
- application/xml
- venue
- PNAS
- year
- 2022
- source locator
- Licence statement in the article XML <license> element: CC BY-NC-ND 4.0
- limitations
- Table 1 is an image in the XML (table1.jpg); its values are taken from the PNAS PDF, recorded separately.
- access note
- Open access under CC BY-NC-ND 4.0. Full text is not archived in the batch; only factual table excerpts are.
- review
- method: source-hash-verification; reviewer: claude; reviewer note: Separate Claude review agent (rev-mlvb), independent of the extracting agent; no human review claimed; date: 2026-10-12; artifact sha256: c0bb2f1bba8680b300076292389b39346ae58bea4bdf28647dd9462333b3bcd7; retrieval url: https://www.ebi.ac.uk/europepmc/webservices/rest/PMC9436379/fullTextXML; note: Re-downloaded the Europe PMC full-text XML; SHA-256 matches.