Accuracy (phylum rank; among the samples the tool classified; SI Table S5; all distantly related test sequences) of DeepMicrobes (Distantly related dataset, Mock et al. 2022) on BERTax Distantly related dataset (Mock et al. 2022)
42% Accuracy (phylum rank; among the samples the tool classified; SI Table S5; all distantly related test sequences)
Methods
- Tested configuration
- DeepMicrobes (Distantly related dataset, Mock et al. 2022)
- Protocol
- BERTax Distantly related dataset: taxonomic classification at superkingdom and phylum (Mock et al. 2022)
- Dataset
- BERTax Distantly related dataset (Mock et al. 2022)
- Procedure
- BERTax Distantly related dataset: taxonomic classification at superkingdom and phylum (Mock et al. 2022)
- Evaluation
- DeepMicrobes on the BERTax distantly related dataset
- Coverage
- Not reported scored / Not reported eligible
- Uncertainty
- Not reported by the source
- Evidence
- Author-reported evaluation · source checkedBERTax SI Appendix (pnas.2122636119.sapp.pdf) · SI Table S5, row "DeepMicrobes", column group "phylum", column "acc. unfiltered" (SI page S16)
A source-checked result verifies the numerical transcription, not every model or protocol detail. Evaluation metadata: source checked. Source checked does not mean independently reproduced.
Reproduction
- Split
- Per phylum, one or more whole genera (the subset closest to 2,000 samples) form the test set, undersampled to 1,780 samples per phylum; no test sample shares a genus with the training set.
- Adaptation
- Reference or training data restricted to the dataset's training partition
- Scoring implementation
- Top prediction only; unclassified samples treated as random guesses for AveP
No execution recipe has been verified for this exact configuration and evaluation. A benchmark's general instructions may use different inputs, splits or model settings.
Reproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
1 evidence row matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| Reported result 41.95 Individual claims | BERTax SI Appendix (pnas.2122636119.sapp.pdf) SI Table S5, row "DeepMicrobes", column group "phylum", column "acc. unfiltered" (SI page S16) Version: SI Appendix as distributed with PMC9436379 (member pnas.2122636119.sapp.pdf of the Europe PMC supplementaryFiles ZIP) | source checked ["source-hash-verification","pdf-text-parse","independent-cell-check"] · 2026-10-12 author reported Audit detailsRe-downloaded the SI PDF from the PMC open-access copy and matched its pinned SHA-256; compared every Table S2 and S5 cell with a separate pdftotext parser written for this review (row and column labels asserted). Reviewer corrections: accuracy qualifier states the classified-samples denominator; proportion classified has direction unknown, because classifying more samples is not better by itself. Field: Source artifact SHA-256: Hash scope: SHA-256 of the PDF member, not of the ZIP (the ZIP is rebuilt per request) Extraction artifact SHA-256: |
Sources and history
Release 2026-10-22-1b7cf027e4f6 · Record review: source checked
3 source records and release history
- BERTax SI Appendix (pnas.2122636119.sapp.pdf) · Original source · SI Appendix as distributed with PMC9436379 (member pnas.2122636119.sapp.pdf of the Europe PMC supplementaryFiles ZIP)
- Taxonomic classification of DNA sequences beyond sequence similarity using deep neural networks · Original source · PNAS 119(35):e2122636119, published 2022-08-26; PMC9436379 full-text XML
- Taxonomic classification of DNA sequences beyond sequence similarity using deep neural networks (PNAS PDF) · Original source · PNAS 119(35):e2122636119 version-of-record PDF (10 pages)
Technical metadata and extraction receipts
Stable ID: dna-pathogen-20261012-bertax-result-deepmicrobes-distantly-phylum-accuracy-homology-unfiltered
- metric
- accuracy
- metric direction
- higher
- unit
- percent
- printed value
- 41.95
- numeric value
- 41.95
- metric qualifier
- phylum rank; among the samples the tool classified; SI Table S5; all distantly related test sequences
- source locator
- SI Table S5, row "DeepMicrobes", column group "phylum", column "acc. unfiltered" (SI page S16)
- missing metadata
- uncertainty: reason: unreported
- review
- method: source-hash-verification; pdf-text-parse; independent-cell-check; reviewer: claude; reviewer note: Separate Claude review agent (rev-mlvb), independent of the extracting agent; no human review claimed; date: 2026-10-12; artifact sha256: 89a2f86f66cbb2ff17886d413cd89577285086fedd1009e1d9daf87b29fbc1c0; retrieval url: https://pmc-oa-opendata.s3.amazonaws.com/PMC9436379.1/pnas.2122636119.sapp.pdf; method note: Read from `pdftotext -layout` output of the pinned SI PDF; extract/extract_bertax.py asserts the caption, header and the three tool labels with six values each.; note: Re-downloaded the SI PDF from the PMC open-access copy and matched its pinned SHA-256; compared every Table S2 and S5 cell with a separate pdftotext parser written for this review (row and column labels asserted). Reviewer corrections: accuracy qualifier states the classified-samples denominator; proportion classified has direction unknown, because classifying more samples is not better by itself.