rewirebio.iobenchmarks
Evaluation

RTG on ZymoBIOMICS Standard II (Song et al. 2025)

Published DNA metagenomic classification comparison; transcribed, not reproduced.

Research readiness

These checks assess whether the evidence supports a reproducible investigation. A source-checked score alone does not meet these requirements.

Release 2026-10-09-8cc1db47c7f9 · Evidence verified: Not verified

Evidence incomplete

Replay metrics

Exact outcomes, predictions, identifiers and evaluator are connected.

Missing or unresolved evidence

  • No verified artifact manifest is linked to this exact record.
  • artifact hashes: verification is missing
  • join integrity: verification is missing
  • score semantics: verification is missing
  • metric replay: verification is missing

Verified: Not verified

Evidence incomplete

Investigate discrepancies

Replay evidence includes annotations and an assessment of dependence. Unknown independence permits descriptive analysis only.

Missing or unresolved evidence

  • No verified artifact manifest is linked to this exact record.
  • artifact hashes: verification is missing
  • join integrity: verification is missing
  • score semantics: verification is missing
  • metric replay: verification is missing
  • annotations: verification is missing
  • dependence: verification is missing

Verified: Not verified

Evidence incomplete

Run locally

A pinned recipe describes the inputs, environment and resource requirements.

Missing or unresolved evidence

  • No verified artifact manifest is linked to this exact record.
  • artifact hashes: verification is missing
  • join integrity: verification is missing
  • score semantics: verification is missing
  • recipe pinned: verification is missing
  • resource estimate: verification is missing

Verified: Not verified

Evidence incomplete

Validate independently

Separate data and exposure records support an independent test.

Missing or unresolved evidence

  • No verified artifact manifest is linked to this exact record.
  • artifact hashes: verification is missing
  • join integrity: verification is missing
  • score semantics: verification is missing
  • independent validation: verification is missing
  • overlap checked: verification is missing

Verified: Not verified

Readiness describes the evidence in this release. Availability on your computer is checked separately when an investigation runs. Existing data exposure can prevent independent validation even when files are available.

Artifacts and reproduction

No verified artifact manifest is connected to this record yet. The gaps above identify what is needed before analysis can begin.

Read reviewed discrepancy investigations

Evaluation results

1 evaluation · 9 results. Different protocols are not a single leaderboard.

Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: RTG Core (Song et al. 2025)Protocol: Relative abundance of each species in ZymoBIOMICS Standard II against its theoretical distribution (Song et al. 2025 Table 1)
Dataset: ZymoBIOMICS Microbial Community Standard II positive control (Song et al. 2025)
8.50E‐3 proportion
fraction · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

RTG on ZymoBIOMICS Standard II (Song et al. 2025)

dna-pathogen-20261009-protocol-song2025-zymo-abundance

Aggregation: Not reported

Diagnostic Accuracy of Shotgun Metagenomics for Bloodstream Infections Is Influenced by Bioinformatics Workflow Selection · Table 1, row 'Bacillus subtilis', column 'RTG'
Configuration: RTG Core (Song et al. 2025)Protocol: Relative abundance of each species in ZymoBIOMICS Standard II against its theoretical distribution (Song et al. 2025 Table 1)
Dataset: ZymoBIOMICS Microbial Community Standard II positive control (Song et al. 2025)
9.68E‐5 proportion
fraction · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

RTG on ZymoBIOMICS Standard II (Song et al. 2025)

dna-pathogen-20261009-protocol-song2025-zymo-abundance

Aggregation: Not reported

Diagnostic Accuracy of Shotgun Metagenomics for Bloodstream Infections Is Influenced by Bioinformatics Workflow Selection · Table 1, row 'Enterococcus faecalis', column 'RTG'
Configuration: RTG Core (Song et al. 2025)Protocol: Relative abundance of each species in ZymoBIOMICS Standard II against its theoretical distribution (Song et al. 2025 Table 1)
Dataset: ZymoBIOMICS Microbial Community Standard II positive control (Song et al. 2025)
6.54E‐4 proportion
fraction · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

RTG on ZymoBIOMICS Standard II (Song et al. 2025)

dna-pathogen-20261009-protocol-song2025-zymo-abundance

Aggregation: Not reported

Diagnostic Accuracy of Shotgun Metagenomics for Bloodstream Infections Is Influenced by Bioinformatics Workflow Selection · Table 1, row 'Escherichia coli', column 'RTG'
Configuration: RTG Core (Song et al. 2025)Protocol: Relative abundance of each species in ZymoBIOMICS Standard II against its theoretical distribution (Song et al. 2025 Table 1)
Dataset: ZymoBIOMICS Microbial Community Standard II positive control (Song et al. 2025)
7.09E‐5 eta-squared
unitless · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

RTG on ZymoBIOMICS Standard II (Song et al. 2025)

dna-pathogen-20261009-protocol-song2025-zymo-abundance

Aggregation: Not reported

Diagnostic Accuracy of Shotgun Metagenomics for Bloodstream Infections Is Influenced by Bioinformatics Workflow Selection · Table 1, rows 'η 2' and 'p‐value', column 'RTG'
Configuration: RTG Core (Song et al. 2025)Protocol: Relative abundance of each species in ZymoBIOMICS Standard II against its theoretical distribution (Song et al. 2025 Table 1)
Dataset: ZymoBIOMICS Microbial Community Standard II positive control (Song et al. 2025)
9.36E‐5 proportion
fraction · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

RTG on ZymoBIOMICS Standard II (Song et al. 2025)

dna-pathogen-20261009-protocol-song2025-zymo-abundance

Aggregation: Not reported

Diagnostic Accuracy of Shotgun Metagenomics for Bloodstream Infections Is Influenced by Bioinformatics Workflow Selection · Table 1, row 'Lactobacillus fermentum', column 'RTG'
Configuration: RTG Core (Song et al. 2025)Protocol: Relative abundance of each species in ZymoBIOMICS Standard II against its theoretical distribution (Song et al. 2025 Table 1)
Dataset: ZymoBIOMICS Microbial Community Standard II positive control (Song et al. 2025)
8.64E‐1 proportion
fraction · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

RTG on ZymoBIOMICS Standard II (Song et al. 2025)

dna-pathogen-20261009-protocol-song2025-zymo-abundance

Aggregation: Not reported

Diagnostic Accuracy of Shotgun Metagenomics for Bloodstream Infections Is Influenced by Bioinformatics Workflow Selection · Table 1, row 'Listeria monocytogenes', column 'RTG'
Configuration: RTG Core (Song et al. 2025)Protocol: Relative abundance of each species in ZymoBIOMICS Standard II against its theoretical distribution (Song et al. 2025 Table 1)
Dataset: ZymoBIOMICS Microbial Community Standard II positive control (Song et al. 2025)
7.65E‐2 proportion
fraction · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

RTG on ZymoBIOMICS Standard II (Song et al. 2025)

dna-pathogen-20261009-protocol-song2025-zymo-abundance

Aggregation: Not reported

Diagnostic Accuracy of Shotgun Metagenomics for Bloodstream Infections Is Influenced by Bioinformatics Workflow Selection · Table 1, row 'Pseudomonas aeruginosa', column 'RTG'
Configuration: RTG Core (Song et al. 2025)Protocol: Relative abundance of each species in ZymoBIOMICS Standard II against its theoretical distribution (Song et al. 2025 Table 1)
Dataset: ZymoBIOMICS Microbial Community Standard II positive control (Song et al. 2025)
8.65E‐4 proportion
fraction · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

RTG on ZymoBIOMICS Standard II (Song et al. 2025)

dna-pathogen-20261009-protocol-song2025-zymo-abundance

Aggregation: Not reported

Diagnostic Accuracy of Shotgun Metagenomics for Bloodstream Infections Is Influenced by Bioinformatics Workflow Selection · Table 1, row 'Salmonella enterica', column 'RTG'
Configuration: RTG Core (Song et al. 2025)Protocol: Relative abundance of each species in ZymoBIOMICS Standard II against its theoretical distribution (Song et al. 2025 Table 1)
Dataset: ZymoBIOMICS Microbial Community Standard II positive control (Song et al. 2025)
0 proportion
fraction · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

RTG on ZymoBIOMICS Standard II (Song et al. 2025)

dna-pathogen-20261009-protocol-song2025-zymo-abundance

Aggregation: Not reported

Diagnostic Accuracy of Shotgun Metagenomics for Bloodstream Infections Is Influenced by Bioinformatics Workflow Selection · Table 1, row 'Staphylococcus aureus', column 'RTG'

Source checking is not independent reproduction. Release 2026-10-09-8cc1db47c7f9.

Evaluation procedure

dna-pathogen-20261009-protocol-song2025-zymo-abundance

Configuration
RTG Core (Song et al. 2025)
Protocol
Relative abundance of each species in ZymoBIOMICS Standard II against its theoretical distribution (Song et al. 2025 Table 1)
Dataset
ZymoBIOMICS Microbial Community Standard II positive control (Song et al. 2025)
origin
Independent external evaluation
configuration
Primary source as retrieved 2026-10-09
protocol id
dna-pathogen-20261009-protocol-song2025-zymo-abundance
dataset version
ZymoBIOMICS Microbial Community Standard II, one library
split
Single positive control
population
Eight species in Table 1
inputs
Merged quality-filtered HiSeq 2500 reads
adaptation
Native database per pipeline
metric implementation
Relative abundance as output by each pipeline
aggregation
Single library
budget
Not reported

Metadata review: source checked. Unreported conditions prevent automatic comparisons.

Reproduction

Split
Single positive control
Adaptation
Native database per pipeline
Scoring implementation
Relative abundance as output by each pipeline

No execution recipe has been verified for this exact configuration and evaluation. A benchmark's general instructions may use different inputs, splits or model settings.

Reproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

18 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-10-09-8cc1db47c7f9
Property and statementOriginal source and locationReview and provenance
attributes.comparison.adaptation
Native database per pipeline
Context-only references
Diagnostic Accuracy of Shotgun Metagenomics for Bloodstream Infections Is Influenced by Bioinformatics Workflow Selection

Original source ↗

Table 1, column 'RTG'

Version: MicrobiologyOpen 14(6):e70158, published online 2025-12-15; PMC12705909 full-text XML
Retrieved: 2026-10-09T19:48:48Z

not individually reviewed

No individual claim review recorded

independent paper

Source has a recorded evidence concern. Consult its source page before using the claim.

Audit details

Field: attributes.comparison.adaptation

Source artifact SHA-256: 7b122b551b2155b43c26f5a15e7382a0662d859520d2939dc91e04d88e5656ef

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

attributes.comparison.aggregation
Single library
Context-only references
Diagnostic Accuracy of Shotgun Metagenomics for Bloodstream Infections Is Influenced by Bioinformatics Workflow Selection

Original source ↗

Table 1, column 'RTG'

Version: MicrobiologyOpen 14(6):e70158, published online 2025-12-15; PMC12705909 full-text XML
Retrieved: 2026-10-09T19:48:48Z

not individually reviewed

No individual claim review recorded

independent paper

Source has a recorded evidence concern. Consult its source page before using the claim.

Audit details

Field: attributes.comparison.aggregation

Source artifact SHA-256: 7b122b551b2155b43c26f5a15e7382a0662d859520d2939dc91e04d88e5656ef

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

attributes.comparison.budget
Not reported
Context-only references
Diagnostic Accuracy of Shotgun Metagenomics for Bloodstream Infections Is Influenced by Bioinformatics Workflow Selection

Original source ↗

Table 1, column 'RTG'

Version: MicrobiologyOpen 14(6):e70158, published online 2025-12-15; PMC12705909 full-text XML
Retrieved: 2026-10-09T19:48:48Z

missing or unspecified

No individual claim review recorded

independent paper

Source has a recorded evidence concern. Consult its source page before using the claim.

Audit details

Field: attributes.comparison.budget

Source artifact SHA-256: 7b122b551b2155b43c26f5a15e7382a0662d859520d2939dc91e04d88e5656ef

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

attributes.comparison.dataset_version
ZymoBIOMICS Microbial Community Standard II, one library
Context-only references
Diagnostic Accuracy of Shotgun Metagenomics for Bloodstream Infections Is Influenced by Bioinformatics Workflow Selection

Original source ↗

Table 1, column 'RTG'

Version: MicrobiologyOpen 14(6):e70158, published online 2025-12-15; PMC12705909 full-text XML
Retrieved: 2026-10-09T19:48:48Z

not individually reviewed

No individual claim review recorded

independent paper

Source has a recorded evidence concern. Consult its source page before using the claim.

Audit details

Field: attributes.comparison.dataset_version

Source artifact SHA-256: 7b122b551b2155b43c26f5a15e7382a0662d859520d2939dc91e04d88e5656ef

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

attributes.comparison.inputs
Merged quality-filtered HiSeq 2500 reads
Context-only references
Diagnostic Accuracy of Shotgun Metagenomics for Bloodstream Infections Is Influenced by Bioinformatics Workflow Selection

Original source ↗

Table 1, column 'RTG'

Version: MicrobiologyOpen 14(6):e70158, published online 2025-12-15; PMC12705909 full-text XML
Retrieved: 2026-10-09T19:48:48Z

not individually reviewed

No individual claim review recorded

independent paper

Source has a recorded evidence concern. Consult its source page before using the claim.

Audit details

Field: attributes.comparison.inputs

Source artifact SHA-256: 7b122b551b2155b43c26f5a15e7382a0662d859520d2939dc91e04d88e5656ef

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

attributes.comparison.metric_implementation
Relative abundance as output by each pipeline
Context-only references
Diagnostic Accuracy of Shotgun Metagenomics for Bloodstream Infections Is Influenced by Bioinformatics Workflow Selection

Original source ↗

Table 1, column 'RTG'

Version: MicrobiologyOpen 14(6):e70158, published online 2025-12-15; PMC12705909 full-text XML
Retrieved: 2026-10-09T19:48:48Z

not individually reviewed

No individual claim review recorded

independent paper

Source has a recorded evidence concern. Consult its source page before using the claim.

Audit details

Field: attributes.comparison.metric_implementation

Source artifact SHA-256: 7b122b551b2155b43c26f5a15e7382a0662d859520d2939dc91e04d88e5656ef

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

attributes.comparison.population
Eight species in Table 1
Context-only references
Diagnostic Accuracy of Shotgun Metagenomics for Bloodstream Infections Is Influenced by Bioinformatics Workflow Selection

Original source ↗

Table 1, column 'RTG'

Version: MicrobiologyOpen 14(6):e70158, published online 2025-12-15; PMC12705909 full-text XML
Retrieved: 2026-10-09T19:48:48Z

not individually reviewed

No individual claim review recorded

independent paper

Source has a recorded evidence concern. Consult its source page before using the claim.

Audit details

Field: attributes.comparison.population

Source artifact SHA-256: 7b122b551b2155b43c26f5a15e7382a0662d859520d2939dc91e04d88e5656ef

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

attributes.comparison.protocol_id
dna-pathogen-20261009-protocol-song2025-zymo-abundance
Context-only references
Diagnostic Accuracy of Shotgun Metagenomics for Bloodstream Infections Is Influenced by Bioinformatics Workflow Selection

Original source ↗

Table 1, column 'RTG'

Version: MicrobiologyOpen 14(6):e70158, published online 2025-12-15; PMC12705909 full-text XML
Retrieved: 2026-10-09T19:48:48Z

not individually reviewed

No individual claim review recorded

independent paper

Source has a recorded evidence concern. Consult its source page before using the claim.

Audit details

Field: attributes.comparison.protocol_id

Source artifact SHA-256: 7b122b551b2155b43c26f5a15e7382a0662d859520d2939dc91e04d88e5656ef

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

attributes.comparison.split
Single positive control
Context-only references
Diagnostic Accuracy of Shotgun Metagenomics for Bloodstream Infections Is Influenced by Bioinformatics Workflow Selection

Original source ↗

Table 1, column 'RTG'

Version: MicrobiologyOpen 14(6):e70158, published online 2025-12-15; PMC12705909 full-text XML
Retrieved: 2026-10-09T19:48:48Z

not individually reviewed

No individual claim review recorded

independent paper

Source has a recorded evidence concern. Consult its source page before using the claim.

Audit details

Field: attributes.comparison.split

Source artifact SHA-256: 7b122b551b2155b43c26f5a15e7382a0662d859520d2939dc91e04d88e5656ef

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

attributes.origin
independent_paper
Context-only references
Diagnostic Accuracy of Shotgun Metagenomics for Bloodstream Infections Is Influenced by Bioinformatics Workflow Selection

Original source ↗

Table 1, column 'RTG'

Version: MicrobiologyOpen 14(6):e70158, published online 2025-12-15; PMC12705909 full-text XML
Retrieved: 2026-10-09T19:48:48Z

not individually reviewed

No individual claim review recorded

independent paper

Source has a recorded evidence concern. Consult its source page before using the claim.

Audit details

Field: attributes.origin

Source artifact SHA-256: 7b122b551b2155b43c26f5a15e7382a0662d859520d2939dc91e04d88e5656ef

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Sources and history

Release 2026-10-09-8cc1db47c7f9 · Record review: source checked

1 source records and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: dna-pathogen-20261009-eval-song2025-zymo-rtg-core-3-12

areas
microbes-communities
contexts
clinical_research
origin
independent_paper
protocol
dna-pathogen-20261009-protocol-song2025-zymo-abundance
version
Primary source as retrieved 2026-10-09
comparison
protocol id: dna-pathogen-20261009-protocol-song2025-zymo-abundance; dataset version: ZymoBIOMICS Microbial Community Standard II, one library; split: Single positive control; population: Eight species in Table 1; inputs: Merged quality-filtered HiSeq 2500 reads; adaptation: Native database per pipeline; metric implementation: Relative abundance as output by each pipeline; aggregation: Single library; budget: Not reported
source locator
Table 1, column 'RTG'
Related records

Suggest a correction