rewirebio.iobenchmarks
Task

Simulated prophage-contig detection

Simulated metagenome assessment compares viral-contig and prophage identification across varying sample conditions.

SourcesSimulation study and comparative evaluation of viral contiguous sequence identification tools · Discussion and Conclusion; cached text lines 71–74

2 evaluations · 2 results

Overview

Datasets

Thirty simulated metagenome collections.

Metrics

Precision, F1 and prophage/genus recall are discussed as different outcomes.

Allowed inputs

Assembled contig sequence.

SourcesSimulation study and comparative evaluation of viral contiguous sequence identification tools · Discussion and Conclusion; cached text lines 71–74
Evaluation procedure diagram
How it worksComputational evaluation flow
Computational evaluation flow1. Input: Assembled contig sequence.. Then: 2. Evaluation: Existing identification tools are applied across controlled simulation conditions.. Then: 3. Readout: Precision, F1 and prophage/genus recall are discussed as different outcomes.Computational evaluation flow1. Input: Assembled contig sequence.. Then: 2. Evaluation: Existing identification tools are applied across controlled simulation conditions.. Then: 3. Readout: Precision, F1 and prophage/genus recall are discussed as different outcomes.Computational evaluation flow1. Input: Assembled contig sequence.. Then: 2. Evaluation: Existing identification tools are applied across controlled simulation conditions.. Then: 3. Readout: Precision, F1 and prophage/genus recall are discussed as different outcomes.

Conceptual summary of the cited evaluation; exact task configuration and source version remain part of the protocol.

SourcesSimulation study and comparative evaluation of viral contiguous sequence identification tools · Discussion and Conclusion; cached text lines 71–74

limited source coverage · Automated source review, 2026-09-16. All specifications and missing details

2 recorded evaluations, 2 metric rows. A comparison chart has not yet been validated for these results. The table retains the individual findings and their sources.

View coverage and remaining gaps across all benchmarks

Results

Results are available, but no reviewed comparison panel is linked in this release.

All evaluations

2 evaluations · 2 results. Different protocols are not a single leaderboard.

Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: VIBRANTTask: Simulated prophage-contig detection
Dataset: 20 medium/high-complexity viral simulations
0.169 F1 (mean)
unitless · unknown

Uncertainty: Not yet extracted

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

VIBRANT: Simulated prophage-contig detection

Average across twenty medium- and high-complexity simulated communities.

Aggregation: Not reported

Simulation study and comparative evaluation of viral contiguous sequence identification tools · Table 3, Vibrant row, Prophage F1 column
Configuration: VirSorterTask: Simulated prophage-contig detection
Dataset: 20 medium/high-complexity viral simulations
0.147 F1 (mean)
unitless · unknown

Uncertainty: Not yet extracted

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

VirSorter: Simulated prophage-contig detection

Average across twenty medium- and high-complexity simulated communities.

Aggregation: Not reported

Simulation study and comparative evaluation of viral contiguous sequence identification tools · Table 3, VirSorter row, Prophage F1 column

Source checking is not independent reproduction. Release 2026-11-21-adc15377fab2.

Methods and evaluation design

Procedure, tasks and evaluated configurations

How it works

Evaluation methodology

Thirty simulated metagenome collections. Simulation scenarios vary taxonomic complexity and contig characteristics; exact reference withholding remains unextracted. Precision, F1 and prophage/genus recall are discussed as different outcomes. Nine viral-identification tools, including Vibrant, VirSorter and Kraken2. Low- and medium-complexity simulation collections use nonoverlapping selected reference genomes. That condition does not establish exclusion from every identification tool’s database. The cited text-accessible evaluation sections give no confidence-interval, resampling or repeat-run error-bar specification. Image-only tables and uninspected supplements are outside this absence claim.

SourcesSimulation study and comparative evaluation of viral contiguous sequence identification tools · Discussion and Conclusion; cached text lines 71–74

Recorded evaluations

Each evaluation records what was tested and under which conditions.

Run instructions

No runnable recipe has been reviewed for this task. Dataset access, model requirements, licences and compute requirements must be checked against its sources before execution.

A task describes a biological question. Choose a linked protocol to obtain concrete split and scoring instructions.

Strengths, limitations and unresolved questions

Strengths and limitations

Strengths and considerations

No source-reviewed explanatory claims are recorded here yet.

Profile review details

Task-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced.

Stable record: reported-task-53e3d216eef6db

Specifications

Inputs, training, access and other details

Explanatory profile: limited source coverage · Automated source review, 2026-09-16. Review applies to the cited claims; unresolved fields are listed below. Numerical results retain their own review status.

Data, procedure and scoring
PropertyDescription and evidence
DatasetsThirty simulated metagenome collections.
SourcesSimulation study and comparative evaluation of viral contiguous sequence identification tools · Discussion and Conclusion; cached text lines 71–74
SplitsSimulation scenarios vary taxonomic complexity and contig characteristics; exact reference withholding remains unextracted.
SourcesSimulation study and comparative evaluation of viral contiguous sequence identification tools · Discussion and Conclusion; cached text lines 71–74
MetricsPrecision, F1 and prophage/genus recall are discussed as different outcomes.
SourcesSimulation study and comparative evaluation of viral contiguous sequence identification tools · Discussion and Conclusion; cached text lines 71–74
BaselinesNine viral-identification tools, including Vibrant, VirSorter and Kraken2.
SourcesSimulation study and comparative evaluation of viral contiguous sequence identification tools · Discussion and Conclusion; cached text lines 71–74
Leakage controlsLow- and medium-complexity simulation collections use nonoverlapping selected reference genomes. That condition does not establish exclusion from every identification tool’s database.
SourcesSimulation study and comparative evaluation of viral contiguous sequence identification tools · Discussion and Conclusion; cached text lines 71–74
UncertaintyThe cited text-accessible evaluation sections give no confidence-interval, resampling or repeat-run error-bar specification. Image-only tables and uninspected supplements are outside this absence claim. · Not reported in inspected sources
SourcesSimulation study and comparative evaluation of viral contiguous sequence identification tools · Discussion and Conclusion; cached text lines 71–74
Entity typePaper-specific computational evaluation protocol.
SourcesSimulation study and comparative evaluation of viral contiguous sequence identification tools · Discussion and Conclusion; cached text lines 71–74
OrganismsSimulated microbial/viral communities.
SourcesSimulation study and comparative evaluation of viral contiguous sequence identification tools · Discussion and Conclusion; cached text lines 71–74
AssaysKnown-origin simulated contigs.
SourcesSimulation study and comparative evaluation of viral contiguous sequence identification tools · Discussion and Conclusion; cached text lines 71–74
Allowed inputsAssembled contig sequence.
SourcesSimulation study and comparative evaluation of viral contiguous sequence identification tools · Discussion and Conclusion; cached text lines 71–74
AdaptationExisting identification tools are applied across controlled simulation conditions.
SourcesSimulation study and comparative evaluation of viral contiguous sequence identification tools · Discussion and Conclusion; cached text lines 71–74

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Papers and result coverage

Last literature check: 2026-09-17. Primary-paper discovery and source inspection. Source-checked results are not independently reproduced experiments.

Paper or primary resourceVersionReference
Simulation study and comparative evaluation of viral contiguous sequence identification toolsversion of recordRead source
DOI: 10.1186/s12859-021-04242-0
Historical gaps recorded on 2026-09-17

The catalogue now holds 2 result rows for this benchmark. A note below about pending extraction describes the state on 2026-09-17 and may since have been answered by a later batch. The result rows and their sources are the current record.

  • Performance averages over simulation conditions, not independent training seeds; do not use rank as a probability.
  • Benchmark simulation conditions differ from real metagenomic samples.
Search and extraction details

primary comparison table screened

Searches

  • "PMC8207588"

Evidence locations

  • Table 3
  • Methods: Building simulated Illumina metagenomes

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

17 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-adc15377fab2
Property and statementOriginal source and locationReview and provenance
Diagram caption
Conceptual summary of the cited evaluation; exact task configuration and source version remain part of the protocol.
Individual claims
Simulation study and comparative evaluation of viral contiguous sequence identification tools

Original source ↗

Discussion and Conclusion; cached text lines 71–74

Version: version of record
Retrieved: 2026-09-16T10:33:50.134Z

source checked

automated source review · 2026-09-16

Audit details

Task-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced.

Field: attributes.profile.diagram.caption

Source artifact SHA-256: 93a24652edfa6d9f686862479df3addf50a2d5d432d2d5a31882075fa59dfdfd

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Diagram steps
  • Input: Assembled contig sequence.
  • Evaluation: Existing identification tools are applied across controlled simulation conditions.
  • Readout: Precision, F1 and prophage/genus recall are discussed as different outcomes.
Individual claims
Simulation study and comparative evaluation of viral contiguous sequence identification tools

Original source ↗

Discussion and Conclusion; cached text lines 71–74

Version: version of record
Retrieved: 2026-09-16T10:33:50.134Z

source checked

automated source review · 2026-09-16

Audit details

Task-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced.

Field: attributes.profile.diagram.steps

Source artifact SHA-256: 93a24652edfa6d9f686862479df3addf50a2d5d432d2d5a31882075fa59dfdfd

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Diagram title
Computational evaluation flow
Individual claims
Simulation study and comparative evaluation of viral contiguous sequence identification tools

Original source ↗

Discussion and Conclusion; cached text lines 71–74

Version: version of record
Retrieved: 2026-09-16T10:33:50.134Z

source checked

automated source review · 2026-09-16

Audit details

Task-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced.

Field: attributes.profile.diagram.title

Source artifact SHA-256: 93a24652edfa6d9f686862479df3addf50a2d5d432d2d5a31882075fa59dfdfd

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Datasets
Thirty simulated metagenome collections.
Individual claims
Simulation study and comparative evaluation of viral contiguous sequence identification tools

Original source ↗

Discussion and Conclusion; cached text lines 71–74

Version: version of record
Retrieved: 2026-09-16T10:33:50.134Z

source checked

automated source review · 2026-09-16

Audit details

Task-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced.

Field: attributes.profile.facts.0.value

Source artifact SHA-256: 93a24652edfa6d9f686862479df3addf50a2d5d432d2d5a31882075fa59dfdfd

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Splits
Simulation scenarios vary taxonomic complexity and contig characteristics; exact reference withholding remains unextracted.
Individual claims
Simulation study and comparative evaluation of viral contiguous sequence identification tools

Original source ↗

Discussion and Conclusion; cached text lines 71–74

Version: version of record
Retrieved: 2026-09-16T10:33:50.134Z

source checked

automated source review · 2026-09-16

Audit details

Task-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced.

Field: attributes.profile.facts.1.value

Source artifact SHA-256: 93a24652edfa6d9f686862479df3addf50a2d5d432d2d5a31882075fa59dfdfd

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Adaptation
Existing identification tools are applied across controlled simulation conditions.
Individual claims
Simulation study and comparative evaluation of viral contiguous sequence identification tools

Original source ↗

Discussion and Conclusion; cached text lines 71–74

Version: version of record
Retrieved: 2026-09-16T10:33:50.134Z

source checked

automated source review · 2026-09-16

Audit details

Task-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced.

Field: attributes.profile.facts.10.value

Source artifact SHA-256: 93a24652edfa6d9f686862479df3addf50a2d5d432d2d5a31882075fa59dfdfd

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Metrics
Precision, F1 and prophage/genus recall are discussed as different outcomes.
Individual claims
Simulation study and comparative evaluation of viral contiguous sequence identification tools

Original source ↗

Discussion and Conclusion; cached text lines 71–74

Version: version of record
Retrieved: 2026-09-16T10:33:50.134Z

source checked

automated source review · 2026-09-16

Audit details

Task-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced.

Field: attributes.profile.facts.2.value

Source artifact SHA-256: 93a24652edfa6d9f686862479df3addf50a2d5d432d2d5a31882075fa59dfdfd

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Baselines
Nine viral-identification tools, including Vibrant, VirSorter and Kraken2.
Individual claims
Simulation study and comparative evaluation of viral contiguous sequence identification tools

Original source ↗

Discussion and Conclusion; cached text lines 71–74

Version: version of record
Retrieved: 2026-09-16T10:33:50.134Z

source checked

automated source review · 2026-09-16

Audit details

Task-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced.

Field: attributes.profile.facts.3.value

Source artifact SHA-256: 93a24652edfa6d9f686862479df3addf50a2d5d432d2d5a31882075fa59dfdfd

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Leakage controls
Low- and medium-complexity simulation collections use nonoverlapping selected reference genomes. That condition does not establish exclusion from every identification tool’s database.
Individual claims
Simulation study and comparative evaluation of viral contiguous sequence identification tools

Original source ↗

Discussion and Conclusion; cached text lines 71–74

Version: version of record
Retrieved: 2026-09-16T10:33:50.134Z

source checked

automated source review · 2026-09-16

Audit details

Task-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced.

Field: attributes.profile.facts.4.value

Source artifact SHA-256: 93a24652edfa6d9f686862479df3addf50a2d5d432d2d5a31882075fa59dfdfd

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Uncertainty
The cited text-accessible evaluation sections give no confidence-interval, resampling or repeat-run error-bar specification. Image-only tables and uninspected supplements are outside this absence claim.
Individual claims
Simulation study and comparative evaluation of viral contiguous sequence identification tools

Original source ↗

Discussion and Conclusion; cached text lines 71–74

Version: version of record
Retrieved: 2026-09-16T10:33:50.134Z

unreported

automated source review · 2026-09-16

Audit details

Task-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced.

Field: attributes.profile.facts.5.value

Source artifact SHA-256: 93a24652edfa6d9f686862479df3addf50a2d5d432d2d5a31882075fa59dfdfd

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-21-adc15377fab2 · Record review: needs review

2 source records and release historyDownload this release (gzip)
Technical metadata and record identifiers

Technical metadata for this record is tracked under stable ID reported-task-53e3d216eef6db.

Related records

Suggest a correction