Benchmark data constructed by the EsViritu authors.
5 evaluations · 10 results. Different protocols are not a single leaderboard.
Applied filters: All linked evaluations
| Tested configuration | Protocol and dataset | Finding | Evidence and details |
|---|---|---|---|
| Configuration: Centrifuger v1.1.1-r309, headline setting (Tisza et al. 2026) | Protocol: Positive-control virus detection by read depth (Tisza et al. 2026 Table S2) Dataset: Positive-control synthetic reads from seven divergent virus genomes (Tisza et al. 2026) | 0.0117 Recall (model-estimated family-level detection probability at 10 read pairs; marginal mean over seven positive-control genomes) fraction · higher Uncertainty: 95% CI 0.00495878224532846 to 0.02719564873770782. Asymptotic interval from brglm2 estimated marginal means; standard error printed 0.005072199752721945 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261011-tisza2026-protocol-pos Aggregation: Not reported Tisza et al. 2026 Supplemental Tables S1-S25 (bioRxiv media-1.xlsx) · Supplemental Table S2, row 5 (base_tool 'Centrifuger', read_pairs 10), column 'prob' (cell C5); interval columns 'asymp.LCL' and 'asymp.UCL' |
| Configuration: Centrifuger v1.1.1-r309, headline setting (Tisza et al. 2026) | Protocol: Positive-control virus detection by read depth (Tisza et al. 2026 Table S2) Dataset: Positive-control synthetic reads from seven divergent virus genomes (Tisza et al. 2026) | 0.198 Recall (model-estimated family-level detection probability at 100 read pairs; marginal mean over seven positive-control genomes) fraction · higher Uncertainty: 95% CI 0.1247430998401599 to 0.2996024520084267. Asymptotic interval from brglm2 estimated marginal means; standard error printed 0.04452631953737853 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261011-tisza2026-protocol-pos Aggregation: Not reported Tisza et al. 2026 Supplemental Tables S1-S25 (bioRxiv media-1.xlsx) · Supplemental Table S2, row 10 (base_tool 'Centrifuger', read_pairs 100), column 'prob' (cell C10); interval columns 'asymp.LCL' and 'asymp.UCL' |
| Configuration: EsViritu v1.3.1, headline setting (Tisza et al. 2026) | Protocol: Positive-control virus detection by read depth (Tisza et al. 2026 Table S2) Dataset: Positive-control synthetic reads from seven divergent virus genomes (Tisza et al. 2026) | 0.974 Recall (model-estimated family-level detection probability at 10 read pairs; marginal mean over seven positive-control genomes) fraction · higher Uncertainty: 95% CI 0.9472888410150351 to 0.9877770210442621. Asymptotic interval from brglm2 estimated marginal means; standard error printed 0.009555569960517363 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceEsViritu v1.3.1 on Positive-control virus detection by read depth (Tisza et al. 2026 Table S2) rna-pathogen-20261011-tisza2026-protocol-pos Aggregation: Not reported Tisza et al. 2026 Supplemental Tables S1-S25 (bioRxiv media-1.xlsx) · Supplemental Table S2, row 4 (base_tool 'EsViritu', read_pairs 10), column 'prob' (cell C4); interval columns 'asymp.LCL' and 'asymp.UCL' |
| Configuration: EsViritu v1.3.1, headline setting (Tisza et al. 2026) | Protocol: Positive-control virus detection by read depth (Tisza et al. 2026 Table S2) Dataset: Positive-control synthetic reads from seven divergent virus genomes (Tisza et al. 2026) | 0.999 Recall (model-estimated family-level detection probability at 100 read pairs; marginal mean over seven positive-control genomes) fraction · higher Uncertainty: 95% CI 0.9958883308387158 to 0.9997762702050332. Asymptotic interval from brglm2 estimated marginal means; standard error printed 0.0007134219297489364 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceEsViritu v1.3.1 on Positive-control virus detection by read depth (Tisza et al. 2026 Table S2) rna-pathogen-20261011-tisza2026-protocol-pos Aggregation: Not reported Tisza et al. 2026 Supplemental Tables S1-S25 (bioRxiv media-1.xlsx) · Supplemental Table S2, row 9 (base_tool 'EsViritu', read_pairs 100), column 'prob' (cell C9); interval columns 'asymp.LCL' and 'asymp.UCL' |
| Configuration: Kraken2 v2.17.1, headline setting (Tisza et al. 2026) | Protocol: Positive-control virus detection by read depth (Tisza et al. 2026 Table S2) Dataset: Positive-control synthetic reads from seven divergent virus genomes (Tisza et al. 2026) | 0.0451 Recall (model-estimated family-level detection probability at 10 read pairs; marginal mean over seven positive-control genomes) fraction · higher Uncertainty: 95% CI 0.02256255452587475 to 0.08820897881741546. Asymptotic interval from brglm2 estimated marginal means; standard error printed 0.01575080088172684 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceKraken2 v2.17.1 on Positive-control virus detection by read depth (Tisza et al. 2026 Table S2) rna-pathogen-20261011-tisza2026-protocol-pos Aggregation: Not reported Tisza et al. 2026 Supplemental Tables S1-S25 (bioRxiv media-1.xlsx) · Supplemental Table S2, row 6 (base_tool 'Kraken2', read_pairs 10), column 'prob' (cell C6); interval columns 'asymp.LCL' and 'asymp.UCL' |
| Configuration: Kraken2 v2.17.1, headline setting (Tisza et al. 2026) | Protocol: Positive-control virus detection by read depth (Tisza et al. 2026 Table S2) Dataset: Positive-control synthetic reads from seven divergent virus genomes (Tisza et al. 2026) | 0.589 Recall (model-estimated family-level detection probability at 100 read pairs; marginal mean over seven positive-control genomes) fraction · higher Uncertainty: 95% CI 0.4695359295150824 to 0.6991817422401287. Asymptotic interval from brglm2 estimated marginal means; standard error printed 0.0596107597598103 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceKraken2 v2.17.1 on Positive-control virus detection by read depth (Tisza et al. 2026 Table S2) rna-pathogen-20261011-tisza2026-protocol-pos Aggregation: Not reported Tisza et al. 2026 Supplemental Tables S1-S25 (bioRxiv media-1.xlsx) · Supplemental Table S2, row 11 (base_tool 'Kraken2', read_pairs 100), column 'prob' (cell C11); interval columns 'asymp.LCL' and 'asymp.UCL' |
| Configuration: Metabuli v1.2.0, headline setting (Tisza et al. 2026) | Protocol: Positive-control virus detection by read depth (Tisza et al. 2026 Table S2) Dataset: Positive-control synthetic reads from seven divergent virus genomes (Tisza et al. 2026) | 1 Recall (model-estimated family-level detection probability at 10 read pairs; marginal mean over seven positive-control genomes) fraction · higher Uncertainty: 95% CI 0.9975626013544785 to 0.9999866586638343. Asymptotic interval from brglm2 estimated marginal means; standard error printed 0.0002398938614360291 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceMetabuli v1.2.0 on Positive-control virus detection by read depth (Tisza et al. 2026 Table S2) rna-pathogen-20261011-tisza2026-protocol-pos Aggregation: Not reported Tisza et al. 2026 Supplemental Tables S1-S25 (bioRxiv media-1.xlsx) · Supplemental Table S2, row 7 (base_tool 'Metabuli', read_pairs 10), column 'prob' (cell C7); interval columns 'asymp.LCL' and 'asymp.UCL' |
| Configuration: Metabuli v1.2.0, headline setting (Tisza et al. 2026) | Protocol: Positive-control virus detection by read depth (Tisza et al. 2026 Table S2) Dataset: Positive-control synthetic reads from seven divergent virus genomes (Tisza et al. 2026) | 1 Recall (model-estimated family-level detection probability at 100 read pairs; marginal mean over seven positive-control genomes) fraction · higher Uncertainty: 95% CI 0.998667970267063 to 0.9999999447574935. Asymptotic interval from brglm2 estimated marginal means; standard error printed 0.00002209870476776148 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceMetabuli v1.2.0 on Positive-control virus detection by read depth (Tisza et al. 2026 Table S2) rna-pathogen-20261011-tisza2026-protocol-pos Aggregation: Not reported Tisza et al. 2026 Supplemental Tables S1-S25 (bioRxiv media-1.xlsx) · Supplemental Table S2, row 12 (base_tool 'Metabuli', read_pairs 100), column 'prob' (cell C12); interval columns 'asymp.LCL' and 'asymp.UCL' |
| Configuration: Sylph v0.9.0, headline setting (Tisza et al. 2026) | Protocol: Positive-control virus detection by read depth (Tisza et al. 2026 Table S2) Dataset: Positive-control synthetic reads from seven divergent virus genomes (Tisza et al. 2026) | 0.000884 Recall (model-estimated family-level detection probability at 10 read pairs; marginal mean over seven positive-control genomes) fraction · higher Uncertainty: 95% CI 0.0002455506729957742 to 0.003174226166650207. Asymptotic interval from brglm2 estimated marginal means; standard error printed 0.0005770437158860627 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceSylph v0.9.0 on Positive-control virus detection by read depth (Tisza et al. 2026 Table S2) rna-pathogen-20261011-tisza2026-protocol-pos Aggregation: Not reported Tisza et al. 2026 Supplemental Tables S1-S25 (bioRxiv media-1.xlsx) · Supplemental Table S2, row 8 (base_tool 'Sylph', read_pairs 10), column 'prob' (cell C8); interval columns 'asymp.LCL' and 'asymp.UCL' |
| Configuration: Sylph v0.9.0, headline setting (Tisza et al. 2026) | Protocol: Positive-control virus detection by read depth (Tisza et al. 2026 Table S2) Dataset: Positive-control synthetic reads from seven divergent virus genomes (Tisza et al. 2026) | 0.00347 Recall (model-estimated family-level detection probability at 100 read pairs; marginal mean over seven positive-control genomes) fraction · higher Uncertainty: 95% CI 0.001204394110956901 to 0.009960703944958654. Asymptotic interval from brglm2 estimated marginal means; standard error printed 0.001871995713381193 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceSylph v0.9.0 on Positive-control virus detection by read depth (Tisza et al. 2026 Table S2) rna-pathogen-20261011-tisza2026-protocol-pos Aggregation: Not reported Tisza et al. 2026 Supplemental Tables S1-S25 (bioRxiv media-1.xlsx) · Supplemental Table S2, row 13 (base_tool 'Sylph', read_pairs 100), column 'prob' (cell C13); interval columns 'asymp.LCL' and 'asymp.UCL' |
Source checking is not independent reproduction. Release 2026-10-22-1b7cf027e4f6.
0 of 4 readiness checks met. These checks assess whether the evidence supports a reproducible investigation; a source-checked score alone does not meet them.
Release 2026-10-22-1b7cf027e4f6 · Evidence verified: Not verified
Exact outcomes, predictions, identifiers and evaluator are connected.
Missing or unresolved evidence
Verified: Not verified
Replay evidence includes annotations and an assessment of dependence. Unknown independence permits descriptive analysis only.
Missing or unresolved evidence
Verified: Not verified
A pinned recipe describes the inputs, environment and resource requirements.
Missing or unresolved evidence
Verified: Not verified
Separate data and exposure records support an independent test.
Missing or unresolved evidence
Verified: Not verified
Readiness describes the evidence in this release. Availability on your computer is checked separately when an investigation runs. Existing data exposure can prevent independent validation even when files are available.
No verified artifact manifest is connected to this record yet. The gaps above identify what is needed before analysis can begin.
A dataset supplies biological observations. The evaluation protocol defines how those observations are split, used and scored.
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
7 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| Access Zenodo 10.5281/zenodo.23043160 (stated in Code and data availability; not retrieved) Context-only references | EsViritu is a sensitive and specific profiler for viral pathogen detection and genome recovery in metagenomes Methods 'Positive controls'; Supplemental Table S25 Version: bioRxiv 10.64898/2026.09.29.755457 v1, posted 2026-09-30; JATS XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Population Reads synthesised with bbtools randomreads.sh from seven genomes (four Genomoviridae, three Picornaviridae) at 75.91% to 95.62% ANI to their closest database reference, at 1, 10, 100 and 1,000 reads, ten permutations per depth Context-only references | EsViritu is a sensitive and specific profiler for viral pathogen detection and genome recovery in metagenomes Methods 'Positive controls'; Supplemental Table S25 Version: bioRxiv 10.64898/2026.09.29.755457 v1, posted 2026-09-30; JATS XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Source location Methods 'Positive controls'; Supplemental Table S25 Context-only references | EsViritu is a sensitive and specific profiler for viral pathogen detection and genome recovery in metagenomes Methods 'Positive controls'; Supplemental Table S25 Version: bioRxiv 10.64898/2026.09.29.755457 v1, posted 2026-09-30; JATS XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Split No split Context-only references | EsViritu is a sensitive and specific profiler for viral pathogen detection and genome recovery in metagenomes Methods 'Positive controls'; Supplemental Table S25 Version: bioRxiv 10.64898/2026.09.29.755457 v1, posted 2026-09-30; JATS XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Version As described in Tisza et al. 2026 v1 Context-only references | EsViritu is a sensitive and specific profiler for viral pathogen detection and genome recovery in metagenomes Methods 'Positive controls'; Supplemental Table S25 Version: bioRxiv 10.64898/2026.09.29.755457 v1, posted 2026-09-30; JATS XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Description Benchmark data constructed by the EsViritu authors. Context-only references | EsViritu is a sensitive and specific profiler for viral pathogen detection and genome recovery in metagenomes Methods 'Positive controls'; Supplemental Table S25 Version: bioRxiv 10.64898/2026.09.29.755457 v1, posted 2026-09-30; JATS XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Name Positive-control synthetic reads from seven divergent virus genomes (Tisza et al. 2026) Context-only references | EsViritu is a sensitive and specific profiler for viral pathogen detection and genome recovery in metagenomes Methods 'Positive controls'; Supplemental Table S25 Version: bioRxiv 10.64898/2026.09.29.755457 v1, posted 2026-09-30; JATS XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Release 2026-10-22-1b7cf027e4f6 · Record review: source checked
Stable ID: rna-pathogen-20261011-tisza2026-data-pos