Strengths and considerations
No source-reviewed explanatory claims are recorded here yet.
Sourmash as evaluated in the cited study. Paper-specific evaluated pipeline; exact checkpoint not inferred from label
Key specifications have not been extracted for this record. See the linked evaluation and sources for the reported setup.
limited source coverage · Automated source review, 2026-09-17. All specifications and missing details
Deployment facts recorded for Sourmash. Fields the record does not carry are marked not recorded.
Evaluated Checkpoint: Paper-specific evaluated pipeline; exact checkpoint not inferred from label
1 evaluation · 3 results. Different protocols are not a single leaderboard.
Protocol: Species profiling on Dilthey2019 simulated long reads (Long-read taxonomic profiling) · Dataset: Species profiling on Dilthey2019 simulated long reads
Sorted by F1 (higher is better). The best value in each column is highlighted. Decimals are rounded for display; each value links to the printed value and its source.
| Tested configuration | F1 | Precision | Recall |
|---|---|---|---|
| SourmashEvaluation | 0.932 | 0.938 | 0.927 |
Applied filters: All linked evaluations
| Tested configuration | Protocol and dataset | Finding | Evidence and details |
|---|---|---|---|
| Configuration: Sourmash | Protocol: Species profiling on Dilthey2019 simulated long reads (Long-read taxonomic profiling) Dataset: Species profiling on Dilthey2019 simulated long reads | 0.932 F1 fraction · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceSourmash: Species profiling on Dilthey2019 simulated long reads Species-level recall/precision/F 1. MetaMaps results copied from original manuscript; other tool versions reported in Methods. 200,114 reads;96 strain design,94 strains with RefSeq species representatives; average read 4,997 bp. Aggregation: Not reported Lightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 1:, row Sourmash, column F1 score; XML row6 column4 |
| Configuration: Sourmash | Protocol: Species profiling on Dilthey2019 simulated long reads (Long-read taxonomic profiling) Dataset: Species profiling on Dilthey2019 simulated long reads | 0.927 Recall fraction · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceSourmash: Species profiling on Dilthey2019 simulated long reads Species-level recall/precision/F 1. MetaMaps results copied from original manuscript; other tool versions reported in Methods. 200,114 reads;96 strain design,94 strains with RefSeq species representatives; average read 4,997 bp. Aggregation: Not reported Lightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 1:, row Sourmash, column Recall; XML row6 column2 |
| Configuration: Sourmash | Protocol: Species profiling on Dilthey2019 simulated long reads (Long-read taxonomic profiling) Dataset: Species profiling on Dilthey2019 simulated long reads | 0.938 Precision fraction · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceSourmash: Species profiling on Dilthey2019 simulated long reads Species-level recall/precision/F 1. MetaMaps results copied from original manuscript; other tool versions reported in Methods. 200,114 reads;96 strain design,94 strains with RefSeq species representatives; average read 4,997 bp. Aggregation: Not reported Lightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 1:, row Sourmash, column Precision; XML row6 column3 |
Source checking is not independent reproduction. Release 2026-11-21-c8bea25e5abb.
Paper-specific evaluated pipeline; exact checkpoint not inferred from label
No source-reviewed explanatory claims are recorded here yet.
No source-reviewed explanatory claims are recorded here yet.
Primary-source transcription and separate automated review. No human sign-off or experimental reproduction.
Stable record: paper-model-1de2ec3070b2f487ceExplanatory profile: limited source coverage · Automated source review, 2026-09-17. Review applies to the cited claims; unresolved fields are listed below. Numerical results retain their own review status.
| Property | Description and evidence |
|---|---|
| Model type | Not extracted or verified for this record. |
| Inputs | Not extracted or verified for this record. |
| Outputs | Not extracted or verified for this record. |
| Parameters | Not extracted or verified for this record. |
| Known versions | Not extracted or verified for this record. |
| Training data | Not extracted or verified for this record. |
| Context limits | Not extracted or verified for this record. |
| Access | Not extracted or verified for this record. |
| Code licence | Not extracted or verified for this record. |
| Weights licence | Not extracted or verified for this record. |
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
2 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| Evaluation in this paper Paper-specific evaluated pipeline; exact checkpoint not inferred from label Individual claims | Lightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet Table 1:, row Sourmash, column Recall; XML row6 column2 Version: PMC archival version PMC11185576.2 | source checked automated source review · 2026-09-17 Audit detailsPrimary-source transcription and separate automated review. No human sign-off or experimental reproduction. Field: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| Introduction Sourmash as evaluated in the cited study. Paper-specific evaluated pipeline; exact checkpoint not inferred from label Individual claims | Lightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet Table 1:, row Sourmash, column Recall; XML row6 column2 Version: PMC archival version PMC11185576.2 | source checked automated source review · 2026-09-17 Audit detailsPrimary-source transcription and separate automated review. No human sign-off or experimental reproduction. Field: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
Release 2026-11-21-c8bea25e5abb · Record review: needs review
Technical metadata for this record is tracked under stable ID paper-model-1de2ec3070b2f487ce.
Sourmash. Rewire biological model benchmark database, release 2026-11-21-c8bea25e5abb. https://benchmarks.rewirebio.io/database/configuration/paper-model-1de2ec3070b2f487ce/
Release 2026-11-21-c8bea25e5abb. Rankings and values change between releases, so keep the release id in the citation. Cite the original publication as well for any value you reuse: each result links its source.
The compilation and annotations made by Rewire in this release are offered under CC BY 4.0; values and text taken from cited sources stay under the terms of those sources and are not covered by this licence. Data licence