rewire.itbenchmarks
Result

0.951 Recall

Lemur: Recall on Species profiling on Dilthey2019 simulated long reads

Tested configuration
Lemur
Protocol
Species profiling on Dilthey2019 simulated long reads (Long-read taxonomic profiling)
Dataset
Species profiling on Dilthey2019 simulated long reads
Procedure
Species-level recall/precision/F 1. MetaMaps results copied from original manuscript; other tool versions reported in Methods. 200,114 reads;96 strain design,94 strains with RefSeq species representatives; average read 4,997 bp.
Evaluation
Lemur: Species profiling on Dilthey2019 simulated long reads
Coverage
scored: unreported; eligible: unreported
Uncertainty
Not reported
Evidence
Author-reported evaluation · source checkedLightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 1:, row Lemur, column Recall; XML row2 column2

A source-checked result verifies the numerical transcription, not every model or protocol detail. Evaluation metadata: needs review. Source checked does not mean independently reproduced.

Reproduction

Split
200,114 reads;96 strain design,94 strains with RefSeq species representatives; average read 4,997 bp.
Adaptation
Paper-specific evaluated pipeline; exact checkpoint not inferred from label
Scoring implementation
Not reported

No execution recipe has been verified for this exact configuration and evaluation. A benchmark's general instructions may use different inputs, splits or model settings.

Reproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

1 evidence row matching the loaded filters

Claims, original sources and review scope · Release 2026-09-29-06401fd5b220
Property and statementOriginal source and locationReview and provenance
Reported result
0.951
Individual claims
Lightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet

Original source ↗

Table 1:, row Lemur, column Recall; XML row2 column2

Version: PMC archival version PMC11185576.2
Retrieved: 2026-09-17T07:56:16.880151+00:00

source checked

Primary-table transcription and separate automated source review · 2026-09-17

author reported

Audit details

Source checked does not mean experimentally reproduced.

Field: attributes.printed_value

Source artifact SHA-256: 4afb9195da447916eb6f733816e3640741c7ade08ea8920d205c3be7b3cce27a

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Sources and history

View linked audit checks and correction history

Release 2026-09-29-06401fd5b220 · Record review: source checked

1 source records and release historyDownload this release
Technical metadata and extraction receipts

Stable ID: paper-result-80f8cca2c2d9379a1a

areas
microbes-communities
tasks
Long-read taxonomic profiling
printed value
0.951
numeric value
0.951
metric
Recall
metric direction
higher
unit
fraction
uncertainty
Not reported
eligible count
Not reported
scored count
Not reported
reported population
Not reported
source locator
Table 1:, row Lemur, column Recall; XML row2 column2
source occurrences
source id: part2-lemur-magnet-2024; locator: Table 1:, row Lemur, column Recall; XML row2 column2
review
method: Primary-table transcription and separate automated source review; date: 2026-09-17; note: Source checked does not mean experimentally reproduced.
missing metadata
scored count: unreported; eligible count: unextracted; checkpoint revision: unextracted; uncertainty: unreported
Related records

Suggest a correction