Result

0.376 F1

Lemur · F1 · Zymo LOG 10%

Tested configuration: Lemur
Task: Long-read taxonomic profiling
Dataset: Zymo LOG 10%
Procedure: Mean across five replicate runs on Zymo LOG 10%.
Evaluation: Lemur: Long-read taxonomic profiling
Coverage: scored: unreported; eligible: unreported
Uncertainty: Not reported
Evidence: Author-reported evaluation · source checkedLightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 3, LOG 10% / Lemur row, F1 column

A source-checked result verifies the numerical transcription, not every model or protocol detail. Evaluation metadata: needs review. Source checked does not mean independently reproduced.

Reproduction

Split: Not reported
Adaptation: Not reported
Scoring implementation: Not reported

No execution recipe has been verified for this exact configuration and evaluation. A benchmark's general instructions may use different inputs, splits or model settings.

Access requirements and official instructions: Long-read taxonomic profiling

Reproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

1 evidence row matching the loaded filters

Claims, original sources and review scope · Release 2026-09-29-06401fd5b220
Property and statement	Original source and location	Review and provenance
attributes.printed_value 0.376 Individual claims	Lightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet Original source ↗ Table 3, LOG 10% / Lemur row, F1 column Version: PMC archival version PMC11185576.2 Retrieved: 2026-09-16T10:44:03.420493+00:00	source checked independent ai table review · 2026-09-16T10:44:03.420493+00:00 author reported Audit details LOG 10% first block, F1 column. Kraken 2 row inherits dataset via rowspan; not LOG 75% or abundance Spearman. Source check verifies central value and table context, not experiment reproduction or all metadata. Field: `attributes.printed_value` Claim: claim-lit-b3-031 Source artifact SHA-256: `4afb9195da447916eb6f733816e3640741c7ade08ea8920d205c3be7b3cce27a` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact Extraction artifact SHA-256: `4afb9195da447916eb6f733816e3640741c7ade08ea8920d205c3be7b3cce27a` Extraction artifact

All evidence (CSV)All evidence (JSONL)How to read the evidence

Sources and history

View linked audit checks and correction history

Release 2026-09-29-06401fd5b220 · Record review: source checked

1 source records and release history

Lightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Original source · PMC archival version PMC11185576.2

Download this release

Technical metadata and extraction receipts

Stable ID: lit-b3-031

areas: microbes-communities
tasks: Long-read taxonomic profiling
printed value: 0.376
numeric value: 0.376
metric: F1
metric direction: unknown
unit: unitless
uncertainty: Not reported
source locator: Table 3, LOG 10% / Lemur row, F1 column
review: method: independent_ai_table_review; reviewer: Codex omics research agent; independent source-table review, not human review; reviewed at: 2026-09-16T10:44:03.420493+00:00; notes: LOG 10% first block, F1 column. Kraken 2 row inherits dataset via rowspan; not LOG 75% or abundance Spearman. Source check verifies central value and table context, not experiment reproduction or all metadata.; evidence: {"table_xml_id": "T3", "row_cells": ["LOG 10%", "Lemur", "0.500", "0.301", "0.376", "0.984"], "selected_cell_zero_based": 4, "selected_cell_xml": "<td align=\"right\" valign=\"top\" rowspan=\"1\" colspan=\"1\">0.376</td>", "caption": "Mean performance and standard deviation across 5 replicate runs of all methods on Zymo LOG, bold values show best performance. Magnet does not report relative abundance, so the Spearman’s ρ cannot be computed. Tools listed below the horizontal dashed lines (for LOG 10% and LOG 75%) focus on the taxonomic classification of reads."}; artifact sha256: 4afb9195da447916eb6f733816e3640741c7ade08ea8920d205c3be7b3cce27a; retrieval url: https://www.ebi.ac.uk/europepmc/webservices/rest/PMC11185576/fullTextXML
legacy id: lit-b3-031
legacy row: id: lit-b3-031; paper id: lemur-magnet-2024; domain id: microbes-communities; task: Long-read taxonomic profiling; model: Lemur; model version: Not reported; dataset: Zymo LOG 10%; dataset version: Not reported; split: Not reported; metric: F1; value: 0.376; unit: unitless; uncertainty: Not reported; protocol: Mean across five replicate runs on Zymo LOG 10%.; source locator: Table 3, LOG 10% / Lemur row, F1 column; source url: https://pmc.ncbi.nlm.nih.gov/articles/PMC11185576/; evaluation origin: author_reported; reviewed utc: 2026-09-15T23:29:32Z
missing metadata: model version: not_reported_in_legacy_extract; dataset version: not_reported_in_legacy_extract; split: not_reported_in_legacy_extract; uncertainty: not_reported_in_legacy_extract

Related records

evaluation: Lemur: Long-read taxonomic profiling
subject: Reported F1 for Lemur

Suggest a correction