rewire.itbenchmarks
Result

95.8 Genus-level F1

kMetaShot · Genus-level F1 · Real mock community MAGs

Tested configuration
kMetaShot
Task
Mock-community MAG taxonomy classification
Dataset
Real mock community MAGs
Procedure
Genus classification of MAGs from MegaHIT contigs; uncorrected kMetaShot.
Evaluation
kMetaShot: Mock-community MAG taxonomy classification
Coverage
scored: unreported; eligible: unreported
Uncertainty
Not reported
Evidence
Author-reported evaluation · source checkedkMetaShot: a fast and reliable taxonomy classifier for metagenome-assembled genomes · Table 2, F1-score % row, Genus kMS column

A source-checked result verifies the numerical transcription, not every model or protocol detail. Evaluation metadata: needs review. Source checked does not mean independently reproduced.

Reproduction

Split
Not reported
Adaptation
Not reported
Scoring implementation
Not reported

No execution recipe has been verified for this exact configuration and evaluation. A benchmark's general instructions may use different inputs, splits or model settings.

Reproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

1 evidence row matching the loaded filters

Claims, original sources and review scope · Release 2026-09-29-06401fd5b220
Property and statementOriginal source and locationReview and provenance
attributes.printed_value
95.83
Individual claims
kMetaShot: a fast and reliable taxonomy classifier for metagenome-assembled genomes

Original source ↗

Table 2, F1-score % row, Genus kMS column

Version: PMC archival version PMC11695915.1
Retrieved: 2026-09-16T10:44:03.417367+00:00

source checked

independent ai table review · 2026-09-16T10:44:03.417367+00:00

author reported

Audit details

Real mock sequencing table, F1-score percentage row; Genus is final three-column block, selecting kMS or Gtk rather than Species/Strain. Source check verifies central value and table context, not experiment reproduction or all metadata.

Field: attributes.printed_value

Claim: claim-lit-b3-029

Source artifact SHA-256: 4584e93ea035c1170b8756a0a52cbe99fe72e70bd09b5f1dee639ee104f78247

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Extraction artifact SHA-256: 4584e93ea035c1170b8756a0a52cbe99fe72e70bd09b5f1dee639ee104f78247

Extraction artifact

Sources and history

View linked audit checks and correction history

Release 2026-09-29-06401fd5b220 · Record review: source checked

1 source records and release historyDownload this release
Technical metadata and extraction receipts

Stable ID: lit-b3-029

areas
microbes-communities
tasks
Mock-community MAG taxonomy classification
printed value
95.83
numeric value
95.83
metric
Genus-level F1
metric direction
unknown
unit
%
uncertainty
Not reported
source locator
Table 2, F1-score % row, Genus kMS column
review
method: independent_ai_table_review; reviewer: Codex omics research agent; independent source-table review, not human review; reviewed at: 2026-09-16T10:44:03.417367+00:00; notes: Real mock sequencing table, F1-score percentage row; Genus is final three-column block, selecting kMS or Gtk rather than Species/Strain. Source check verifies central value and table context, not experiment reproduction or all metadata.; evidence: {"table_xml_id": "TB2", "row_cells": ["F1-score %", "28.13", "85.42", "86.24", "87.18", "87.72", "95.83", "89.80", "94.85"], "selected_cell_zero_based": 6, "selected_cell_xml": "<td align=\"left\" rowspan=\"1\" colspan=\"1\">95.83</td>", "caption": "Classification performance metrics measured on the real mock sequencing data."}; artifact sha256: 4584e93ea035c1170b8756a0a52cbe99fe72e70bd09b5f1dee639ee104f78247; retrieval url: https://www.ebi.ac.uk/europepmc/webservices/rest/PMC11695915/fullTextXML
legacy id
lit-b3-029
legacy row
id: lit-b3-029; paper id: kmetashot-2025; domain id: microbes-communities; task: Mock-community MAG taxonomy classification; model: kMetaShot; model version: Not reported; dataset: Real mock community MAGs; dataset version: Not reported; split: Not reported; metric: Genus-level F1; value: 95.83; unit: %; uncertainty: Not reported; protocol: Genus classification of MAGs from MegaHIT contigs; uncorrected kMetaShot.; source locator: Table 2, F1-score % row, Genus kMS column; source url: https://pmc.ncbi.nlm.nih.gov/articles/PMC11695915/; evaluation origin: author_reported; reviewed utc: 2026-09-15T23:29:32Z
missing metadata
model version: not_reported_in_legacy_extract; dataset version: not_reported_in_legacy_extract; split: not_reported_in_legacy_extract; uncertainty: not_reported_in_legacy_extract
Related records

Suggest a correction