rewirebio.iobenchmarks
Evidence claim

accuracy_versus_macro_f1: cell-type-20261009-protocol-wu2025-ts-to-hlca

Descriptive fact transcribed from the pinned source.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

6 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-10-10-6e93f504adfc
Property and statementOriginal source and locationReview and provenance
attributes.field
accuracy_versus_macro_f1
Context-only references
Biology-driven insights into the power of single-cell foundation models

Original source ↗

Results 'Cross-dataset validation' paragraph 2

Version: Genome Biology 26:334, published 2025-10-03; PMC12492631 full-text XML
Retrieved: 2026-10-09T21:22:13Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.field

Source artifact SHA-256: 368051b7cda5acd4864331875a1faac6f1d68e0a209ed999e4c2ee3b25b57c2c

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

attributes.source_locator
Results 'Cross-dataset validation' paragraph 2
Context-only references
Biology-driven insights into the power of single-cell foundation models

Original source ↗

Results 'Cross-dataset validation' paragraph 2

Version: Genome Biology 26:334, published 2025-10-03; PMC12492631 full-text XML
Retrieved: 2026-10-09T21:22:13Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.source_locator

Source artifact SHA-256: 368051b7cda5acd4864331875a1faac6f1d68e0a209ed999e4c2ee3b25b57c2c

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

attributes.value
Although cross-dataset accuracy scores are all above 0.6, macro-F1 scores are much lower, which the authors read as poor handling of shifts in cell-type proportions and of rare subpopulations.
Context-only references
Biology-driven insights into the power of single-cell foundation models

Original source ↗

Results 'Cross-dataset validation' paragraph 2

Version: Genome Biology 26:334, published 2025-10-03; PMC12492631 full-text XML
Retrieved: 2026-10-09T21:22:13Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.value

Source artifact SHA-256: 368051b7cda5acd4864331875a1faac6f1d68e0a209ed999e4c2ee3b25b57c2c

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

description
Descriptive fact transcribed from the pinned source.
Context-only references
Biology-driven insights into the power of single-cell foundation models

Original source ↗

Results 'Cross-dataset validation' paragraph 2

Version: Genome Biology 26:334, published 2025-10-03; PMC12492631 full-text XML
Retrieved: 2026-10-09T21:22:13Z

not individually reviewed

No individual claim review recorded

Audit details

Field: description

Source artifact SHA-256: 368051b7cda5acd4864331875a1faac6f1d68e0a209ed999e4c2ee3b25b57c2c

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Relationship: subject
cell-type-20261009-protocol-wu2025-ts-to-hlca
Context-only references
Biology-driven insights into the power of single-cell foundation models

Original source ↗

Results 'Cross-dataset validation' paragraph 2

Version: Genome Biology 26:334, published 2025-10-03; PMC12492631 full-text XML
Retrieved: 2026-10-09T21:22:13Z

not individually reviewed

No individual claim review recorded

Audit details

Field: links:subject:cell-type-20261009-protocol-wu2025-ts-to-hlca

Source artifact SHA-256: 368051b7cda5acd4864331875a1faac6f1d68e0a209ed999e4c2ee3b25b57c2c

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

name
accuracy_versus_macro_f1: cell-type-20261009-protocol-wu2025-ts-to-hlca
Context-only references
Biology-driven insights into the power of single-cell foundation models

Original source ↗

Results 'Cross-dataset validation' paragraph 2

Version: Genome Biology 26:334, published 2025-10-03; PMC12492631 full-text XML
Retrieved: 2026-10-09T21:22:13Z

not individually reviewed

No individual claim review recorded

Audit details

Field: name

Source artifact SHA-256: 368051b7cda5acd4864331875a1faac6f1d68e0a209ed999e4c2ee3b25b57c2c

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Sources and history

Release 2026-10-10-6e93f504adfc · Record review: source checked

1 source records and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: cell-type-20261009-claim-wu2025-macro-f1-gap

field
accuracy_versus_macro_f1
value
Although cross-dataset accuracy scores are all above 0.6, macro-F1 scores are much lower, which the authors read as poor handling of shifts in cell-type proportions and of rare subpopulations.
source locator
Results 'Cross-dataset validation' paragraph 2
review
method: source-hash-verification; ai-assisted-source-review; reviewer: claude; reviewer note: Separate Claude review agent, independent of the extractor; no human review claimed; date: 2026-10-09; artifact sha256: 368051b7cda5acd4864331875a1faac6f1d68e0a209ed999e4c2ee3b25b57c2c; retrieval url: https://www.ebi.ac.uk/europepmc/webservices/rest/PMC12492631/fullTextXML; method note: Compared the claim with the cited paragraph of the re-downloaded article XML.; note: Transcribed from the pinned article XML. Pending independent review. Independent review 2026-10-09: matches the source.
Related records

Suggest a correction