Result

0.796 F1 macro-weighted

SPIN + ESM2-35M · F1 macro-weighted · TRX

Tested pipeline: SPIN + ESM2-35M
Task: protein function annotation
Dataset: TRX
Procedure: frozen ESM2-35M backbone in SPIN
Evaluation: SPIN + ESM2-35M: protein function annotation
Coverage: scored: unreported; eligible: unreported
Uncertainty: Not reported
Evidence: Author-reported evaluation · source checkedScaling the profile of life by function with SPIN · Table 1, ESM2-35M Test row, F1_m-w column

A source-checked result verifies the numerical transcription, not every model or protocol detail. Evaluation metadata: needs review. Source checked does not mean independently reproduced.

Reproduction

Split: test set
Adaptation: Not reported
Scoring implementation: Not reported

No execution recipe has been verified for this exact configuration and evaluation. A benchmark's general instructions may use different inputs, splits or model settings.

Access requirements and official instructions: protein function annotation

Reproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

1 evidence row matching the loaded filters

Claims, original sources and review scope · Release 2026-09-29-06401fd5b220
Property and statement	Original source and location	Review and provenance
attributes.printed_value 0.796 Individual claims	Scaling the profile of life by function with SPIN Original source ↗ Table 1, ESM2-35M Test row, F1_m-w column Version: journal full text in PMC Retrieved: 2026-09-16T10:38:57.558225+00:00	source checked independent ai table review · 2026-09-16T10:38:57.558225+00:00 author reported Audit details Resolved Test group and macro-weighted F1 subcolumn (0.796) for frozen ESM2-35M in SPIN. Test weighted accuracy is 0.798. Methods define inverse-frequency class weighting for macro-weighted F1. Field: `attributes.printed_value` Claim: claim-b2-spin-protein-function-2026 Source artifact SHA-256: `9701843e93bf7fa3ead71e19693fb07d483f1022379871adfb04486783722a9d` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact Extraction artifact SHA-256: `9701843e93bf7fa3ead71e19693fb07d483f1022379871adfb04486783722a9d` Extraction artifact

All evidence (CSV)All evidence (JSONL)How to read the evidence

Sources and history

View linked audit checks and correction history

Release 2026-09-29-06401fd5b220 · Record review: source checked

1 source records and release history

Scaling the profile of life by function with SPIN · Original source · journal full text in PMC

Download this release

Technical metadata and extraction receipts

Stable ID: b2-spin-protein-function-2026

areas: proteins-complexes
tasks: protein function annotation
printed value: 0.796
numeric value: 0.796
metric: F1 macro-weighted
metric direction: unknown
unit: fraction
uncertainty: Not reported
source locator: Table 1, ESM2-35M Test row, F1_m-w column
review: method: independent_ai_table_review; reviewer: Codex secondary table review; reviewed at: 2026-09-16T10:38:57.558225+00:00; notes: Resolved Test group and macro-weighted F1 subcolumn (0.796) for frozen ESM2-35M in SPIN. Test weighted accuracy is 0.798. Methods define inverse-frequency class weighting for macro-weighted F1.; evidence: Original PMC XML table headers, row groups and caption inspected; printed value 0.796.; artifact sha256: 9701843e93bf7fa3ead71e19693fb07d483f1022379871adfb04486783722a9d; retrieval url: https://www.ebi.ac.uk/europepmc/webservices/rest/PMC12970593/fullTextXML
legacy id: b2-spin-protein-function-2026
legacy row: id: b2-spin-protein-function-2026; paper id: spin-protein-function-2026; domain id: proteins-complexes; task: protein function annotation; model: SPIN + ESM2-35M; model version: ESM2-35M frozen; dataset: TRX; dataset version: Not reported; split: test set; metric: F1 macro-weighted; value: 0.796; unit: fraction; uncertainty: Not reported; protocol: frozen ESM2-35M backbone in SPIN; source locator: Table 1, ESM2-35M Test row, F1_m-w column; source url: https://pmc.ncbi.nlm.nih.gov/articles/PMC12970593/; evaluation origin: author_reported; reviewed utc: 2026-09-15T23:33:26Z
missing metadata: dataset version: not_reported_in_legacy_extract; uncertainty: not_reported_in_legacy_extract

Related records

evaluation: SPIN + ESM2-35M: protein function annotation
subject: Reported F1 macro-weighted for SPIN + ESM2-35M

Suggest a correction