rewirebio.iobenchmarks
Result

Precision at 100 of Pangolin · mask=False on MFASS v2 eligible assay cohort

0.65 Precision at 100

Methods

Tested configuration
Pangolin · mask=False
Protocol
MFASS v2
Dataset
MFASS v2 eligible assay cohort
Related family profiles
Pangolin
Procedure
Unchanged specialist run in genomic context with GENCODE v44; zero-shot on MFASS assay labels. Point metrics use the scored subset.
Evaluation
Pangolin · mask=False on MFASS v2
Coverage
8301/8324 scored
Uncertainty
Not reported by the source: Point estimate; see paired-comparison artifacts.
Evidence
Rewire evaluation · rerun recordedMFASS v2 pinned rewire artifacts · benchmarks/mfass/results/pangolin-maskFalse.json :: precision_at_100

A source-checked result verifies the numerical transcription, not every model or protocol detail. Evaluation metadata: rerun recorded. Source checked does not mean independently reproduced.

Reproduction

Split
split-v2.tsv
Adaptation
Not reported
Scoring implementation
Not reported

Recompute metrics from existing predictions

This mapping supports rescoring the original held-out prediction IDs under the corrected MFASS v2 protocol. It does not regenerate model predictions or establish reproduction of the published score. Preserve the reported missing-prediction coverage.

rewirebench: MFASS guide; rewirebench: MFASS protocol code · docs/mfass.md: archived predictions; protocols/mfass.py: canonical split, score and coverage

Reproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

1 evidence row matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Reported result
0.65
Individual claims
MFASS v2 pinned rewire artifacts

Original source ↗

benchmarks/mfass/results/pangolin-maskFalse.json :: precision_at_100

Version: bee9133b83f3aedaf2bbb9013f1875515845607e
Retrieved: 2026-09-16T10:50:02Z

rerun recorded

["existing-run-import"] · 2026-09-16T10:50:02Z

rewire run

Audit details

Imported existing documented own-run record, not a newly executed reproduction.

Field: attributes.printed_value

Source artifact SHA-256: a3af693afc070b39b334e359beed7f9affd76f7456a4f9264e2d1e9dab26111d

Hash scope: Local imported data/benchmark-runs/mfass-v2.json; not the upstream repository or result-file hash

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: rerun recorded

3 source records and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: rewire-result-pangolin-maskfalse-precision-at-100

areas
dna-genomes
printed value
0.65
numeric value
0.65
metric
precision-at-100
metric direction
higher
unit
fraction
source locator
benchmarks/mfass/results/pangolin-maskFalse.json :: precision_at_100
review
method: existing-run-import; reviewer: rewire-benchmark-runner; reviewed at: 2026-09-16T10:50:02Z; reviewer note: documented MFASS v2 run; note: Imported existing documented own-run record, not a newly executed reproduction.
coverage
scored: 8301; eligible: 8324
missing metadata
uncertainty: reason: unreported; note: Point estimate; see paired-comparison artifacts.
Related records

Suggest a correction