0.299 average_precision
SpliceAI 1.3.1 · average_precision
- Tested configuration
- SpliceAI 1.3.1
- Protocol
- MFASS v2
- Dataset
- MFASS v2 eligible assay cohort
- Related family profiles
- SpliceAI
- Procedure
- Unchanged specialist run in genomic context with bundled annotation; zero-shot on MFASS assay labels. Point metrics use the scored subset.
- Evaluation
- SpliceAI 1.3.1 on MFASS v2
- Coverage
- 8194/8324
- Uncertainty
- Not reported
- Evidence
- Rewire evaluation · reproducedMFASS v2 pinned rewire artifacts · benchmarks/mfass/results/spliceai-1.3.1.json :: average_precision
A source-checked result verifies the numerical transcription, not every model or protocol detail. Evaluation metadata: reproduced. Source checked does not mean independently reproduced.
Reproduction
- Split
- split-v2.tsv
- Adaptation
- Not reported
- Scoring implementation
- Not reported
Recompute metrics from existing predictions
This mapping supports rescoring the original held-out prediction IDs under the corrected MFASS v2 protocol. It does not regenerate model predictions or establish reproduction of the published score. Preserve the reported missing-prediction coverage.
rewirebench: MFASS guide; rewirebench: MFASS protocol code · docs/mfass.md: archived predictions; protocols/mfass.py: canonical split, score and coverageReproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
1 evidence row matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| Reported result 0.2986855472760137 Individual claims | MFASS v2 pinned rewire artifacts benchmarks/mfass/results/spliceai-1.3.1.json :: average_precision Version: bee9133b83f3aedaf2bbb9013f1875515845607e | reproduced existing run import · 2026-09-16T10:50:02Z rewire run Audit detailsImported existing documented own-run record, not a newly executed reproduction. Field: Source artifact SHA-256: Hash scope: Local imported data/benchmark-runs/mfass-v2.json; not the upstream repository or result-file hash |
Sources and history
View linked audit checks and correction history
Release 2026-09-29-06401fd5b220 · Record review: reproduced
3 source records and release history
- MFASS v2 pinned rewire artifacts · Original source · bee9133b83f3aedaf2bbb9013f1875515845607e
- rewirebench: MFASS guide · Original source · f80cef7f818bec33e51b7f43ad499eb5078c8d87
- rewirebench: MFASS protocol code · Original source · f80cef7f818bec33e51b7f43ad499eb5078c8d87
Technical metadata and extraction receipts
Stable ID: rewire-result-spliceai-1-3-1-average-precision
- areas
- dna-genomes
- printed value
- 0.2986855472760137
- numeric value
- 0.2986855472760137
- metric
- average_precision
- metric direction
- higher
- unit
- fraction
- uncertainty
- Not reported
- source locator
- benchmarks/mfass/results/spliceai-1.3.1.json :: average_precision
- review
- method: existing_run_import; reviewer: rewire documented MFASS v2 run; reviewed at: 2026-09-16T10:50:02Z; notes: Imported existing documented own-run record, not a newly executed reproduction.
- coverage
- 8194/8324
- missing metadata
- uncertainty: Point estimate; see paired-comparison artifacts.
Related records
- evaluation: SpliceAI 1.3.1 on MFASS v2