Model type
Pretrained splice-site specialist ensemble
This MFASS evaluation uses the official SpliceAI 1.3.1 five-model ensemble in genomic context.
Schematic of the pinned MFASS configuration; this does not generalise to every member of the model family.
Pretrained splice-site specialist ensemble
Variant genomic coordinates and GRCh38 reference/annotation
Maximum splice acceptor/donor gain/loss delta score
Public pinned benchmark runner with external genome and SpliceAI dependencies.
limited source coverage · Automated source review, 2026-09-16. All specifications and missing details
1 evaluation · 3 results. Different protocols are not a single leaderboard.
Applied filters: All linked evaluations
| Tested configuration | Protocol and dataset | Finding | Evidence and details |
|---|---|---|---|
| Configuration: SpliceAI 1.3.1 | Protocol: MFASS v2 Dataset: MFASS v2 eligible assay cohort | 0.806 auroc fraction · higher Uncertainty: Not reported Coverage: 8194/8324 | Rewire evaluation · Independently reproducedMethods, coverage and sourceUnchanged specialist run in genomic context with bundled annotation; zero-shot on MFASS assay labels. Point metrics use the scored subset. Aggregation: Not reported MFASS v2 pinned rewire artifacts · benchmarks/mfass/results/spliceai-1.3.1.json :: auroc |
| Configuration: SpliceAI 1.3.1 | Protocol: MFASS v2 Dataset: MFASS v2 eligible assay cohort | 0.299 average_precision fraction · higher Uncertainty: Not reported Coverage: 8194/8324 | Rewire evaluation · Independently reproducedMethods, coverage and sourceUnchanged specialist run in genomic context with bundled annotation; zero-shot on MFASS assay labels. Point metrics use the scored subset. Aggregation: Not reported MFASS v2 pinned rewire artifacts · benchmarks/mfass/results/spliceai-1.3.1.json :: average_precision |
| Configuration: SpliceAI 1.3.1 | Protocol: MFASS v2 Dataset: MFASS v2 eligible assay cohort | 0.64 precision_at_100 fraction · higher Uncertainty: Not reported Coverage: 8194/8324 | Rewire evaluation · Independently reproducedMethods, coverage and sourceUnchanged specialist run in genomic context with bundled annotation; zero-shot on MFASS assay labels. Point metrics use the scored subset. Aggregation: Not reported MFASS v2 pinned rewire artifacts · benchmarks/mfass/results/spliceai-1.3.1.json :: precision_at_100 |
Source checking is not independent reproduction. Release 2026-09-29-06401fd5b220.
Related profile: SpliceAI. This page retains the exact record and its evaluation context.
Underlying model: SpliceAI. Results on this page belong to this configuration and its evaluated settings.
The runner scores variants against GRCh38 with bundled annotations and unmasked outputs. It ranks variants by the largest acceptor/donor gain or loss delta score. Its specialist predictions were retained unchanged for the corrected v2 comparison.
Pinned MFASS runner source rechecked at bee9133b83f3aedaf2bbb9013f1875515845607e. Existing numerical records and historical artifacts remain unchanged; no new run was performed.
Stable record: rewire-model-spliceai-1-3-1Explanatory profile: limited source coverage · Automated source review, 2026-09-16. Review applies to the cited claims; unresolved fields are listed below. Numerical results retain their own review status.
| Property | Description and evidence |
|---|---|
| Model type | Pretrained splice-site specialist ensembleSourcesMFASS v2 run_spliceai.py · run_spliceai.py; module documentation, main() configuration and scoring procedure |
| Architecture / procedure | Official five-model SpliceAI ensemble; score is max(DS_AG, DS_AL, DS_DG, DS_DL), with masking disabled.SourcesMFASS v2 run_spliceai.py · run_spliceai.py; module documentation, main() configuration and scoring procedure |
| Biological inputs | Variant genomic coordinates and GRCh38 reference/annotationSourcesMFASS v2 run_spliceai.py · run_spliceai.py; module documentation, main() configuration and scoring procedure |
| Outputs | Maximum splice acceptor/donor gain/loss delta scoreSourcesMFASS v2 run_spliceai.py · run_spliceai.py; module documentation, main() configuration and scoring procedure |
| Parameters | An aggregate parameter total for this exact evaluated configuration is not established by the inspected sources. · Not reported in inspected sourcesSourcesMFASS v2 run_spliceai.py · Pinned runner configuration and implementation; inspected for aggregate parameter count (component sizes are not added without an exact configuration) |
| Training data / fitting | No MFASS-label fitting by the runner. Upstream transcript overlap with assayed exons remains unchecked.SourcesMFASS v2 run_spliceai.py · run_spliceai.py; module documentation, main() configuration and scoring procedure |
| Context limits | 10,000-bp genomic context; distance_D=50; mask_M=0.SourcesMFASS v2 run_spliceai.py · run_spliceai.py; module documentation, main() configuration and scoring procedure |
| Known versions / configuration | SpliceAI 1.3.1; bundled spliceai1–5.h5 weightsSourcesMFASS v2 run_spliceai.py · run_spliceai.py; module documentation, main() configuration and scoring procedure |
| Access | Public pinned benchmark runner with external genome and SpliceAI dependencies.SourcesMFASS v2 run_spliceai.py · run_spliceai.py; module documentation, main() configuration and scoring procedure |
| Code licence | MIT for the Rewire runner at the reviewed revision. Upstream SpliceAI: PolyForm Strict 1.0.0. These are separate component licences.Sources (2)Rewire benchmark runner licence; github.com/Illumina/SpliceAI LICENSE · LICENSE; complete MIT grant; upstream LICENSE |
| Weights licence | SpliceAI trained models are CC BY-NC 4.0 for academic/non-commercial use; commercial use requires separate Illumina terms.Sourcesgithub.com/Illumina/SpliceAI README.md · README.md; License |
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
23 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| Diagram caption Schematic of the pinned MFASS configuration; this does not generalise to every member of the model family. Individual claims | MFASS v2 pinned rewire artifacts benchmarks/mfass/README.md, MFASS-v2 results; results/spliceai-1.3.1.json, description, config and notes at bee9133b83f3aedaf2bbb9013f1875515845607e Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-16 Audit detailsPinned MFASS runner source rechecked at bee9133b83f3aedaf2bbb9013f1875515845607e. Existing numerical records and historical artifacts remain unchanged; no new run was performed. Field: Source artifact SHA-256: Hash scope: Local imported data/benchmark-runs/mfass-v2.json; not the upstream repository or result-file hash |
Diagram steps
| MFASS v2 pinned rewire artifacts benchmarks/mfass/README.md, MFASS-v2 results; results/spliceai-1.3.1.json, description, config and notes at bee9133b83f3aedaf2bbb9013f1875515845607e Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-16 Audit detailsPinned MFASS runner source rechecked at bee9133b83f3aedaf2bbb9013f1875515845607e. Existing numerical records and historical artifacts remain unchanged; no new run was performed. Field: Source artifact SHA-256: Hash scope: Local imported data/benchmark-runs/mfass-v2.json; not the upstream repository or result-file hash |
| Diagram title Evaluated pipeline Individual claims | MFASS v2 pinned rewire artifacts benchmarks/mfass/README.md, MFASS-v2 results; results/spliceai-1.3.1.json, description, config and notes at bee9133b83f3aedaf2bbb9013f1875515845607e Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-16 Audit detailsPinned MFASS runner source rechecked at bee9133b83f3aedaf2bbb9013f1875515845607e. Existing numerical records and historical artifacts remain unchanged; no new run was performed. Field: Source artifact SHA-256: Hash scope: Local imported data/benchmark-runs/mfass-v2.json; not the upstream repository or result-file hash |
| Model type Pretrained splice-site specialist ensemble Individual claims | MFASS v2 run_spliceai.py run_spliceai.py; module documentation, main() configuration and scoring procedure Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-16 Audit detailsPinned MFASS runner source rechecked at bee9133b83f3aedaf2bbb9013f1875515845607e. Existing numerical records and historical artifacts remain unchanged; no new run was performed. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Architecture / procedure Official five-model SpliceAI ensemble; score is max(DS_AG, DS_AL, DS_DG, DS_DL), with masking disabled. Individual claims | MFASS v2 run_spliceai.py run_spliceai.py; module documentation, main() configuration and scoring procedure Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-16 Audit detailsPinned MFASS runner source rechecked at bee9133b83f3aedaf2bbb9013f1875515845607e. Existing numerical records and historical artifacts remain unchanged; no new run was performed. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Weights licence SpliceAI trained models are CC BY-NC 4.0 for academic/non-commercial use; commercial use requires separate Illumina terms. Individual claims | github.com/Illumina/SpliceAI README.md README.md; License Version: 03f42437aaf56dc5dfd822c4ccee5aec1a705079 | source checked automated source review · 2026-09-16 Audit detailsPinned MFASS runner source rechecked at bee9133b83f3aedaf2bbb9013f1875515845607e. Existing numerical records and historical artifacts remain unchanged; no new run was performed. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Biological inputs Variant genomic coordinates and GRCh38 reference/annotation Individual claims | MFASS v2 run_spliceai.py run_spliceai.py; module documentation, main() configuration and scoring procedure Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-16 Audit detailsPinned MFASS runner source rechecked at bee9133b83f3aedaf2bbb9013f1875515845607e. Existing numerical records and historical artifacts remain unchanged; no new run was performed. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Outputs Maximum splice acceptor/donor gain/loss delta score Individual claims | MFASS v2 run_spliceai.py run_spliceai.py; module documentation, main() configuration and scoring procedure Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-16 Audit detailsPinned MFASS runner source rechecked at bee9133b83f3aedaf2bbb9013f1875515845607e. Existing numerical records and historical artifacts remain unchanged; no new run was performed. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Parameters An aggregate parameter total for this exact evaluated configuration is not established by the inspected sources. Individual claims | MFASS v2 run_spliceai.py Pinned runner configuration and implementation; inspected for aggregate parameter count (component sizes are not added without an exact configuration) Version: bee9133b83f3aedaf2bbb9013f1875515845607e | unreported automated source review · 2026-09-16 Audit detailsPinned MFASS runner source rechecked at bee9133b83f3aedaf2bbb9013f1875515845607e. Existing numerical records and historical artifacts remain unchanged; no new run was performed. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Training data / fitting No MFASS-label fitting by the runner. Upstream transcript overlap with assayed exons remains unchecked. Individual claims | MFASS v2 run_spliceai.py run_spliceai.py; module documentation, main() configuration and scoring procedure Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-16 Audit detailsPinned MFASS runner source rechecked at bee9133b83f3aedaf2bbb9013f1875515845607e. Existing numerical records and historical artifacts remain unchanged; no new run was performed. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
View linked audit checks and correction history
Release 2026-09-29-06401fd5b220 · Record review: source checked
Stable ID: rewire-model-spliceai-1-3-1