Model type
Pretrained splice-usage specialist ensemble
This MFASS evaluation uses Pangolin with masking disabled, scoring variants in genomic context.
Schematic of the pinned MFASS configuration; this does not generalise to every member of the model family.
Pretrained splice-usage specialist ensemble
Variant genomic coordinates, GRCh38 reference and GENCODE annotation
Maximum absolute predicted splice-usage change
Public pinned runner with external reference, annotation and model dependencies.
limited source coverage · Automated source review, 2026-09-16. All specifications and missing details
1 evaluation · 3 results. Different protocols are not a single leaderboard.
Applied filters: All linked evaluations
| Tested configuration | Protocol and dataset | Finding | Evidence and details |
|---|---|---|---|
| Configuration: Pangolin · mask=False | Protocol: MFASS v2 Dataset: MFASS v2 eligible assay cohort | 0.876 auroc fraction · higher Uncertainty: Not reported Coverage: 8301/8324 | Rewire evaluation · Independently reproducedMethods, coverage and sourcePangolin · mask=False on MFASS v2 Unchanged specialist run in genomic context with GENCODE v44; zero-shot on MFASS assay labels. Point metrics use the scored subset. Aggregation: Not reported MFASS v2 pinned rewire artifacts · benchmarks/mfass/results/pangolin-maskFalse.json :: auroc |
| Configuration: Pangolin · mask=False | Protocol: MFASS v2 Dataset: MFASS v2 eligible assay cohort | 0.389 average_precision fraction · higher Uncertainty: Not reported Coverage: 8301/8324 | Rewire evaluation · Independently reproducedMethods, coverage and sourcePangolin · mask=False on MFASS v2 Unchanged specialist run in genomic context with GENCODE v44; zero-shot on MFASS assay labels. Point metrics use the scored subset. Aggregation: Not reported MFASS v2 pinned rewire artifacts · benchmarks/mfass/results/pangolin-maskFalse.json :: average_precision |
| Configuration: Pangolin · mask=False | Protocol: MFASS v2 Dataset: MFASS v2 eligible assay cohort | 0.65 precision_at_100 fraction · higher Uncertainty: Not reported Coverage: 8301/8324 | Rewire evaluation · Independently reproducedMethods, coverage and sourcePangolin · mask=False on MFASS v2 Unchanged specialist run in genomic context with GENCODE v44; zero-shot on MFASS assay labels. Point metrics use the scored subset. Aggregation: Not reported MFASS v2 pinned rewire artifacts · benchmarks/mfass/results/pangolin-maskFalse.json :: precision_at_100 |
Source checking is not independent reproduction. Release 2026-09-29-06401fd5b220.
Related profile: Pangolin. This page retains the exact record and its evaluation context.
Underlying model: Pangolin. Results on this page belong to this configuration and its evaluated settings.
The runner uses the specified reference and GENCODE annotation to predict changes in splice strength. The mask=False choice retains changes that annotation-based masking would remove. These specialist predictions were retained unchanged in the corrected v2 comparison.
Pinned MFASS runner source rechecked at bee9133b83f3aedaf2bbb9013f1875515845607e. Existing numerical records and historical artifacts remain unchanged; no new run was performed.
Stable record: rewire-model-pangolin-maskfalseExplanatory profile: limited source coverage · Automated source review, 2026-09-16. Review applies to the cited claims; unresolved fields are listed below. Numerical results retain their own review status.
| Property | Description and evidence |
|---|---|
| Model type | Pretrained splice-usage specialist ensembleSourcesMFASS v2 run_pangolin.py · run_pangolin.py; module documentation, main() configuration and scoring procedure |
| Architecture / procedure | Official 12-model Pangolin ensemble; use maximum absolute predicted splice-usage change with masking disabled.SourcesMFASS v2 run_pangolin.py · run_pangolin.py; module documentation, main() configuration and scoring procedure |
| Biological inputs | Variant genomic coordinates, GRCh38 reference and GENCODE annotationSourcesMFASS v2 run_pangolin.py · run_pangolin.py; module documentation, main() configuration and scoring procedure |
| Outputs | Maximum absolute predicted splice-usage changeSourcesMFASS v2 run_pangolin.py · run_pangolin.py; module documentation, main() configuration and scoring procedure |
| Parameters | An aggregate parameter total for this exact evaluated configuration is not established by the inspected sources. · Not reported in inspected sourcesSourcesMFASS v2 run_pangolin.py · Pinned runner configuration and implementation; inspected for aggregate parameter count (component sizes are not added without an exact configuration) |
| Training data / fitting | No fitting on MFASS assay outcomes in this runner. Upstream training overlap at assayed exons remains unchecked.SourcesMFASS v2 run_pangolin.py · run_pangolin.py; module documentation, main() configuration and scoring procedure |
| Context limits | 10,000-bp genomic context and 50-base scoring distance in the recorded configuration.SourcesMFASS v2 run_pangolin.py · run_pangolin.py; module documentation, main() configuration and scoring procedure |
| Known versions / configuration | Pangolin official final.{1,2,3}.{0,2,4,6}.3.v2 ensemble; mask=FalseSourcesMFASS v2 run_pangolin.py · run_pangolin.py; module documentation, main() configuration and scoring procedure |
| Access | Public pinned runner with external reference, annotation and model dependencies.SourcesMFASS v2 run_pangolin.py · run_pangolin.py; module documentation, main() configuration and scoring procedure |
| Code licence | MIT for the Rewire runner at the reviewed revision. Upstream Pangolin: GPLv3. These are separate component licences.Sources (2)Rewire benchmark runner licence; github.com/tkzeng/Pangolin LICENSE · LICENSE; complete MIT grant; upstream LICENSE |
| Weights licence | A separate grant specifically naming the Pangolin weight files is not stated in the inspected README or repository GPL licence; code and weight scope require clarification. · Not reported in inspected sourcesSourcesgithub.com/tkzeng/Pangolin README.md · README.md; model installation and full repository LICENSE |
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
23 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| Diagram caption Schematic of the pinned MFASS configuration; this does not generalise to every member of the model family. Individual claims | MFASS v2 pinned rewire artifacts benchmarks/mfass/README.md, MFASS-v2 results; results/pangolin-maskFalse.json, config and notes at bee9133b83f3aedaf2bbb9013f1875515845607e Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-16 Audit detailsPinned MFASS runner source rechecked at bee9133b83f3aedaf2bbb9013f1875515845607e. Existing numerical records and historical artifacts remain unchanged; no new run was performed. Field: Source artifact SHA-256: Hash scope: Local imported data/benchmark-runs/mfass-v2.json; not the upstream repository or result-file hash |
Diagram steps
| MFASS v2 pinned rewire artifacts benchmarks/mfass/README.md, MFASS-v2 results; results/pangolin-maskFalse.json, config and notes at bee9133b83f3aedaf2bbb9013f1875515845607e Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-16 Audit detailsPinned MFASS runner source rechecked at bee9133b83f3aedaf2bbb9013f1875515845607e. Existing numerical records and historical artifacts remain unchanged; no new run was performed. Field: Source artifact SHA-256: Hash scope: Local imported data/benchmark-runs/mfass-v2.json; not the upstream repository or result-file hash |
| Diagram title Evaluated pipeline Individual claims | MFASS v2 pinned rewire artifacts benchmarks/mfass/README.md, MFASS-v2 results; results/pangolin-maskFalse.json, config and notes at bee9133b83f3aedaf2bbb9013f1875515845607e Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-16 Audit detailsPinned MFASS runner source rechecked at bee9133b83f3aedaf2bbb9013f1875515845607e. Existing numerical records and historical artifacts remain unchanged; no new run was performed. Field: Source artifact SHA-256: Hash scope: Local imported data/benchmark-runs/mfass-v2.json; not the upstream repository or result-file hash |
| Model type Pretrained splice-usage specialist ensemble Individual claims | MFASS v2 run_pangolin.py run_pangolin.py; module documentation, main() configuration and scoring procedure Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-16 Audit detailsPinned MFASS runner source rechecked at bee9133b83f3aedaf2bbb9013f1875515845607e. Existing numerical records and historical artifacts remain unchanged; no new run was performed. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Architecture / procedure Official 12-model Pangolin ensemble; use maximum absolute predicted splice-usage change with masking disabled. Individual claims | MFASS v2 run_pangolin.py run_pangolin.py; module documentation, main() configuration and scoring procedure Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-16 Audit detailsPinned MFASS runner source rechecked at bee9133b83f3aedaf2bbb9013f1875515845607e. Existing numerical records and historical artifacts remain unchanged; no new run was performed. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Weights licence A separate grant specifically naming the Pangolin weight files is not stated in the inspected README or repository GPL licence; code and weight scope require clarification. Individual claims | github.com/tkzeng/Pangolin README.md README.md; model installation and full repository LICENSE Version: 5cf94b8db938c658391b4305cd7ce33297d44ff7 | unreported automated source review · 2026-09-16 Audit detailsPinned MFASS runner source rechecked at bee9133b83f3aedaf2bbb9013f1875515845607e. Existing numerical records and historical artifacts remain unchanged; no new run was performed. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Biological inputs Variant genomic coordinates, GRCh38 reference and GENCODE annotation Individual claims | MFASS v2 run_pangolin.py run_pangolin.py; module documentation, main() configuration and scoring procedure Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-16 Audit detailsPinned MFASS runner source rechecked at bee9133b83f3aedaf2bbb9013f1875515845607e. Existing numerical records and historical artifacts remain unchanged; no new run was performed. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Outputs Maximum absolute predicted splice-usage change Individual claims | MFASS v2 run_pangolin.py run_pangolin.py; module documentation, main() configuration and scoring procedure Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-16 Audit detailsPinned MFASS runner source rechecked at bee9133b83f3aedaf2bbb9013f1875515845607e. Existing numerical records and historical artifacts remain unchanged; no new run was performed. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Parameters An aggregate parameter total for this exact evaluated configuration is not established by the inspected sources. Individual claims | MFASS v2 run_pangolin.py Pinned runner configuration and implementation; inspected for aggregate parameter count (component sizes are not added without an exact configuration) Version: bee9133b83f3aedaf2bbb9013f1875515845607e | unreported automated source review · 2026-09-16 Audit detailsPinned MFASS runner source rechecked at bee9133b83f3aedaf2bbb9013f1875515845607e. Existing numerical records and historical artifacts remain unchanged; no new run was performed. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Training data / fitting No fitting on MFASS assay outcomes in this runner. Upstream training overlap at assayed exons remains unchecked. Individual claims | MFASS v2 run_pangolin.py run_pangolin.py; module documentation, main() configuration and scoring procedure Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-16 Audit detailsPinned MFASS runner source rechecked at bee9133b83f3aedaf2bbb9013f1875515845607e. Existing numerical records and historical artifacts remain unchanged; no new run was performed. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
View linked audit checks and correction history
Release 2026-09-29-06401fd5b220 · Record review: source checked
Stable ID: rewire-model-pangolin-maskfalse