Model type
Dilated convolutional splicing predictor
SpliceAI annotates sequence variants with predicted splice acceptor and donor changes.
1 evaluation · 4 results1 open disagreement between studies involves its model
Conceptual summary of the documented data flow; optional inputs and configured downstream stages must be reported for a reproducible evaluation.
Dilated convolutional splicing predictor
VCF variants, reference FASTA and matching gene annotation, or custom one-hot-encoded sequence.
Acceptor/donor gain/loss scores and positions in VCF INFO annotations.
Official project documentation and implementation: https://github.com/illumina/SpliceAI
limited source coverage · Automated source review, 2026-09-16. All specifications and missing details
Deployment facts recorded for SpliceAI 1.3.1 · mask 1 (S1). Fields the record does not carry are marked not recorded.
1 evaluation · 4 results. Different protocols are not a single leaderboard.
Protocol: MFASS: matched GENCODE 44 canonical annotation · Dataset subset: MFASS v2 test: matched canonical annotation coverage
Sorted by AUROC (higher is better). The best value in each column is highlighted. Decimals are rounded for display; each value links to the printed value and its source.
| Tested configuration | AUROC | Average precision | Precision at 100 | Recall at 100 |
|---|---|---|---|---|
| SpliceAI 1.3.1 · mask 1 (S1)Evaluation | 0.815 | 0.313 | 0.65 | 0.207 |
Applied filters: All linked evaluations
| Tested configuration | Protocol and dataset | Finding | Evidence and details |
|---|---|---|---|
| Configuration: SpliceAI 1.3.1 · mask 1 (S1) | Protocol: MFASS: matched GENCODE 44 canonical annotation Dataset subset: MFASS v2 test: matched canonical annotation coverage | 0.815 AUROC unitless · higher Uncertainty: Not reported by the source: Point estimate; paired contrast intervals are reported separately in the source and must not be used as intervals for this individual condition. Coverage: 8297/8324 scored | Rewire evaluation · Source checkedMethods, coverage and sourceSpliceAI 1.3.1 · mask 1 (S1) on MFASS matched annotation MFASS matched GENCODE 44 canonical annotation Aggregation: Not reported MFASS matched canonical annotation v1: report.json; MFASS matched canonical annotation v1: manifest-v1.json; MFASS matched canonical annotation v1: verification.json; MFASS matched canonical annotation v1: provenance.json; MFASS matched canonical annotation v1: exclusion-verification.json · report.json: conditions.S1.metrics.auroc |
| Configuration: SpliceAI 1.3.1 · mask 1 (S1) | Protocol: MFASS: matched GENCODE 44 canonical annotation Dataset subset: MFASS v2 test: matched canonical annotation coverage | 0.313 Average precision unitless · higher Uncertainty: Not reported by the source: Point estimate; paired contrast intervals are reported separately in the source and must not be used as intervals for this individual condition. Coverage: 8297/8324 scored | Rewire evaluation · Source checkedMethods, coverage and sourceSpliceAI 1.3.1 · mask 1 (S1) on MFASS matched annotation MFASS matched GENCODE 44 canonical annotation Aggregation: Not reported MFASS matched canonical annotation v1: report.json; MFASS matched canonical annotation v1: manifest-v1.json; MFASS matched canonical annotation v1: verification.json; MFASS matched canonical annotation v1: provenance.json; MFASS matched canonical annotation v1: exclusion-verification.json · report.json: conditions.S1.metrics.average_precision_sklearn |
| Configuration: SpliceAI 1.3.1 · mask 1 (S1) | Protocol: MFASS: matched GENCODE 44 canonical annotation Dataset subset: MFASS v2 test: matched canonical annotation coverage | 0.65 Precision at 100 unitless · higher Uncertainty: Not reported by the source: Point estimate; paired contrast intervals are reported separately in the source and must not be used as intervals for this individual condition. Coverage: 8297/8324 scored | Rewire evaluation · Source checkedMethods, coverage and sourceSpliceAI 1.3.1 · mask 1 (S1) on MFASS matched annotation MFASS matched GENCODE 44 canonical annotation Aggregation: Not reported MFASS matched canonical annotation v1: report.json; MFASS matched canonical annotation v1: manifest-v1.json; MFASS matched canonical annotation v1: verification.json; MFASS matched canonical annotation v1: provenance.json; MFASS matched canonical annotation v1: exclusion-verification.json · report.json: conditions.S1.metrics.precision_at_capacity |
| Configuration: SpliceAI 1.3.1 · mask 1 (S1) | Protocol: MFASS: matched GENCODE 44 canonical annotation Dataset subset: MFASS v2 test: matched canonical annotation coverage | 0.207 Recall at 100 unitless · higher Uncertainty: Not reported by the source: Point estimate; paired contrast intervals are reported separately in the source and must not be used as intervals for this individual condition. Coverage: 8297/8324 scored | Rewire evaluation · Source checkedMethods, coverage and sourceSpliceAI 1.3.1 · mask 1 (S1) on MFASS matched annotation MFASS matched GENCODE 44 canonical annotation Aggregation: Not reported MFASS matched canonical annotation v1: report.json; MFASS matched canonical annotation v1: manifest-v1.json; MFASS matched canonical annotation v1: verification.json; MFASS matched canonical annotation v1: provenance.json; MFASS matched canonical annotation v1: exclusion-verification.json · report.json: conditions.S1.metrics.recall_at_capacity |
Source checking is not independent reproduction. Release 2026-11-21-c8bea25e5abb.
Related profile: SpliceAI. This page retains the exact record and its evaluation context.
8,297 of 8,324 held-out variants scored in every configuration (314 positives, 460 exon groups). The same 27 rows are excluded: 23 assembly-orientation mismatches and four outside the selected canonical transcript spans. Missing scores are not zero or negative predictions.
SpliceAI reads one-hot-encoded DNA through dilated convolutional residual blocks. Skip connections combine features at different depths, and a softmax layer assigns acceptor, donor or neither probabilities to the central positions. The 10kb version requires 5kb of sequence on each side of a scored position; variant scoring compares the reference and alternate predictions.
The paper studies 80nt, 400nt, 2kb and 10kb receptive spans. Variant scoring averages five independently trained models; these are not five different assay results. SpliceAI-10k uses 5,000 flanking bases on each side. An input of length l + 10,000 produces predictions for l central positions; receptive span is distinct from maximum input length.
Inspected pinned official documentation, relevant implementation files and named primary-paper sections. Claims are limited to those artifacts. Remaining field extraction and identity conflicts are explicit; no new performance claims, model runs or human review are implied.
Stable record: discovery-model-spliceaiExplanatory profile: limited source coverage · Automated source review, 2026-09-16. Review applies to the cited claims; unresolved fields are listed below. Numerical results retain their own review status.
| Property | Description and evidence |
|---|---|
| Model type | Dilated convolutional splicing predictorSources (2)illumina/SpliceAI: README.md; spliceai: Primary paper PDF · Jaganathan et al., Cell 2019, STAR Methods: SpliceAI architecture and Model training and testing (pp. e2–e3); README.md: usage and License |
| Architecture | Residual one-dimensional convolutional network with dilated kernels and skip connections; a softmax head predicts acceptor, donor and neither at each central position.Sources (2)illumina/SpliceAI: README.md; spliceai: Primary paper PDF · Jaganathan et al., Cell 2019, STAR Methods: SpliceAI architecture and Model training and testing (pp. e2–e3); README.md: usage and License |
| Inputs | VCF variants, reference FASTA and matching gene annotation, or custom one-hot-encoded sequence.Sources (2)illumina/SpliceAI: README.md; spliceai: Primary paper PDF · Jaganathan et al., Cell 2019, STAR Methods: SpliceAI architecture and Model training and testing (pp. e2–e3); README.md: usage and License |
| Outputs | Acceptor/donor gain/loss scores and positions in VCF INFO annotations.Sources (2)illumina/SpliceAI: README.md; spliceai: Primary paper PDF · Jaganathan et al., Cell 2019, STAR Methods: SpliceAI architecture and Model training and testing (pp. e2–e3); README.md: usage and License |
| Parameters | The original STAR Methods specifies residual blocks, dilation and receptive spans, but does not state a complete parameter count for each released five-model scoring ensemble. · Not reported in inspected sourcesSources (2)illumina/SpliceAI: README.md; spliceai: Primary paper PDF · Jaganathan et al., Cell 2019, STAR Methods: SpliceAI architecture and Model training and testing (pp. e2–e3); README.md: usage and License |
| Known versions | The paper studies 80nt, 400nt, 2kb and 10kb receptive spans. Variant scoring averages five independently trained models; these are not five different assay results.Sources (2)illumina/SpliceAI: README.md; spliceai: Primary paper PDF · Jaganathan et al., Cell 2019, STAR Methods: SpliceAI architecture and Model training and testing (pp. e2–e3); README.md: usage and License |
| Training data | Human GRCh37 sequence and GENCODE V24lift37 principal protein-coding transcripts, split by chromosome with non-paralogous held-out test genes. The paper distinguishes GENCODE-only training from GTEx-junction-augmented models used for variant analyses.Sources (2)illumina/SpliceAI: README.md; spliceai: Primary paper PDF · Jaganathan et al., Cell 2019, STAR Methods: SpliceAI architecture and Model training and testing (pp. e2–e3); README.md: usage and License |
| Training cutoff | GENCODE V24lift37 on GRCh37 defines the documented transcript annotations. GTEx-augmented training is separately described; the paper does not give one common latest-data date for both variants.Sources (2)illumina/SpliceAI: README.md; spliceai: Primary paper PDF · Jaganathan et al., Cell 2019, STAR Methods: SpliceAI architecture and Model training and testing (pp. e2–e3); README.md: usage and License |
| Context limits | SpliceAI-10k uses 5,000 flanking bases on each side. An input of length l + 10,000 produces predictions for l central positions; receptive span is distinct from maximum input length.Sources (2)illumina/SpliceAI: README.md; spliceai: Primary paper PDF · Jaganathan et al., Cell 2019, STAR Methods: SpliceAI architecture and Model training and testing (pp. e2–e3); README.md: usage and License |
| Weights licence | CC-BY-NC-4.0 for trained models; commercial use requires a separate licence. Code is PolyForm Strict 1.0.0.Sources (2)illumina/SpliceAI: README.md; spliceai: Primary paper PDF · Jaganathan et al., Cell 2019, STAR Methods: SpliceAI architecture and Model training and testing (pp. e2–e3); README.md: usage and License |
| Access | Official project documentation and implementation: https://github.com/illumina/SpliceAISources (2)illumina/SpliceAI: README.md; spliceai: Primary paper PDF · Jaganathan et al., Cell 2019, STAR Methods: SpliceAI architecture and Model training and testing (pp. e2–e3); README.md: usage and License |
| Code licence | PolyForm Strict 1.0.0 for code; trained weights have separate terms.Sourcesillumina/SpliceAI: LICENSE · LICENSE: licence text |
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
10 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
Facets: method types1 values
| MFASS matched canonical annotation v1: exclusion-verification.json SpliceAI and Pangolin (configuration_of links) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 4be7a98e2553fa2378c29625b13eb3e8ac2e58fb | conflicting claim ["automated-source-review"] · 2026-10-12 Audit detailsCorrect the method type from none to supervised_machine_learning (use-case baseline review 2026-10-12, table 2). Evidence from docs/reviews/use-cases/baselines-2026-10-12.md. Independent review 2026-10-12: approved. See docs/reviews/2026-10-12-method-type-corrections.md. Conflicting source claim: Field: Claim: metadata-correction-tags-20261012-b646843ca9de0643817d Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Facets: method types1 values
| MFASS matched canonical annotation v1: manifest-v1.json SpliceAI and Pangolin (configuration_of links) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 093fd1ae198c80ce34408d84d6543bca4fc538f2 | conflicting claim ["automated-source-review"] · 2026-10-12 Audit detailsCorrect the method type from none to supervised_machine_learning (use-case baseline review 2026-10-12, table 2). Evidence from docs/reviews/use-cases/baselines-2026-10-12.md. Independent review 2026-10-12: approved. See docs/reviews/2026-10-12-method-type-corrections.md. Conflicting source claim: Field: Claim: metadata-correction-tags-20261012-b646843ca9de0643817d Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Facets: method types1 values
| MFASS matched canonical annotation v1: provenance.json SpliceAI and Pangolin (configuration_of links) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 093fd1ae198c80ce34408d84d6543bca4fc538f2 | conflicting claim ["automated-source-review"] · 2026-10-12 Audit detailsCorrect the method type from none to supervised_machine_learning (use-case baseline review 2026-10-12, table 2). Evidence from docs/reviews/use-cases/baselines-2026-10-12.md. Independent review 2026-10-12: approved. See docs/reviews/2026-10-12-method-type-corrections.md. Conflicting source claim: Field: Claim: metadata-correction-tags-20261012-b646843ca9de0643817d Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Facets: method types1 values
| MFASS matched canonical annotation v1: report.json SpliceAI and Pangolin (configuration_of links) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 093fd1ae198c80ce34408d84d6543bca4fc538f2 | conflicting claim ["automated-source-review"] · 2026-10-12 Audit detailsCorrect the method type from none to supervised_machine_learning (use-case baseline review 2026-10-12, table 2). Evidence from docs/reviews/use-cases/baselines-2026-10-12.md. Independent review 2026-10-12: approved. See docs/reviews/2026-10-12-method-type-corrections.md. Conflicting source claim: Field: Claim: metadata-correction-tags-20261012-b646843ca9de0643817d Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Facets: method types1 values
| MFASS matched canonical annotation v1: verification.json SpliceAI and Pangolin (configuration_of links) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 093fd1ae198c80ce34408d84d6543bca4fc538f2 | conflicting claim ["automated-source-review"] · 2026-10-12 Audit detailsCorrect the method type from none to supervised_machine_learning (use-case baseline review 2026-10-12, table 2). Evidence from docs/reviews/use-cases/baselines-2026-10-12.md. Independent review 2026-10-12: approved. See docs/reviews/2026-10-12-method-type-corrections.md. Conflicting source claim: Field: Claim: metadata-correction-tags-20261012-b646843ca9de0643817d Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Relationship: configuration of discovery-model-spliceai Individual claims | MFASS matched canonical annotation v1: exclusion-verification.json manifest-v1.json: study and conditions Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 4be7a98e2553fa2378c29625b13eb3e8ac2e58fb | source checked ["execution-evidence-review"] · 2026-09-25T11:24:56Z Audit detailsComputational source, coverage and metric checks only; not independent human review or published-score reproduction. Field: Claim: rewire-mfass-matched-v1-configuration-s1-variant-of-discovery-model-spliceai Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Relationship: configuration of discovery-model-spliceai Individual claims | MFASS matched canonical annotation v1: manifest-v1.json manifest-v1.json: study and conditions Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 093fd1ae198c80ce34408d84d6543bca4fc538f2 | source checked ["execution-evidence-review"] · 2026-09-25T11:24:56Z Audit detailsComputational source, coverage and metric checks only; not independent human review or published-score reproduction. Field: Claim: rewire-mfass-matched-v1-configuration-s1-variant-of-discovery-model-spliceai Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Relationship: configuration of discovery-model-spliceai Individual claims | MFASS matched canonical annotation v1: provenance.json manifest-v1.json: study and conditions Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 093fd1ae198c80ce34408d84d6543bca4fc538f2 | source checked ["execution-evidence-review"] · 2026-09-25T11:24:56Z Audit detailsComputational source, coverage and metric checks only; not independent human review or published-score reproduction. Field: Claim: rewire-mfass-matched-v1-configuration-s1-variant-of-discovery-model-spliceai Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Relationship: configuration of discovery-model-spliceai Individual claims | MFASS matched canonical annotation v1: report.json manifest-v1.json: study and conditions Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 093fd1ae198c80ce34408d84d6543bca4fc538f2 | source checked ["execution-evidence-review"] · 2026-09-25T11:24:56Z Audit detailsComputational source, coverage and metric checks only; not independent human review or published-score reproduction. Field: Claim: rewire-mfass-matched-v1-configuration-s1-variant-of-discovery-model-spliceai Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Relationship: configuration of discovery-model-spliceai Individual claims | MFASS matched canonical annotation v1: verification.json manifest-v1.json: study and conditions Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 093fd1ae198c80ce34408d84d6543bca4fc538f2 | source checked ["execution-evidence-review"] · 2026-09-25T11:24:56Z Audit detailsComputational source, coverage and metric checks only; not independent human review or published-score reproduction. Field: Claim: rewire-mfass-matched-v1-configuration-s1-variant-of-discovery-model-spliceai Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Release 2026-11-21-c8bea25e5abb · Record review: source checked
Technical metadata for this record is tracked under stable ID rewire-mfass-matched-v1-configuration-s1.
Source locator: manifest-v1.json: conditions.S1; code.spliceai
SpliceAI 1.3.1 · mask 1 (S1). Rewire biological model benchmark database, release 2026-11-21-c8bea25e5abb. https://benchmarks.rewirebio.io/database/configuration/rewire-mfass-matched-v1-configuration-s1/
Release 2026-11-21-c8bea25e5abb. Rankings and values change between releases, so keep the release id in the citation. Cite the original publication as well for any value you reuse: each result links its source.
The compilation and annotations made by Rewire in this release are offered under CC BY 4.0; values and text taken from cited sources stay under the terms of those sources and are not covered by this licence. Data licence