rewirebio.iobenchmarks
Configuration

OpenSpliceAI (Fortier et al. 2026)

OpenSpliceAI run by the authors

6 evaluations · 24 results

Overview

An explanatory profile has not yet been reviewed for this record.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Evaluations and results

6 evaluations · 24 results. Different protocols are not a single leaderboard.

Sorted by Balanced accuracy (maximum delta score > 0.5 (Legacy Ensemble N > 1)) (higher is better). The best value in each column is highlighted. Decimals are rounded for display; each value links to the printed value and its source.

Tested configurationProtocol and datasetBalanced accuracy (maximum delta score > 0.5 (Legacy Ensemble N > 1))F1 (maximum delta score > 0.5 (Legacy Ensemble N > 1))Recall (maximum delta score > 0.5 (Legacy Ensemble N > 1))Specificity (maximum delta score > 0.5 (Legacy Ensemble N > 1))Balanced accuracy (delta score for each variant's effect type; threshold optimised per gene and algorithm for maximum accuracy (upper bound))Balanced accuracy (maximum delta score classification after legacy-tool pre-filtering (threshold not restated for this dataset))Balanced accuracy (threshold optimised per algorithm for balanced accuracy on this dataset)F1 (delta score for each variant's effect type; threshold optimised per gene and algorithm for maximum accuracy (upper bound))F1 (maximum delta score classification after legacy-tool pre-filtering (threshold not restated for this dataset))F1 (threshold optimised per algorithm for balanced accuracy on this dataset)Recall (delta score for each variant's effect type; threshold optimised per gene and algorithm for maximum accuracy (upper bound))Recall (maximum delta score classification after legacy-tool pre-filtering (threshold not restated for this dataset))Recall (threshold optimised per algorithm for balanced accuracy on this dataset)Specificity (delta score for each variant's effect type; threshold optimised per gene and algorithm for maximum accuracy (upper bound))Specificity (maximum delta score classification after legacy-tool pre-filtering (threshold not restated for this dataset))Specificity (threshold optimised per algorithm for balanced accuracy on this dataset)
OpenSpliceAI (Fortier et al. 2026)EvaluationSplice-altering variant classification, Barbosa et al. ClinVar intronic SNV benchmark (53,600 variants) (Fortier et al. Table 5), Barbosa et al. ClinVar intronic SNV benchmark (53,600 variants)0.965 (best in column)0.961 (best in column)0.932 (best in column)0.998Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
OpenSpliceAI (Fortier et al. 2026)EvaluationSplice-altering variant classification, CI-SpliceAI benchmark variant set (1,316 variants) (Fortier et al. Table 1), CI-SpliceAI benchmark variant set (1,316 variants)0.8950.8860.8160.975Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
OpenSpliceAI (Fortier et al. 2026)EvaluationSplice-altering variant classification, SPiP benchmark variant set (99,601 variants) (Fortier et al. Table 3), SPiP benchmark variant set (99,601 variants)0.7970.7240.5950.999 (best in column)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
OpenSpliceAI (Fortier et al. 2026)EvaluationSplice-altering variant classification, Barbosa et al. deep intronic pathogenic variants with matched common controls (484 variants) (Fortier et al. Table 4), Barbosa et al. deep intronic pathogenic variants with matched common controls (484 variants)Not reportedNot reportedNot reportedNot reportedNot reportedNot reported0.841Not reportedNot reported0.815Not reportedNot reported0.702Not reportedNot reported0.979
OpenSpliceAI (Fortier et al. 2026)EvaluationSplice-altering variant classification, Extended ClinVar benchmark (58,064 variants) (Fortier et al. Table 6), Extended ClinVar benchmark (58,064 variants)Not reportedNot reportedNot reportedNot reportedNot reported0.895Not reportedNot reported0.877Not reportedNot reported0.799Not reportedNot reported0.992Not reported
OpenSpliceAI (Fortier et al. 2026)EvaluationSplice-altering variant classification, Riepe et al. functional splice assay variants (213 variants, ABCA4 and MYBPC3) (Fortier et al. Table 2), Riepe et al. functional splice assay variants (213 variants, ABCA4 and MYBPC3)Not reportedNot reportedNot reportedNot reported0.746Not reportedNot reported0.741Not reportedNot reported0.672Not reportedNot reported0.819Not reportedNot reported
All 24 result rows with coverage, uncertainty and sources
Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: OpenSpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, Barbosa et al. ClinVar intronic SNV benchmark (53,600 variants) (Fortier et al. Table 5)
Dataset: Barbosa et al. ClinVar intronic SNV benchmark (53,600 variants)
0.965 Balanced accuracy (maximum delta score > 0.5 (Legacy Ensemble N > 1))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

OpenSpliceAI on the Barbosa et al. ClinVar intronic SNV benchmark (53,600 variants)

rna-splicing-20261011-fortier2026-protocol-barbosa-clinvar

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 5, row 'OpenSpliceAI', column 'Balanced Accuracy'
Configuration: OpenSpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, Barbosa et al. ClinVar intronic SNV benchmark (53,600 variants) (Fortier et al. Table 5)
Dataset: Barbosa et al. ClinVar intronic SNV benchmark (53,600 variants)
0.961 F1 (maximum delta score > 0.5 (Legacy Ensemble N > 1))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

OpenSpliceAI on the Barbosa et al. ClinVar intronic SNV benchmark (53,600 variants)

rna-splicing-20261011-fortier2026-protocol-barbosa-clinvar

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 5, row 'OpenSpliceAI', column 'F1'
Configuration: OpenSpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, Barbosa et al. ClinVar intronic SNV benchmark (53,600 variants) (Fortier et al. Table 5)
Dataset: Barbosa et al. ClinVar intronic SNV benchmark (53,600 variants)
0.932 Recall (maximum delta score > 0.5 (Legacy Ensemble N > 1))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

OpenSpliceAI on the Barbosa et al. ClinVar intronic SNV benchmark (53,600 variants)

rna-splicing-20261011-fortier2026-protocol-barbosa-clinvar

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 5, row 'OpenSpliceAI', column 'Sensitivity'
Configuration: OpenSpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, Barbosa et al. ClinVar intronic SNV benchmark (53,600 variants) (Fortier et al. Table 5)
Dataset: Barbosa et al. ClinVar intronic SNV benchmark (53,600 variants)
0.998 Specificity (maximum delta score > 0.5 (Legacy Ensemble N > 1))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

OpenSpliceAI on the Barbosa et al. ClinVar intronic SNV benchmark (53,600 variants)

rna-splicing-20261011-fortier2026-protocol-barbosa-clinvar

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 5, row 'OpenSpliceAI', column 'Specificity'
Configuration: OpenSpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, Barbosa et al. deep intronic pathogenic variants with matched common controls (484 variants) (Fortier et al. Table 4)
Dataset: Barbosa et al. deep intronic pathogenic variants with matched common controls (484 variants)
0.841 Balanced accuracy (threshold optimised per algorithm for balanced accuracy on this dataset)
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

OpenSpliceAI on the Barbosa et al. deep intronic pathogenic variants with matched common controls (484 variants)

rna-splicing-20261011-fortier2026-protocol-barbosa-deep-intronic

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 4, row 'OpenSpliceAI', column 'Balanced Accuracy'
Configuration: OpenSpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, Barbosa et al. deep intronic pathogenic variants with matched common controls (484 variants) (Fortier et al. Table 4)
Dataset: Barbosa et al. deep intronic pathogenic variants with matched common controls (484 variants)
0.815 F1 (threshold optimised per algorithm for balanced accuracy on this dataset)
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

OpenSpliceAI on the Barbosa et al. deep intronic pathogenic variants with matched common controls (484 variants)

rna-splicing-20261011-fortier2026-protocol-barbosa-deep-intronic

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 4, row 'OpenSpliceAI', column 'F1'
Configuration: OpenSpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, Barbosa et al. deep intronic pathogenic variants with matched common controls (484 variants) (Fortier et al. Table 4)
Dataset: Barbosa et al. deep intronic pathogenic variants with matched common controls (484 variants)
0.702 Recall (threshold optimised per algorithm for balanced accuracy on this dataset)
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

OpenSpliceAI on the Barbosa et al. deep intronic pathogenic variants with matched common controls (484 variants)

rna-splicing-20261011-fortier2026-protocol-barbosa-deep-intronic

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 4, row 'OpenSpliceAI', column 'Sensitivity'
Configuration: OpenSpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, Barbosa et al. deep intronic pathogenic variants with matched common controls (484 variants) (Fortier et al. Table 4)
Dataset: Barbosa et al. deep intronic pathogenic variants with matched common controls (484 variants)
0.979 Specificity (threshold optimised per algorithm for balanced accuracy on this dataset)
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

OpenSpliceAI on the Barbosa et al. deep intronic pathogenic variants with matched common controls (484 variants)

rna-splicing-20261011-fortier2026-protocol-barbosa-deep-intronic

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 4, row 'OpenSpliceAI', column 'Specificity'
Configuration: OpenSpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, CI-SpliceAI benchmark variant set (1,316 variants) (Fortier et al. Table 1)
Dataset: CI-SpliceAI benchmark variant set (1,316 variants)
0.895 Balanced accuracy (maximum delta score > 0.5 (Legacy Ensemble N > 1))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

OpenSpliceAI on the CI-SpliceAI benchmark variant set (1,316 variants)

rna-splicing-20261011-fortier2026-protocol-ci-spliceai-benchmark

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 1, row 'OpenSpliceAI', column 'Balanced Accuracy'
Configuration: OpenSpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, CI-SpliceAI benchmark variant set (1,316 variants) (Fortier et al. Table 1)
Dataset: CI-SpliceAI benchmark variant set (1,316 variants)
0.886 F1 (maximum delta score > 0.5 (Legacy Ensemble N > 1))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

OpenSpliceAI on the CI-SpliceAI benchmark variant set (1,316 variants)

rna-splicing-20261011-fortier2026-protocol-ci-spliceai-benchmark

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 1, row 'OpenSpliceAI', column 'F1'
Configuration: OpenSpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, CI-SpliceAI benchmark variant set (1,316 variants) (Fortier et al. Table 1)
Dataset: CI-SpliceAI benchmark variant set (1,316 variants)
0.816 Recall (maximum delta score > 0.5 (Legacy Ensemble N > 1))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

OpenSpliceAI on the CI-SpliceAI benchmark variant set (1,316 variants)

rna-splicing-20261011-fortier2026-protocol-ci-spliceai-benchmark

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 1, row 'OpenSpliceAI', column 'Sensitivity'
Configuration: OpenSpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, CI-SpliceAI benchmark variant set (1,316 variants) (Fortier et al. Table 1)
Dataset: CI-SpliceAI benchmark variant set (1,316 variants)
0.975 Specificity (maximum delta score > 0.5 (Legacy Ensemble N > 1))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

OpenSpliceAI on the CI-SpliceAI benchmark variant set (1,316 variants)

rna-splicing-20261011-fortier2026-protocol-ci-spliceai-benchmark

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 1, row 'OpenSpliceAI', column 'Specificity'
Configuration: OpenSpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, Extended ClinVar benchmark (58,064 variants) (Fortier et al. Table 6)
Dataset: Extended ClinVar benchmark (58,064 variants)
0.895 Balanced accuracy (maximum delta score classification after legacy-tool pre-filtering (threshold not restated for this dataset))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

OpenSpliceAI on the Extended ClinVar benchmark (58,064 variants)

rna-splicing-20261011-fortier2026-protocol-extended-clinvar

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 6, row 'OpenSpliceAI', column 'Balanced Accuracy'
Configuration: OpenSpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, Extended ClinVar benchmark (58,064 variants) (Fortier et al. Table 6)
Dataset: Extended ClinVar benchmark (58,064 variants)
0.877 F1 (maximum delta score classification after legacy-tool pre-filtering (threshold not restated for this dataset))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

OpenSpliceAI on the Extended ClinVar benchmark (58,064 variants)

rna-splicing-20261011-fortier2026-protocol-extended-clinvar

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 6, row 'OpenSpliceAI', column 'F1'
Configuration: OpenSpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, Extended ClinVar benchmark (58,064 variants) (Fortier et al. Table 6)
Dataset: Extended ClinVar benchmark (58,064 variants)
0.799 Recall (maximum delta score classification after legacy-tool pre-filtering (threshold not restated for this dataset))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

OpenSpliceAI on the Extended ClinVar benchmark (58,064 variants)

rna-splicing-20261011-fortier2026-protocol-extended-clinvar

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 6, row 'OpenSpliceAI', column 'Sensitivity'
Configuration: OpenSpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, Extended ClinVar benchmark (58,064 variants) (Fortier et al. Table 6)
Dataset: Extended ClinVar benchmark (58,064 variants)
0.992 Specificity (maximum delta score classification after legacy-tool pre-filtering (threshold not restated for this dataset))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

OpenSpliceAI on the Extended ClinVar benchmark (58,064 variants)

rna-splicing-20261011-fortier2026-protocol-extended-clinvar

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 6, row 'OpenSpliceAI', column 'Specificity'
Configuration: OpenSpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, Riepe et al. functional splice assay variants (213 variants, ABCA4 and MYBPC3) (Fortier et al. Table 2)
Dataset: Riepe et al. functional splice assay variants (213 variants, ABCA4 and MYBPC3)
0.746 Balanced accuracy (delta score for each variant's effect type; threshold optimised per gene and algorithm for maximum accuracy (upper bound))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

OpenSpliceAI on the Riepe et al. functional splice assay variants (213 variants, ABCA4 and MYBPC3)

rna-splicing-20261011-fortier2026-protocol-riepe

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 2, row 'OpenSpliceAI', column 'Balanced Accuracy'
Configuration: OpenSpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, Riepe et al. functional splice assay variants (213 variants, ABCA4 and MYBPC3) (Fortier et al. Table 2)
Dataset: Riepe et al. functional splice assay variants (213 variants, ABCA4 and MYBPC3)
0.741 F1 (delta score for each variant's effect type; threshold optimised per gene and algorithm for maximum accuracy (upper bound))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

OpenSpliceAI on the Riepe et al. functional splice assay variants (213 variants, ABCA4 and MYBPC3)

rna-splicing-20261011-fortier2026-protocol-riepe

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 2, row 'OpenSpliceAI', column 'F1'
Configuration: OpenSpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, Riepe et al. functional splice assay variants (213 variants, ABCA4 and MYBPC3) (Fortier et al. Table 2)
Dataset: Riepe et al. functional splice assay variants (213 variants, ABCA4 and MYBPC3)
0.672 Recall (delta score for each variant's effect type; threshold optimised per gene and algorithm for maximum accuracy (upper bound))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

OpenSpliceAI on the Riepe et al. functional splice assay variants (213 variants, ABCA4 and MYBPC3)

rna-splicing-20261011-fortier2026-protocol-riepe

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 2, row 'OpenSpliceAI', column 'Sensitivity'
Configuration: OpenSpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, Riepe et al. functional splice assay variants (213 variants, ABCA4 and MYBPC3) (Fortier et al. Table 2)
Dataset: Riepe et al. functional splice assay variants (213 variants, ABCA4 and MYBPC3)
0.819 Specificity (delta score for each variant's effect type; threshold optimised per gene and algorithm for maximum accuracy (upper bound))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

OpenSpliceAI on the Riepe et al. functional splice assay variants (213 variants, ABCA4 and MYBPC3)

rna-splicing-20261011-fortier2026-protocol-riepe

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 2, row 'OpenSpliceAI', column 'Specificity'
Configuration: OpenSpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, SPiP benchmark variant set (99,601 variants) (Fortier et al. Table 3)
Dataset: SPiP benchmark variant set (99,601 variants)
0.797 Balanced accuracy (maximum delta score > 0.5 (Legacy Ensemble N > 1))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

OpenSpliceAI on the SPiP benchmark variant set (99,601 variants)

rna-splicing-20261011-fortier2026-protocol-spip

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 3, row 'OpenSpliceAI', column 'Balanced Accuracy'
Configuration: OpenSpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, SPiP benchmark variant set (99,601 variants) (Fortier et al. Table 3)
Dataset: SPiP benchmark variant set (99,601 variants)
0.724 F1 (maximum delta score > 0.5 (Legacy Ensemble N > 1))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

OpenSpliceAI on the SPiP benchmark variant set (99,601 variants)

rna-splicing-20261011-fortier2026-protocol-spip

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 3, row 'OpenSpliceAI', column 'F1'
Configuration: OpenSpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, SPiP benchmark variant set (99,601 variants) (Fortier et al. Table 3)
Dataset: SPiP benchmark variant set (99,601 variants)
0.595 Recall (maximum delta score > 0.5 (Legacy Ensemble N > 1))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

OpenSpliceAI on the SPiP benchmark variant set (99,601 variants)

rna-splicing-20261011-fortier2026-protocol-spip

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 3, row 'OpenSpliceAI', column 'Sensitivity'
Configuration: OpenSpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, SPiP benchmark variant set (99,601 variants) (Fortier et al. Table 3)
Dataset: SPiP benchmark variant set (99,601 variants)
0.999 Specificity (maximum delta score > 0.5 (Legacy Ensemble N > 1))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

OpenSpliceAI on the SPiP benchmark variant set (99,601 variants)

rna-splicing-20261011-fortier2026-protocol-spip

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 3, row 'OpenSpliceAI', column 'Specificity'

Source checking is not independent reproduction. Release 2026-10-22-1b7cf027e4f6.

Use this configuration

How it works, versions and access
Strengths, limitations and unresolved questions

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-10-22-1b7cf027e4f6
Property and statementOriginal source and locationReview and provenance

No evidence rows match these filters. Choose another scope or clear the search.

Sources and history

Release 2026-10-22-1b7cf027e4f6 · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: rna-splicing-20261011-fortier2026-config-openspliceai

areas
dna-genomes
contexts
clinical_research
method types
supervised_machine_learning
reported name
OpenSpliceAI
foundation model eligible
false
parameters
Masking enabled; maximum distance between variant and gained or lost splice site 500 bp; classification on the maximum of the four delta scores (threshold per benchmark, see evaluations)
access reuse
Open-source reimplementation (Introduction paragraph 5)
source locator
Methods 'Splice prediction tools' and the list of options for the deep learning algorithms
missing metadata
version: reason: unreported; note: Software or model release not printed
Related records

Suggest a correction