rewirebio.iobenchmarks
Configuration

CI-SpliceAI (Fortier et al. 2026)

CI-SpliceAI run by the authors

6 evaluations · 24 results

Overview

An explanatory profile has not yet been reviewed for this record.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Evaluations and results

6 evaluations · 24 results. Different protocols are not a single leaderboard.

Sorted by Balanced accuracy (maximum delta score > 0.5 (Legacy Ensemble N > 1)) (higher is better). The best value in each column is highlighted. Decimals are rounded for display; each value links to the printed value and its source.

Tested configurationProtocol and datasetBalanced accuracy (maximum delta score > 0.5 (Legacy Ensemble N > 1))F1 (maximum delta score > 0.5 (Legacy Ensemble N > 1))Recall (maximum delta score > 0.5 (Legacy Ensemble N > 1))Specificity (maximum delta score > 0.5 (Legacy Ensemble N > 1))Balanced accuracy (delta score for each variant's effect type; threshold optimised per gene and algorithm for maximum accuracy (upper bound))Balanced accuracy (maximum delta score classification after legacy-tool pre-filtering (threshold not restated for this dataset))Balanced accuracy (threshold optimised per algorithm for balanced accuracy on this dataset)F1 (delta score for each variant's effect type; threshold optimised per gene and algorithm for maximum accuracy (upper bound))F1 (maximum delta score classification after legacy-tool pre-filtering (threshold not restated for this dataset))F1 (threshold optimised per algorithm for balanced accuracy on this dataset)Recall (delta score for each variant's effect type; threshold optimised per gene and algorithm for maximum accuracy (upper bound))Recall (maximum delta score classification after legacy-tool pre-filtering (threshold not restated for this dataset))Recall (threshold optimised per algorithm for balanced accuracy on this dataset)Specificity (delta score for each variant's effect type; threshold optimised per gene and algorithm for maximum accuracy (upper bound))Specificity (maximum delta score classification after legacy-tool pre-filtering (threshold not restated for this dataset))Specificity (threshold optimised per algorithm for balanced accuracy on this dataset)
CI-SpliceAI (Fortier et al. 2026)EvaluationSplice-altering variant classification, Barbosa et al. ClinVar intronic SNV benchmark (53,600 variants) (Fortier et al. Table 5), Barbosa et al. ClinVar intronic SNV benchmark (53,600 variants)0.977 (best in column)0.974 (best in column)0.958 (best in column)0.997Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
CI-SpliceAI (Fortier et al. 2026)EvaluationSplice-altering variant classification, CI-SpliceAI benchmark variant set (1,316 variants) (Fortier et al. Table 1), CI-SpliceAI benchmark variant set (1,316 variants)0.9070.8990.8370.976Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
CI-SpliceAI (Fortier et al. 2026)EvaluationSplice-altering variant classification, SPiP benchmark variant set (99,601 variants) (Fortier et al. Table 3), SPiP benchmark variant set (99,601 variants)0.7980.7250.5960.999 (best in column)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
CI-SpliceAI (Fortier et al. 2026)EvaluationSplice-altering variant classification, Barbosa et al. deep intronic pathogenic variants with matched common controls (484 variants) (Fortier et al. Table 4), Barbosa et al. deep intronic pathogenic variants with matched common controls (484 variants)Not reportedNot reportedNot reportedNot reportedNot reportedNot reported0.89Not reportedNot reported0.886Not reportedNot reported0.851Not reportedNot reported0.93
CI-SpliceAI (Fortier et al. 2026)EvaluationSplice-altering variant classification, Extended ClinVar benchmark (58,064 variants) (Fortier et al. Table 6), Extended ClinVar benchmark (58,064 variants)Not reportedNot reportedNot reportedNot reportedNot reported0.895Not reportedNot reported0.876Not reportedNot reported0.8Not reportedNot reported0.991Not reported
CI-SpliceAI (Fortier et al. 2026)EvaluationSplice-altering variant classification, Riepe et al. functional splice assay variants (213 variants, ABCA4 and MYBPC3) (Fortier et al. Table 2), Riepe et al. functional splice assay variants (213 variants, ABCA4 and MYBPC3)Not reportedNot reportedNot reportedNot reported0.794Not reportedNot reported0.785Not reportedNot reported0.706Not reportedNot reported0.883Not reportedNot reported
All 24 result rows with coverage, uncertainty and sources
Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: CI-SpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, Barbosa et al. ClinVar intronic SNV benchmark (53,600 variants) (Fortier et al. Table 5)
Dataset: Barbosa et al. ClinVar intronic SNV benchmark (53,600 variants)
0.977 Balanced accuracy (maximum delta score > 0.5 (Legacy Ensemble N > 1))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

CI-SpliceAI on the Barbosa et al. ClinVar intronic SNV benchmark (53,600 variants)

rna-splicing-20261011-fortier2026-protocol-barbosa-clinvar

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 5, row 'CI-SpliceAI', column 'Balanced Accuracy'
Configuration: CI-SpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, Barbosa et al. ClinVar intronic SNV benchmark (53,600 variants) (Fortier et al. Table 5)
Dataset: Barbosa et al. ClinVar intronic SNV benchmark (53,600 variants)
0.974 F1 (maximum delta score > 0.5 (Legacy Ensemble N > 1))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

CI-SpliceAI on the Barbosa et al. ClinVar intronic SNV benchmark (53,600 variants)

rna-splicing-20261011-fortier2026-protocol-barbosa-clinvar

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 5, row 'CI-SpliceAI', column 'F1'
Configuration: CI-SpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, Barbosa et al. ClinVar intronic SNV benchmark (53,600 variants) (Fortier et al. Table 5)
Dataset: Barbosa et al. ClinVar intronic SNV benchmark (53,600 variants)
0.958 Recall (maximum delta score > 0.5 (Legacy Ensemble N > 1))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

CI-SpliceAI on the Barbosa et al. ClinVar intronic SNV benchmark (53,600 variants)

rna-splicing-20261011-fortier2026-protocol-barbosa-clinvar

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 5, row 'CI-SpliceAI', column 'Sensitivity'
Configuration: CI-SpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, Barbosa et al. ClinVar intronic SNV benchmark (53,600 variants) (Fortier et al. Table 5)
Dataset: Barbosa et al. ClinVar intronic SNV benchmark (53,600 variants)
0.997 Specificity (maximum delta score > 0.5 (Legacy Ensemble N > 1))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

CI-SpliceAI on the Barbosa et al. ClinVar intronic SNV benchmark (53,600 variants)

rna-splicing-20261011-fortier2026-protocol-barbosa-clinvar

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 5, row 'CI-SpliceAI', column 'Specificity'
Configuration: CI-SpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, Barbosa et al. deep intronic pathogenic variants with matched common controls (484 variants) (Fortier et al. Table 4)
Dataset: Barbosa et al. deep intronic pathogenic variants with matched common controls (484 variants)
0.89 Balanced accuracy (threshold optimised per algorithm for balanced accuracy on this dataset)
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

CI-SpliceAI on the Barbosa et al. deep intronic pathogenic variants with matched common controls (484 variants)

rna-splicing-20261011-fortier2026-protocol-barbosa-deep-intronic

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 4, row 'CI-SpliceAI', column 'Balanced Accuracy'
Configuration: CI-SpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, Barbosa et al. deep intronic pathogenic variants with matched common controls (484 variants) (Fortier et al. Table 4)
Dataset: Barbosa et al. deep intronic pathogenic variants with matched common controls (484 variants)
0.886 F1 (threshold optimised per algorithm for balanced accuracy on this dataset)
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

CI-SpliceAI on the Barbosa et al. deep intronic pathogenic variants with matched common controls (484 variants)

rna-splicing-20261011-fortier2026-protocol-barbosa-deep-intronic

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 4, row 'CI-SpliceAI', column 'F1'
Configuration: CI-SpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, Barbosa et al. deep intronic pathogenic variants with matched common controls (484 variants) (Fortier et al. Table 4)
Dataset: Barbosa et al. deep intronic pathogenic variants with matched common controls (484 variants)
0.851 Recall (threshold optimised per algorithm for balanced accuracy on this dataset)
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

CI-SpliceAI on the Barbosa et al. deep intronic pathogenic variants with matched common controls (484 variants)

rna-splicing-20261011-fortier2026-protocol-barbosa-deep-intronic

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 4, row 'CI-SpliceAI', column 'Sensitivity'
Configuration: CI-SpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, Barbosa et al. deep intronic pathogenic variants with matched common controls (484 variants) (Fortier et al. Table 4)
Dataset: Barbosa et al. deep intronic pathogenic variants with matched common controls (484 variants)
0.93 Specificity (threshold optimised per algorithm for balanced accuracy on this dataset)
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

CI-SpliceAI on the Barbosa et al. deep intronic pathogenic variants with matched common controls (484 variants)

rna-splicing-20261011-fortier2026-protocol-barbosa-deep-intronic

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 4, row 'CI-SpliceAI', column 'Specificity'
Configuration: CI-SpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, CI-SpliceAI benchmark variant set (1,316 variants) (Fortier et al. Table 1)
Dataset: CI-SpliceAI benchmark variant set (1,316 variants)
0.907 Balanced accuracy (maximum delta score > 0.5 (Legacy Ensemble N > 1))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

CI-SpliceAI on the CI-SpliceAI benchmark variant set (1,316 variants)

rna-splicing-20261011-fortier2026-protocol-ci-spliceai-benchmark

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 1, row 'CI-SpliceAI', column 'Balanced Accuracy'
Configuration: CI-SpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, CI-SpliceAI benchmark variant set (1,316 variants) (Fortier et al. Table 1)
Dataset: CI-SpliceAI benchmark variant set (1,316 variants)
0.899 F1 (maximum delta score > 0.5 (Legacy Ensemble N > 1))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

CI-SpliceAI on the CI-SpliceAI benchmark variant set (1,316 variants)

rna-splicing-20261011-fortier2026-protocol-ci-spliceai-benchmark

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 1, row 'CI-SpliceAI', column 'F1'
Configuration: CI-SpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, CI-SpliceAI benchmark variant set (1,316 variants) (Fortier et al. Table 1)
Dataset: CI-SpliceAI benchmark variant set (1,316 variants)
0.837 Recall (maximum delta score > 0.5 (Legacy Ensemble N > 1))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

CI-SpliceAI on the CI-SpliceAI benchmark variant set (1,316 variants)

rna-splicing-20261011-fortier2026-protocol-ci-spliceai-benchmark

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 1, row 'CI-SpliceAI', column 'Sensitivity'
Configuration: CI-SpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, CI-SpliceAI benchmark variant set (1,316 variants) (Fortier et al. Table 1)
Dataset: CI-SpliceAI benchmark variant set (1,316 variants)
0.976 Specificity (maximum delta score > 0.5 (Legacy Ensemble N > 1))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

CI-SpliceAI on the CI-SpliceAI benchmark variant set (1,316 variants)

rna-splicing-20261011-fortier2026-protocol-ci-spliceai-benchmark

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 1, row 'CI-SpliceAI', column 'Specificity'
Configuration: CI-SpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, Extended ClinVar benchmark (58,064 variants) (Fortier et al. Table 6)
Dataset: Extended ClinVar benchmark (58,064 variants)
0.895 Balanced accuracy (maximum delta score classification after legacy-tool pre-filtering (threshold not restated for this dataset))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

CI-SpliceAI on the Extended ClinVar benchmark (58,064 variants)

rna-splicing-20261011-fortier2026-protocol-extended-clinvar

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 6, row 'CI-SpliceAI', column 'Balanced Accuracy'
Configuration: CI-SpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, Extended ClinVar benchmark (58,064 variants) (Fortier et al. Table 6)
Dataset: Extended ClinVar benchmark (58,064 variants)
0.876 F1 (maximum delta score classification after legacy-tool pre-filtering (threshold not restated for this dataset))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

CI-SpliceAI on the Extended ClinVar benchmark (58,064 variants)

rna-splicing-20261011-fortier2026-protocol-extended-clinvar

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 6, row 'CI-SpliceAI', column 'F1'
Configuration: CI-SpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, Extended ClinVar benchmark (58,064 variants) (Fortier et al. Table 6)
Dataset: Extended ClinVar benchmark (58,064 variants)
0.8 Recall (maximum delta score classification after legacy-tool pre-filtering (threshold not restated for this dataset))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

CI-SpliceAI on the Extended ClinVar benchmark (58,064 variants)

rna-splicing-20261011-fortier2026-protocol-extended-clinvar

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 6, row 'CI-SpliceAI', column 'Sensitivity'
Configuration: CI-SpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, Extended ClinVar benchmark (58,064 variants) (Fortier et al. Table 6)
Dataset: Extended ClinVar benchmark (58,064 variants)
0.991 Specificity (maximum delta score classification after legacy-tool pre-filtering (threshold not restated for this dataset))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

CI-SpliceAI on the Extended ClinVar benchmark (58,064 variants)

rna-splicing-20261011-fortier2026-protocol-extended-clinvar

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 6, row 'CI-SpliceAI', column 'Specificity'
Configuration: CI-SpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, Riepe et al. functional splice assay variants (213 variants, ABCA4 and MYBPC3) (Fortier et al. Table 2)
Dataset: Riepe et al. functional splice assay variants (213 variants, ABCA4 and MYBPC3)
0.794 Balanced accuracy (delta score for each variant's effect type; threshold optimised per gene and algorithm for maximum accuracy (upper bound))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

CI-SpliceAI on the Riepe et al. functional splice assay variants (213 variants, ABCA4 and MYBPC3)

rna-splicing-20261011-fortier2026-protocol-riepe

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 2, row 'CI-SpliceAI', column 'Balanced Accuracy'
Configuration: CI-SpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, Riepe et al. functional splice assay variants (213 variants, ABCA4 and MYBPC3) (Fortier et al. Table 2)
Dataset: Riepe et al. functional splice assay variants (213 variants, ABCA4 and MYBPC3)
0.785 F1 (delta score for each variant's effect type; threshold optimised per gene and algorithm for maximum accuracy (upper bound))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

CI-SpliceAI on the Riepe et al. functional splice assay variants (213 variants, ABCA4 and MYBPC3)

rna-splicing-20261011-fortier2026-protocol-riepe

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 2, row 'CI-SpliceAI', column 'F1'
Configuration: CI-SpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, Riepe et al. functional splice assay variants (213 variants, ABCA4 and MYBPC3) (Fortier et al. Table 2)
Dataset: Riepe et al. functional splice assay variants (213 variants, ABCA4 and MYBPC3)
0.706 Recall (delta score for each variant's effect type; threshold optimised per gene and algorithm for maximum accuracy (upper bound))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

CI-SpliceAI on the Riepe et al. functional splice assay variants (213 variants, ABCA4 and MYBPC3)

rna-splicing-20261011-fortier2026-protocol-riepe

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 2, row 'CI-SpliceAI', column 'Sensitivity'
Configuration: CI-SpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, Riepe et al. functional splice assay variants (213 variants, ABCA4 and MYBPC3) (Fortier et al. Table 2)
Dataset: Riepe et al. functional splice assay variants (213 variants, ABCA4 and MYBPC3)
0.883 Specificity (delta score for each variant's effect type; threshold optimised per gene and algorithm for maximum accuracy (upper bound))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

CI-SpliceAI on the Riepe et al. functional splice assay variants (213 variants, ABCA4 and MYBPC3)

rna-splicing-20261011-fortier2026-protocol-riepe

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 2, row 'CI-SpliceAI', column 'Specificity'
Configuration: CI-SpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, SPiP benchmark variant set (99,601 variants) (Fortier et al. Table 3)
Dataset: SPiP benchmark variant set (99,601 variants)
0.798 Balanced accuracy (maximum delta score > 0.5 (Legacy Ensemble N > 1))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

CI-SpliceAI on the SPiP benchmark variant set (99,601 variants)

rna-splicing-20261011-fortier2026-protocol-spip

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 3, row 'CI-SpliceAI', column 'Balanced Accuracy'
Configuration: CI-SpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, SPiP benchmark variant set (99,601 variants) (Fortier et al. Table 3)
Dataset: SPiP benchmark variant set (99,601 variants)
0.725 F1 (maximum delta score > 0.5 (Legacy Ensemble N > 1))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

CI-SpliceAI on the SPiP benchmark variant set (99,601 variants)

rna-splicing-20261011-fortier2026-protocol-spip

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 3, row 'CI-SpliceAI', column 'F1'
Configuration: CI-SpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, SPiP benchmark variant set (99,601 variants) (Fortier et al. Table 3)
Dataset: SPiP benchmark variant set (99,601 variants)
0.596 Recall (maximum delta score > 0.5 (Legacy Ensemble N > 1))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

CI-SpliceAI on the SPiP benchmark variant set (99,601 variants)

rna-splicing-20261011-fortier2026-protocol-spip

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 3, row 'CI-SpliceAI', column 'Sensitivity'
Configuration: CI-SpliceAI (Fortier et al. 2026)Protocol: Splice-altering variant classification, SPiP benchmark variant set (99,601 variants) (Fortier et al. Table 3)
Dataset: SPiP benchmark variant set (99,601 variants)
0.999 Specificity (maximum delta score > 0.5 (Legacy Ensemble N > 1))
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

CI-SpliceAI on the SPiP benchmark variant set (99,601 variants)

rna-splicing-20261011-fortier2026-protocol-spip

Aggregation: Not reported

Analyzing the performance of deep learning splice prediction algorithms (Fortier, Rudy and Scherer, PLOS One 2026) · Table 3, row 'CI-SpliceAI', column 'Specificity'

Source checking is not independent reproduction. Release 2026-10-22-1b7cf027e4f6.

Use this configuration

How it works, versions and access
Strengths, limitations and unresolved questions

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-10-22-1b7cf027e4f6
Property and statementOriginal source and locationReview and provenance

No evidence rows match these filters. Choose another scope or clear the search.

Sources and history

Release 2026-10-22-1b7cf027e4f6 · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: rna-splicing-20261011-fortier2026-config-ci-spliceai

areas
dna-genomes
contexts
clinical_research
method types
supervised_machine_learning
reported name
CI-SpliceAI
foundation model eligible
false
parameters
Masking enabled; maximum distance between variant and gained or lost splice site 500 bp; classification on the maximum of the four delta scores (threshold per benchmark, see evaluations)
access reuse
Open-source reimplementation (Introduction paragraph 5)
source locator
Methods 'Splice prediction tools' and the list of options for the deep learning algorithms
missing metadata
version: reason: unreported; note: Software or model release not printed
Related records

Suggest a correction