rewirebio.iobenchmarks
Configuration

SPiP 2.1 (Drost et al.)

SPiP as used by Drost et al.

3 evaluations · 24 results

Overview

SPiP as used by Drost et al.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Evaluations and results

3 evaluations · 24 results. Different protocols are not a single leaderboard.

Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: SPiP 2.1 (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, CAGI6 Splicing VUS subset (Drost et al. Data S1)
Dataset: CAGI6 Splicing VUS variants as scored by Drost et al.
0.906 auprc
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

SPiP 2.1 on 56 CAGI6 Splicing VUS variants

rna-splicing-20261009-protocol-drost2025-cagi6

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S3 'Stratified datasets', Dataset 'CAGI6', cell I8; row SPiP, column AUPRC
Configuration: SPiP 2.1 (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, CAGI6 Splicing VUS subset (Drost et al. Data S1)
Dataset: CAGI6 Splicing VUS variants as scored by Drost et al.
0.874 auroc
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

SPiP 2.1 on 56 CAGI6 Splicing VUS variants

rna-splicing-20261009-protocol-drost2025-cagi6

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S3 'Stratified datasets', Dataset 'CAGI6', cell H8; row SPiP, column AUROC
Configuration: SPiP 2.1 (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, CAGI6 Splicing VUS subset (Drost et al. Data S1)
Dataset: CAGI6 Splicing VUS variants as scored by Drost et al.
0.889 f1-score
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

SPiP 2.1 on 56 CAGI6 Splicing VUS variants

rna-splicing-20261009-protocol-drost2025-cagi6

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S4 'CAGI6 dataset', cell F21; row SPiP, column F1
Configuration: SPiP 2.1 (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, CAGI6 Splicing VUS subset (Drost et al. Data S1)
Dataset: CAGI6 Splicing VUS variants as scored by Drost et al.
0.762 negative-predictive-value
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

SPiP 2.1 on 56 CAGI6 Splicing VUS variants

rna-splicing-20261009-protocol-drost2025-cagi6

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S4 'CAGI6 dataset', cell H21; row SPiP, column Neg Pred Value
Configuration: SPiP 2.1 (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, CAGI6 Splicing VUS subset (Drost et al. Data S1)
Dataset: CAGI6 Splicing VUS variants as scored by Drost et al.
0.914 precision
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

SPiP 2.1 on 56 CAGI6 Splicing VUS variants

rna-splicing-20261009-protocol-drost2025-cagi6

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S4 'CAGI6 dataset', cell G21; row SPiP, column Pos Pred Value
Configuration: SPiP 2.1 (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, CAGI6 Splicing VUS subset (Drost et al. Data S1)
Dataset: CAGI6 Splicing VUS variants as scored by Drost et al.
0.914 precision
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

SPiP 2.1 on 56 CAGI6 Splicing VUS variants

rna-splicing-20261009-protocol-drost2025-cagi6

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S4 'CAGI6 dataset', cell E21; row SPiP, column Precision
Configuration: SPiP 2.1 (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, CAGI6 Splicing VUS subset (Drost et al. Data S1)
Dataset: CAGI6 Splicing VUS variants as scored by Drost et al.
0.865 recall
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

SPiP 2.1 on 56 CAGI6 Splicing VUS variants

rna-splicing-20261009-protocol-drost2025-cagi6

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S4 'CAGI6 dataset', cell C21; row SPiP, column Sensitivity (Recall)
Configuration: SPiP 2.1 (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, CAGI6 Splicing VUS subset (Drost et al. Data S1)
Dataset: CAGI6 Splicing VUS variants as scored by Drost et al.
0.842 specificity
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

SPiP 2.1 on 56 CAGI6 Splicing VUS variants

rna-splicing-20261009-protocol-drost2025-cagi6

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S4 'CAGI6 dataset', cell D21; row SPiP, column Specificity
Configuration: SPiP 2.1 (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, in-house diagnostic cohort (Drost et al. Data S1)
Dataset: Drost et al. in-house RNA-tested diagnostic variants, scorable subset
0.89 auprc
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

SPiP 2.1 on in-house scorable variants (count not printed)

rna-splicing-20261009-protocol-drost2025-inhouse

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S3 'Stratified datasets', Dataset 'In House', cell I13; row SPiP, column AUPRC
Configuration: SPiP 2.1 (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, in-house diagnostic cohort (Drost et al. Data S1)
Dataset: Drost et al. in-house RNA-tested diagnostic variants, scorable subset
0.817 auroc
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

SPiP 2.1 on in-house scorable variants (count not printed)

rna-splicing-20261009-protocol-drost2025-inhouse

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S3 'Stratified datasets', Dataset 'In House', cell H13; row SPiP, column AUROC
Configuration: SPiP 2.1 (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, in-house diagnostic cohort (Drost et al. Data S1)
Dataset: Drost et al. in-house RNA-tested diagnostic variants, scorable subset
0.833 f1-score
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

SPiP 2.1 on in-house scorable variants (count not printed)

rna-splicing-20261009-protocol-drost2025-inhouse

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S4 'In House dataset', cell F34; row SPiP, column F1
Configuration: SPiP 2.1 (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, in-house diagnostic cohort (Drost et al. Data S1)
Dataset: Drost et al. in-house RNA-tested diagnostic variants, scorable subset
0.708 negative-predictive-value
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

SPiP 2.1 on in-house scorable variants (count not printed)

rna-splicing-20261009-protocol-drost2025-inhouse

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S4 'In House dataset', cell H34; row SPiP, column Neg Pred Value
Configuration: SPiP 2.1 (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, in-house diagnostic cohort (Drost et al. Data S1)
Dataset: Drost et al. in-house RNA-tested diagnostic variants, scorable subset
0.843 precision
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

SPiP 2.1 on in-house scorable variants (count not printed)

rna-splicing-20261009-protocol-drost2025-inhouse

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S4 'In House dataset', cell G34; row SPiP, column Pos Pred Value
Configuration: SPiP 2.1 (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, in-house diagnostic cohort (Drost et al. Data S1)
Dataset: Drost et al. in-house RNA-tested diagnostic variants, scorable subset
0.843 precision
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

SPiP 2.1 on in-house scorable variants (count not printed)

rna-splicing-20261009-protocol-drost2025-inhouse

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S4 'In House dataset', cell E34; row SPiP, column Precision
Configuration: SPiP 2.1 (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, in-house diagnostic cohort (Drost et al. Data S1)
Dataset: Drost et al. in-house RNA-tested diagnostic variants, scorable subset
0.822 recall
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

SPiP 2.1 on in-house scorable variants (count not printed)

rna-splicing-20261009-protocol-drost2025-inhouse

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S4 'In House dataset', cell C34; row SPiP, column Sensitivity (Recall)
Configuration: SPiP 2.1 (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, in-house diagnostic cohort (Drost et al. Data S1)
Dataset: Drost et al. in-house RNA-tested diagnostic variants, scorable subset
0.739 specificity
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

SPiP 2.1 on in-house scorable variants (count not printed)

rna-splicing-20261009-protocol-drost2025-inhouse

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S4 'In House dataset', cell D34; row SPiP, column Specificity
Configuration: SPiP 2.1 (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, all 243 scorable variants (Drost et al. Data S1)
Dataset: Drost et al. RNA-tested clinical variants plus CAGI6 Splicing VUS, 243 scorable
0.889 auprc
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

SPiP 2.1 on 243 scorable variants (in-house plus CAGI6)

rna-splicing-20261009-protocol-drost2025-merged-243

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S3 'Entire Dataset', cell D11; row SPiP, column AUPRC
Configuration: SPiP 2.1 (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, all 243 scorable variants (Drost et al. Data S1)
Dataset: Drost et al. RNA-tested clinical variants plus CAGI6 Splicing VUS, 243 scorable
0.83 auroc
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

SPiP 2.1 on 243 scorable variants (in-house plus CAGI6)

rna-splicing-20261009-protocol-drost2025-merged-243

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S3 'Entire Dataset', cell C11; row SPiP, column AUROC
Configuration: SPiP 2.1 (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, all 243 scorable variants (Drost et al. Data S1)
Dataset: Drost et al. RNA-tested clinical variants plus CAGI6 Splicing VUS, 243 scorable
0.846 f1-score
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

SPiP 2.1 on 243 scorable variants (in-house plus CAGI6)

rna-splicing-20261009-protocol-drost2025-merged-243

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S4 'Entire Dataset', cell F8; row SPiP, column F1
Configuration: SPiP 2.1 (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, all 243 scorable variants (Drost et al. Data S1)
Dataset: Drost et al. RNA-tested clinical variants plus CAGI6 Splicing VUS, 243 scorable
0.72 negative-predictive-value
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

SPiP 2.1 on 243 scorable variants (in-house plus CAGI6)

rna-splicing-20261009-protocol-drost2025-merged-243

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S4 'Entire Dataset', cell H8; row SPiP, column Neg Pred Value
Configuration: SPiP 2.1 (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, all 243 scorable variants (Drost et al. Data S1)
Dataset: Drost et al. RNA-tested clinical variants plus CAGI6 Splicing VUS, 243 scorable
0.86 precision
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

SPiP 2.1 on 243 scorable variants (in-house plus CAGI6)

rna-splicing-20261009-protocol-drost2025-merged-243

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S4 'Entire Dataset', cell G8; row SPiP, column Pos Pred Value
Configuration: SPiP 2.1 (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, all 243 scorable variants (Drost et al. Data S1)
Dataset: Drost et al. RNA-tested clinical variants plus CAGI6 Splicing VUS, 243 scorable
0.86 precision
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

SPiP 2.1 on 243 scorable variants (in-house plus CAGI6)

rna-splicing-20261009-protocol-drost2025-merged-243

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S4 'Entire Dataset', cell E8; row SPiP, column Precision
Configuration: SPiP 2.1 (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, all 243 scorable variants (Drost et al. Data S1)
Dataset: Drost et al. RNA-tested clinical variants plus CAGI6 Splicing VUS, 243 scorable
0.832 recall
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

SPiP 2.1 on 243 scorable variants (in-house plus CAGI6)

rna-splicing-20261009-protocol-drost2025-merged-243

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S4 'Entire Dataset', cell C8; row SPiP, column Sensitivity (Recall)
Configuration: SPiP 2.1 (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, all 243 scorable variants (Drost et al. Data S1)
Dataset: Drost et al. RNA-tested clinical variants plus CAGI6 Splicing VUS, 243 scorable
0.761 specificity
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

SPiP 2.1 on 243 scorable variants (in-house plus CAGI6)

rna-splicing-20261009-protocol-drost2025-merged-243

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S4 'Entire Dataset', cell D8; row SPiP, column Specificity

Source checking is not independent reproduction. Release 2026-10-09-ba02f2f4a36e.

Use this model

How it works, versions and access
Strengths, limitations and unresolved questions

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-10-09-ba02f2f4a36e
Property and statementOriginal source and locationReview and provenance

No evidence rows match these filters. Choose another scope or clear the search.

Sources and history

Release 2026-10-09-ba02f2f4a36e · Record review: source checked

2 source records and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: rna-splicing-20261009-config-drost2025-spip

areas
dna-genomes
contexts
clinical_research
method types
supervised_machine_learning
reported name
SPiP 2.1 (Drost et al.)
foundation model eligible
false
version
2.1
parameters
Binary predictions at the literature threshold 0.452
source locator
Methods 'In silico splice predictions'; Results paragraph 3
Related records

Suggest a correction