rewirebio.iobenchmarks
Configuration

At least 3 of 4 splice predictors (Drost et al.)

Effect predicted when at least 3 of SpliceAI, Pangolin, SPiP and SQUIRLS exceed their literature thresholds.

3 evaluations · 18 results

Overview

Effect predicted when at least 3 of SpliceAI, Pangolin, SPiP and SQUIRLS exceed their literature thresholds.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Evaluations and results

3 evaluations · 18 results. Different protocols are not a single leaderboard.

Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: At least 3 of 4 splice predictors (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, CAGI6 Splicing VUS subset (Drost et al. Data S1)
Dataset: CAGI6 Splicing VUS variants as scored by Drost et al.
0.87 f1-score
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

At least 3 of 4 splice predictors on 56 CAGI6 Splicing VUS variants

rna-splicing-20261009-protocol-drost2025-cagi6

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S4 'CAGI6 dataset', cell F27; row AtLeast3, column F1
Configuration: At least 3 of 4 splice predictors (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, CAGI6 Splicing VUS subset (Drost et al. Data S1)
Dataset: CAGI6 Splicing VUS variants as scored by Drost et al.
0.708 negative-predictive-value
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

At least 3 of 4 splice predictors on 56 CAGI6 Splicing VUS variants

rna-splicing-20261009-protocol-drost2025-cagi6

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S4 'CAGI6 dataset', cell H27; row AtLeast3, column Neg Pred Value
Configuration: At least 3 of 4 splice predictors (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, CAGI6 Splicing VUS subset (Drost et al. Data S1)
Dataset: CAGI6 Splicing VUS variants as scored by Drost et al.
0.938 precision
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

At least 3 of 4 splice predictors on 56 CAGI6 Splicing VUS variants

rna-splicing-20261009-protocol-drost2025-cagi6

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S4 'CAGI6 dataset', cell G27; row AtLeast3, column Pos Pred Value
Configuration: At least 3 of 4 splice predictors (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, CAGI6 Splicing VUS subset (Drost et al. Data S1)
Dataset: CAGI6 Splicing VUS variants as scored by Drost et al.
0.938 precision
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

At least 3 of 4 splice predictors on 56 CAGI6 Splicing VUS variants

rna-splicing-20261009-protocol-drost2025-cagi6

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S4 'CAGI6 dataset', cell E27; row AtLeast3, column Precision
Configuration: At least 3 of 4 splice predictors (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, CAGI6 Splicing VUS subset (Drost et al. Data S1)
Dataset: CAGI6 Splicing VUS variants as scored by Drost et al.
0.811 recall
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

At least 3 of 4 splice predictors on 56 CAGI6 Splicing VUS variants

rna-splicing-20261009-protocol-drost2025-cagi6

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S4 'CAGI6 dataset', cell C27; row AtLeast3, column Sensitivity (Recall)
Configuration: At least 3 of 4 splice predictors (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, CAGI6 Splicing VUS subset (Drost et al. Data S1)
Dataset: CAGI6 Splicing VUS variants as scored by Drost et al.
0.895 specificity
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

At least 3 of 4 splice predictors on 56 CAGI6 Splicing VUS variants

rna-splicing-20261009-protocol-drost2025-cagi6

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S4 'CAGI6 dataset', cell D27; row AtLeast3, column Specificity
Configuration: At least 3 of 4 splice predictors (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, in-house diagnostic cohort (Drost et al. Data S1)
Dataset: Drost et al. in-house RNA-tested diagnostic variants, scorable subset
0.856 f1-score
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

At least 3 of 4 splice predictors on in-house scorable variants (count not printed)

rna-splicing-20261009-protocol-drost2025-inhouse

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S4 'In House dataset', cell F40; row AtLeast3, column F1
Configuration: At least 3 of 4 splice predictors (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, in-house diagnostic cohort (Drost et al. Data S1)
Dataset: Drost et al. in-house RNA-tested diagnostic variants, scorable subset
0.737 negative-predictive-value
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

At least 3 of 4 splice predictors on in-house scorable variants (count not printed)

rna-splicing-20261009-protocol-drost2025-inhouse

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S4 'In House dataset', cell H40; row AtLeast3, column Neg Pred Value
Configuration: At least 3 of 4 splice predictors (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, in-house diagnostic cohort (Drost et al. Data S1)
Dataset: Drost et al. in-house RNA-tested diagnostic variants, scorable subset
0.883 precision
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

At least 3 of 4 splice predictors on in-house scorable variants (count not printed)

rna-splicing-20261009-protocol-drost2025-inhouse

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S4 'In House dataset', cell G40; row AtLeast3, column Pos Pred Value
Configuration: At least 3 of 4 splice predictors (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, in-house diagnostic cohort (Drost et al. Data S1)
Dataset: Drost et al. in-house RNA-tested diagnostic variants, scorable subset
0.883 precision
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

At least 3 of 4 splice predictors on in-house scorable variants (count not printed)

rna-splicing-20261009-protocol-drost2025-inhouse

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S4 'In House dataset', cell E40; row AtLeast3, column Precision
Configuration: At least 3 of 4 splice predictors (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, in-house diagnostic cohort (Drost et al. Data S1)
Dataset: Drost et al. in-house RNA-tested diagnostic variants, scorable subset
0.831 recall
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

At least 3 of 4 splice predictors on in-house scorable variants (count not printed)

rna-splicing-20261009-protocol-drost2025-inhouse

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S4 'In House dataset', cell C40; row AtLeast3, column Sensitivity (Recall)
Configuration: At least 3 of 4 splice predictors (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, in-house diagnostic cohort (Drost et al. Data S1)
Dataset: Drost et al. in-house RNA-tested diagnostic variants, scorable subset
0.812 specificity
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

At least 3 of 4 splice predictors on in-house scorable variants (count not printed)

rna-splicing-20261009-protocol-drost2025-inhouse

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S4 'In House dataset', cell D40; row AtLeast3, column Specificity
Configuration: At least 3 of 4 splice predictors (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, all 243 scorable variants (Drost et al. Data S1)
Dataset: Drost et al. RNA-tested clinical variants plus CAGI6 Splicing VUS, 243 scorable
0.859 f1-score
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

At least 3 of 4 splice predictors on 243 scorable variants (in-house plus CAGI6)

rna-splicing-20261009-protocol-drost2025-merged-243

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S4 'Entire Dataset', cell F14; row AtLeast3, column F1
Configuration: At least 3 of 4 splice predictors (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, all 243 scorable variants (Drost et al. Data S1)
Dataset: Drost et al. RNA-tested clinical variants plus CAGI6 Splicing VUS, 243 scorable
0.73 negative-predictive-value
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

At least 3 of 4 splice predictors on 243 scorable variants (in-house plus CAGI6)

rna-splicing-20261009-protocol-drost2025-merged-243

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S4 'Entire Dataset', cell H14; row AtLeast3, column Neg Pred Value
Configuration: At least 3 of 4 splice predictors (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, all 243 scorable variants (Drost et al. Data S1)
Dataset: Drost et al. RNA-tested clinical variants plus CAGI6 Splicing VUS, 243 scorable
0.895 precision
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

At least 3 of 4 splice predictors on 243 scorable variants (in-house plus CAGI6)

rna-splicing-20261009-protocol-drost2025-merged-243

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S4 'Entire Dataset', cell G14; row AtLeast3, column Pos Pred Value
Configuration: At least 3 of 4 splice predictors (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, all 243 scorable variants (Drost et al. Data S1)
Dataset: Drost et al. RNA-tested clinical variants plus CAGI6 Splicing VUS, 243 scorable
0.895 precision
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

At least 3 of 4 splice predictors on 243 scorable variants (in-house plus CAGI6)

rna-splicing-20261009-protocol-drost2025-merged-243

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S4 'Entire Dataset', cell E14; row AtLeast3, column Precision
Configuration: At least 3 of 4 splice predictors (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, all 243 scorable variants (Drost et al. Data S1)
Dataset: Drost et al. RNA-tested clinical variants plus CAGI6 Splicing VUS, 243 scorable
0.826 recall
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

At least 3 of 4 splice predictors on 243 scorable variants (in-house plus CAGI6)

rna-splicing-20261009-protocol-drost2025-merged-243

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S4 'Entire Dataset', cell C14; row AtLeast3, column Sensitivity (Recall)
Configuration: At least 3 of 4 splice predictors (Drost et al.)Protocol: Splice-effect prediction against patient-RNA or exon-trapping results, all 243 scorable variants (Drost et al. Data S1)
Dataset: Drost et al. RNA-tested clinical variants plus CAGI6 Splicing VUS, 243 scorable
0.83 specificity
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

At least 3 of 4 splice predictors on 243 scorable variants (in-house plus CAGI6)

rna-splicing-20261009-protocol-drost2025-merged-243

Aggregation: Not reported

Routine RNA-based analysis of potential splicing variants facilitates genomic diagnostics and reveals limitations of in silico prediction tools; Drost et al. 2025, Data S1 (Tables S1-S6) · Data S1 Table S4 'Entire Dataset', cell D14; row AtLeast3, column Specificity

Source checking is not independent reproduction. Release 2026-10-09-ba02f2f4a36e.

Use this model

How it works, versions and access
Strengths, limitations and unresolved questions

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-10-09-ba02f2f4a36e
Property and statementOriginal source and locationReview and provenance

No evidence rows match these filters. Choose another scope or clear the search.

Sources and history

Release 2026-10-09-ba02f2f4a36e · Record review: source checked

2 source records and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: rna-splicing-20261009-config-drost2025-at-least-3

areas
dna-genomes
contexts
clinical_research
method types
conventional_pipeline
reported name
At least 3 of 4 splice predictors (Drost et al.)
foundation model eligible
false
version
AtLeast3 (as printed)
parameters
Component thresholds: SQUIRLS 0.018, SPiP 0.452, Pangolin 0.106, SpliceAI 0.12
source locator
Data S1 Table S4 row label 'AtLeast3'; Results paragraph 3
Related records

Suggest a correction