rewirebio.iobenchmarks
Configuration

NTv3 650M Post (Alavi 2026)

NTV3 650M POST as configured in Alavi 2026.

3 evaluations · 14 results

Overview

Nucleotide Transformer v3: Nucleotide Transformer v3 genomic language model family (pre- and post-trained checkpoints).

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Evaluations and results

3 evaluations · 14 results. Different protocols are not a single leaderboard.

Sorted by Accuracy (higher is better). The best value in each column is highlighted. Decimals are rounded for display; each value links to the printed value and its source.

Tested configurationProtocol and datasetAccuracyFalse positive rate (type I error: false positives as a share of the benign set)PrecisionProportion (type II error: false negatives as a share of the splicing set (false-negative rate))RecallSpecificityProportion (share of 306 further OPA1 pathogenic substitutions called splice-altering)Proportion (share of 69 OPA1 VUS substitutions called splice-altering)
NTv3 650M Post (Alavi 2026)EvaluationSplice-defect classification of OPA1 variants with thresholds tuned on the same sets (Alavi Table III, evaluation sets), OPA1 LOVD evaluation sets (49 splicing, 79 benign)89.1% (best in column)5 (6.3%)88.9%9 (18.4%) (best in column)40 (81.6%) (best in column)74 (93.7%)Not reportedNot reported
NTv3 650M Post (Alavi 2026)EvaluationSpliceogenic versus benign classification on an independent 65-gene set with OPA1-derived thresholds (Alavi Table IV), Multi-gene spliceogenic test set (76 spliceogenic, 107 benign, 65 genes)71.6%3 (2.8%) (best in column)90% (best in column)49 (64.5%)27 (35.5%)104 (97.2%) (best in column)Not reportedNot reported
NTv3 650M Post (Alavi 2026)EvaluationShare of further OPA1 pathogenic substitutions and VUS called splice-altering (Alavi Table III, extended corpus), OPA1 extended LOVD corpus (306 pathogenic substitutions, 69 VUS)Not reportedNot reportedNot reportedNot reportedNot reportedNot reported77 (25.2%)9 (13.0%)
All 14 result rows with coverage, uncertainty and sources
Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: NTv3 650M Post (Alavi 2026)Protocol: Spliceogenic versus benign classification on an independent 65-gene set with OPA1-derived thresholds (Alavi Table IV)
Dataset: Multi-gene spliceogenic test set (76 spliceogenic, 107 benign, 65 genes)
71.6% Accuracy
percent · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

NTv3 650M Post on Multi-gene spliceogenic test set (76 spliceogenic, 107 benign, 65 genes)

rna-splicing-20261011-alavi2026-protocol-multigene

Aggregation: Not reported

Probing Genomic Foundation Models with Splice-Variant Perturbations (Alavi, bioRxiv 2026) · Table IV, row 'NTV3 650M POST', column 'Accuracy' (PDF page 9 of 11)
Configuration: NTv3 650M Post (Alavi 2026)Protocol: Spliceogenic versus benign classification on an independent 65-gene set with OPA1-derived thresholds (Alavi Table IV)
Dataset: Multi-gene spliceogenic test set (76 spliceogenic, 107 benign, 65 genes)
90% Precision
percent · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

NTv3 650M Post on Multi-gene spliceogenic test set (76 spliceogenic, 107 benign, 65 genes)

rna-splicing-20261011-alavi2026-protocol-multigene

Aggregation: Not reported

Probing Genomic Foundation Models with Splice-Variant Perturbations (Alavi, bioRxiv 2026) · Table IV, row 'NTV3 650M POST', column 'PPV' (PDF page 9 of 11)
Configuration: NTv3 650M Post (Alavi 2026)Protocol: Spliceogenic versus benign classification on an independent 65-gene set with OPA1-derived thresholds (Alavi Table IV)
Dataset: Multi-gene spliceogenic test set (76 spliceogenic, 107 benign, 65 genes)
27 (35.5%) Recall
percent · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

NTv3 650M Post on Multi-gene spliceogenic test set (76 spliceogenic, 107 benign, 65 genes)

rna-splicing-20261011-alavi2026-protocol-multigene

Aggregation: Not reported

Probing Genomic Foundation Models with Splice-Variant Perturbations (Alavi, bioRxiv 2026) · Table IV, row 'NTV3 650M POST', column 'Sensitivity' (PDF page 9 of 11)
Configuration: NTv3 650M Post (Alavi 2026)Protocol: Spliceogenic versus benign classification on an independent 65-gene set with OPA1-derived thresholds (Alavi Table IV)
Dataset: Multi-gene spliceogenic test set (76 spliceogenic, 107 benign, 65 genes)
104 (97.2%) Specificity
percent · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

NTv3 650M Post on Multi-gene spliceogenic test set (76 spliceogenic, 107 benign, 65 genes)

rna-splicing-20261011-alavi2026-protocol-multigene

Aggregation: Not reported

Probing Genomic Foundation Models with Splice-Variant Perturbations (Alavi, bioRxiv 2026) · Table IV, row 'NTV3 650M POST', column 'Specificity' (PDF page 9 of 11)
Configuration: NTv3 650M Post (Alavi 2026)Protocol: Spliceogenic versus benign classification on an independent 65-gene set with OPA1-derived thresholds (Alavi Table IV)
Dataset: Multi-gene spliceogenic test set (76 spliceogenic, 107 benign, 65 genes)
3 (2.8%) False positive rate (type I error: false positives as a share of the benign set)
percent · lower

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

NTv3 650M Post on Multi-gene spliceogenic test set (76 spliceogenic, 107 benign, 65 genes)

rna-splicing-20261011-alavi2026-protocol-multigene

Aggregation: Not reported

Probing Genomic Foundation Models with Splice-Variant Perturbations (Alavi, bioRxiv 2026) · Table IV, row 'NTV3 650M POST', column 'Type I error' (PDF page 9 of 11)
Configuration: NTv3 650M Post (Alavi 2026)Protocol: Spliceogenic versus benign classification on an independent 65-gene set with OPA1-derived thresholds (Alavi Table IV)
Dataset: Multi-gene spliceogenic test set (76 spliceogenic, 107 benign, 65 genes)
49 (64.5%) Proportion (type II error: false negatives as a share of the splicing set (false-negative rate))
percent · lower

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

NTv3 650M Post on Multi-gene spliceogenic test set (76 spliceogenic, 107 benign, 65 genes)

rna-splicing-20261011-alavi2026-protocol-multigene

Aggregation: Not reported

Probing Genomic Foundation Models with Splice-Variant Perturbations (Alavi, bioRxiv 2026) · Table IV, row 'NTV3 650M POST', column 'Type II error' (PDF page 9 of 11)
Configuration: NTv3 650M Post (Alavi 2026)Protocol: Splice-defect classification of OPA1 variants with thresholds tuned on the same sets (Alavi Table III, evaluation sets)
Dataset: OPA1 LOVD evaluation sets (49 splicing, 79 benign)
89.1% Accuracy
percent · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

NTv3 650M Post on OPA1 LOVD evaluation sets (49 splicing, 79 benign)

rna-splicing-20261011-alavi2026-protocol-opa1-evaluation

Aggregation: Not reported

Probing Genomic Foundation Models with Splice-Variant Perturbations (Alavi, bioRxiv 2026) · Table III, row 'NTV3 650M POST', column 'Accuracy' (PDF page 6 of 11)
Configuration: NTv3 650M Post (Alavi 2026)Protocol: Splice-defect classification of OPA1 variants with thresholds tuned on the same sets (Alavi Table III, evaluation sets)
Dataset: OPA1 LOVD evaluation sets (49 splicing, 79 benign)
88.9% Precision
percent · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

NTv3 650M Post on OPA1 LOVD evaluation sets (49 splicing, 79 benign)

rna-splicing-20261011-alavi2026-protocol-opa1-evaluation

Aggregation: Not reported

Probing Genomic Foundation Models with Splice-Variant Perturbations (Alavi, bioRxiv 2026) · Table III, row 'NTV3 650M POST', column 'PPV' (PDF page 6 of 11)
Configuration: NTv3 650M Post (Alavi 2026)Protocol: Splice-defect classification of OPA1 variants with thresholds tuned on the same sets (Alavi Table III, evaluation sets)
Dataset: OPA1 LOVD evaluation sets (49 splicing, 79 benign)
40 (81.6%) Recall
percent · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

NTv3 650M Post on OPA1 LOVD evaluation sets (49 splicing, 79 benign)

rna-splicing-20261011-alavi2026-protocol-opa1-evaluation

Aggregation: Not reported

Probing Genomic Foundation Models with Splice-Variant Perturbations (Alavi, bioRxiv 2026) · Table III, row 'NTV3 650M POST', column 'Sensitivity' (PDF page 6 of 11)
Configuration: NTv3 650M Post (Alavi 2026)Protocol: Splice-defect classification of OPA1 variants with thresholds tuned on the same sets (Alavi Table III, evaluation sets)
Dataset: OPA1 LOVD evaluation sets (49 splicing, 79 benign)
74 (93.7%) Specificity
percent · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

NTv3 650M Post on OPA1 LOVD evaluation sets (49 splicing, 79 benign)

rna-splicing-20261011-alavi2026-protocol-opa1-evaluation

Aggregation: Not reported

Probing Genomic Foundation Models with Splice-Variant Perturbations (Alavi, bioRxiv 2026) · Table III, row 'NTV3 650M POST', column 'Specificity' (PDF page 6 of 11)
Configuration: NTv3 650M Post (Alavi 2026)Protocol: Splice-defect classification of OPA1 variants with thresholds tuned on the same sets (Alavi Table III, evaluation sets)
Dataset: OPA1 LOVD evaluation sets (49 splicing, 79 benign)
5 (6.3%) False positive rate (type I error: false positives as a share of the benign set)
percent · lower

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

NTv3 650M Post on OPA1 LOVD evaluation sets (49 splicing, 79 benign)

rna-splicing-20261011-alavi2026-protocol-opa1-evaluation

Aggregation: Not reported

Probing Genomic Foundation Models with Splice-Variant Perturbations (Alavi, bioRxiv 2026) · Table III, row 'NTV3 650M POST', column 'Type I error' (PDF page 6 of 11)
Configuration: NTv3 650M Post (Alavi 2026)Protocol: Splice-defect classification of OPA1 variants with thresholds tuned on the same sets (Alavi Table III, evaluation sets)
Dataset: OPA1 LOVD evaluation sets (49 splicing, 79 benign)
9 (18.4%) Proportion (type II error: false negatives as a share of the splicing set (false-negative rate))
percent · lower

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

NTv3 650M Post on OPA1 LOVD evaluation sets (49 splicing, 79 benign)

rna-splicing-20261011-alavi2026-protocol-opa1-evaluation

Aggregation: Not reported

Probing Genomic Foundation Models with Splice-Variant Perturbations (Alavi, bioRxiv 2026) · Table III, row 'NTV3 650M POST', column 'Type II error' (PDF page 6 of 11)
Configuration: NTv3 650M Post (Alavi 2026)Protocol: Share of further OPA1 pathogenic substitutions and VUS called splice-altering (Alavi Table III, extended corpus)
Dataset: OPA1 extended LOVD corpus (306 pathogenic substitutions, 69 VUS)
77 (25.2%) Proportion (share of 306 further OPA1 pathogenic substitutions called splice-altering)
percent · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

NTv3 650M Post on OPA1 extended LOVD corpus (306 pathogenic substitutions, 69 VUS)

rna-splicing-20261011-alavi2026-protocol-opa1-extended-positive-calls

Aggregation: Not reported

Probing Genomic Foundation Models with Splice-Variant Perturbations (Alavi, bioRxiv 2026) · Table III, row 'NTV3 650M POST', column 'Positive mutations' (PDF page 6 of 11)
Configuration: NTv3 650M Post (Alavi 2026)Protocol: Share of further OPA1 pathogenic substitutions and VUS called splice-altering (Alavi Table III, extended corpus)
Dataset: OPA1 extended LOVD corpus (306 pathogenic substitutions, 69 VUS)
9 (13.0%) Proportion (share of 69 OPA1 VUS substitutions called splice-altering)
percent · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

NTv3 650M Post on OPA1 extended LOVD corpus (306 pathogenic substitutions, 69 VUS)

rna-splicing-20261011-alavi2026-protocol-opa1-extended-positive-calls

Aggregation: Not reported

Probing Genomic Foundation Models with Splice-Variant Perturbations (Alavi, bioRxiv 2026) · Table III, row 'NTV3 650M POST', column 'Positive VUS' (PDF page 6 of 11)

Source checking is not independent reproduction. Release 2026-10-22-1b7cf027e4f6.

Use this configuration

How it works, versions and access
Strengths, limitations and unresolved questions

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-10-22-1b7cf027e4f6
Property and statementOriginal source and locationReview and provenance

No evidence rows match these filters. Choose another scope or clear the search.

Sources and history

Release 2026-10-22-1b7cf027e4f6 · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: rna-splicing-20261011-alavi2026-config-ntv3-650m-post

areas
dna-genomes
contexts
clinical_research
method types
foundation_model
reported name
NTV3 650M POST
foundation model eligible
true
version
InstaDeepAI/NTv3_650M_post
parameters
Zero-shot log-likelihood ratio, 16,384 bp context, human species embedding, summed over ±16 bp; forward and reverse strands; thresholds by grid search (Methods F)
access reuse
Public weights (Hugging Face)
source locator
Methods C to H; Table III and IV row label
Related records

Suggest a correction