rewirebio.iobenchmarks
Configuration

AlphaGenome all outputs, quantile, maximum (Lu et al. 2025)

AlphaGenome variant score taken as the maximum quantile (percentile) over all outputs after converting each output to quantiles.

15 evaluations · 15 results

Overview

An explanatory profile has not yet been reviewed for this record.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Evaluations and results

15 evaluations · 15 results. Different protocols are not a single leaderboard.

Protocol: ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)

Sorted by AUROC (ClinVar pathogenic vs benign canonical splice SNVs (N=11,047); AlphaGenome scorer 'All outputs (quantile)') (higher is better). The best value in each column is highlighted. Decimals are rounded for display; each value links to the printed value and its source.

Tested configurationProtocol and datasetAUROC (ClinVar pathogenic vs benign canonical splice SNVs (N=11,047); AlphaGenome scorer 'All outputs (quantile)')AUROC (ClinVar pathogenic vs benign SNVs, 3' UTR)AUROC (ClinVar pathogenic vs benign SNVs, 5' UTR)AUROC (ClinVar pathogenic vs benign SNVs, All variants)AUROC (ClinVar pathogenic vs benign SNVs, Intron (Non-splice))AUROC (ClinVar pathogenic vs benign SNVs, Missense & 3'UTR)AUROC (ClinVar pathogenic vs benign SNVs, Missense & Intron (Non-splice))AUROC (ClinVar pathogenic vs benign SNVs, Missense)AUROC (ClinVar pathogenic vs benign SNVs, Noncoding)AUROC (ClinVar pathogenic vs benign SNVs, RNA gene)AUROC (ClinVar pathogenic vs benign SNVs, Splice)AUROC (ClinVar pathogenic vs benign SNVs, Start loss)AUROC (ClinVar pathogenic vs benign SNVs, Stop gain)AUROC (ClinVar pathogenic vs benign SNVs, Stop loss)AUROC (ClinVar pathogenic vs benign SNVs, Synonymous)
AlphaGenome all outputs, quantile, maximum (Lu et al. 2025)EvaluationLu et al. 2025 ClinVar benchmark: splice variants scored by AlphaGenome (Supplementary Figure S2)0.614Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
AlphaGenome all outputs, quantile, maximum (Lu et al. 2025)EvaluationLu et al. 2025 ClinVar benchmark: All variants (Figure 1)Not reportedNot reportedNot reported0.31Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
AlphaGenome all outputs, quantile, maximum (Lu et al. 2025)EvaluationLu et al. 2025 ClinVar benchmark: Intron (Non-splice) (Figure 1)Not reportedNot reportedNot reportedNot reported0.96Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
AlphaGenome all outputs, quantile, maximum (Lu et al. 2025)EvaluationLu et al. 2025 ClinVar benchmark: Missense (Figure 1)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.56Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
AlphaGenome all outputs, quantile, maximum (Lu et al. 2025)EvaluationLu et al. 2025 ClinVar benchmark: Missense & Intron (Non-splice) (Figure 1)Not reportedNot reportedNot reportedNot reportedNot reportedNot reported0.583Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
AlphaGenome all outputs, quantile, maximum (Lu et al. 2025)EvaluationLu et al. 2025 ClinVar benchmark: Missense & 3'UTR (Figure 1)Not reportedNot reportedNot reportedNot reportedNot reported0.508Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
AlphaGenome all outputs, quantile, maximum (Lu et al. 2025)EvaluationLu et al. 2025 ClinVar benchmark: Noncoding (Figure 1)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.991Not reportedNot reportedNot reportedNot reportedNot reportedNot reported
AlphaGenome all outputs, quantile, maximum (Lu et al. 2025)EvaluationLu et al. 2025 ClinVar benchmark: RNA gene (Figure 1)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.851Not reportedNot reportedNot reportedNot reportedNot reported
AlphaGenome all outputs, quantile, maximum (Lu et al. 2025)EvaluationLu et al. 2025 ClinVar benchmark: Splice (Figure 1)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.592Not reportedNot reportedNot reportedNot reported
AlphaGenome all outputs, quantile, maximum (Lu et al. 2025)EvaluationLu et al. 2025 ClinVar benchmark: Start loss (Figure 1)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.523Not reportedNot reportedNot reported
AlphaGenome all outputs, quantile, maximum (Lu et al. 2025)EvaluationLu et al. 2025 ClinVar benchmark: Stop gain (Figure 1)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.389Not reportedNot reported
AlphaGenome all outputs, quantile, maximum (Lu et al. 2025)EvaluationLu et al. 2025 ClinVar benchmark: Stop loss (Figure 1)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.362Not reported
AlphaGenome all outputs, quantile, maximum (Lu et al. 2025)EvaluationLu et al. 2025 ClinVar benchmark: Synonymous (Figure 1)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.919
AlphaGenome all outputs, quantile, maximum (Lu et al. 2025)EvaluationLu et al. 2025 ClinVar benchmark: 3' UTR (Figure 1)Not reported0.789Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
AlphaGenome all outputs, quantile, maximum (Lu et al. 2025)EvaluationLu et al. 2025 ClinVar benchmark: 5' UTR (Figure 1)Not reportedNot reported0.58Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
All 15 result rows with coverage, uncertainty and sources
Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: AlphaGenome all outputs, quantile, maximum (Lu et al. 2025)Protocol: ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)
Dataset subset: Lu et al. 2025 ClinVar benchmark: All variants (Figure 1)
0.31 AUROC (ClinVar pathogenic vs benign SNVs, All variants)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

AlphaGenome on ClinVar All variants SNVs (Lu et al. 2025 Figure 1)

lu-hetero-20261019-protocol-clinvar-variant-type-auroc

Aggregation: Not reported

Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2) · Figure 1 (page 8), column 1, panel 1 'All variants (N=258,944, %P=30.59%)', row 'AlphaGenome', bar label
Configuration: AlphaGenome all outputs, quantile, maximum (Lu et al. 2025)Protocol: ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)
Dataset subset: Lu et al. 2025 ClinVar benchmark: Intron (Non-splice) (Figure 1)
0.96 AUROC (ClinVar pathogenic vs benign SNVs, Intron (Non-splice))
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

AlphaGenome on ClinVar Intron (Non-splice) SNVs (Lu et al. 2025 Figure 1)

lu-hetero-20261019-protocol-clinvar-variant-type-auroc

Aggregation: Not reported

Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2) · Figure 1 (page 8), column 1, panel 3 'Intron (Non-splice) (N=88,049, %P=1.60%)', row 'AlphaGenome', bar label
Configuration: AlphaGenome all outputs, quantile, maximum (Lu et al. 2025)Protocol: ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)
Dataset subset: Lu et al. 2025 ClinVar benchmark: Missense (Figure 1)
0.56 AUROC (ClinVar pathogenic vs benign SNVs, Missense)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

AlphaGenome on ClinVar Missense SNVs (Lu et al. 2025 Figure 1)

lu-hetero-20261019-protocol-clinvar-variant-type-auroc

Aggregation: Not reported

Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2) · Figure 1 (page 8), column 3, panel 1 'Missense (N=50,820, %P=40.09%)', row 'AlphaGenome', bar label
Configuration: AlphaGenome all outputs, quantile, maximum (Lu et al. 2025)Protocol: ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)
Dataset subset: Lu et al. 2025 ClinVar benchmark: Missense & Intron (Non-splice) (Figure 1)
0.583 AUROC (ClinVar pathogenic vs benign SNVs, Missense & Intron (Non-splice))
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

AlphaGenome on ClinVar Missense & Intron (Non-splice) SNVs (Lu et al. 2025 Figure 1)

lu-hetero-20261019-protocol-clinvar-variant-type-auroc

Aggregation: Not reported

Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2) · Figure 1 (page 8), column 3, panel 2 'Missense & Intron (Non-splice) (N=255, %P=17.91%)', row 'AlphaGenome', bar label
Configuration: AlphaGenome all outputs, quantile, maximum (Lu et al. 2025)Protocol: ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)
Dataset subset: Lu et al. 2025 ClinVar benchmark: Missense & 3'UTR (Figure 1)
0.508 AUROC (ClinVar pathogenic vs benign SNVs, Missense & 3'UTR)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

AlphaGenome on ClinVar Missense & 3'UTR SNVs (Lu et al. 2025 Figure 1)

lu-hetero-20261019-protocol-clinvar-variant-type-auroc

Aggregation: Not reported

Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2) · Figure 1 (page 8), column 3, panel 3 'Missense & 3'UTR (N=117, %P=40.97%)', row 'AlphaGenome', bar label
Configuration: AlphaGenome all outputs, quantile, maximum (Lu et al. 2025)Protocol: ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)
Dataset subset: Lu et al. 2025 ClinVar benchmark: Noncoding (Figure 1)
0.991 AUROC (ClinVar pathogenic vs benign SNVs, Noncoding)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

AlphaGenome on ClinVar Noncoding SNVs (Lu et al. 2025 Figure 1)

lu-hetero-20261019-protocol-clinvar-variant-type-auroc

Aggregation: Not reported

Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2) · Figure 1 (page 8), column 1, panel 2 'Noncoding (N=118,256, %P=10.69%)', row 'AlphaGenome', bar label
Configuration: AlphaGenome all outputs, quantile, maximum (Lu et al. 2025)Protocol: ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)
Dataset subset: Lu et al. 2025 ClinVar benchmark: RNA gene (Figure 1)
0.851 AUROC (ClinVar pathogenic vs benign SNVs, RNA gene)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

AlphaGenome on ClinVar RNA gene SNVs (Lu et al. 2025 Figure 1)

lu-hetero-20261019-protocol-clinvar-variant-type-auroc

Aggregation: Not reported

Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2) · Figure 1 (page 8), column 2, panel 2 'RNA gene (N=131, %P=25.95%)', row 'AlphaGenome', bar label
Configuration: AlphaGenome all outputs, quantile, maximum (Lu et al. 2025)Protocol: ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)
Dataset subset: Lu et al. 2025 ClinVar benchmark: Splice (Figure 1)
0.592 AUROC (ClinVar pathogenic vs benign SNVs, Splice)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

AlphaGenome on ClinVar Splice SNVs (Lu et al. 2025 Figure 1)

lu-hetero-20261019-protocol-clinvar-variant-type-auroc

Aggregation: Not reported

Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2) · Figure 1 (page 8), column 1, panel 4 'Splice (N=11,042, %P=99.30%)', row 'AlphaGenome', bar label
Configuration: AlphaGenome all outputs, quantile, maximum (Lu et al. 2025)Protocol: ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)
Dataset subset: Lu et al. 2025 ClinVar benchmark: splice variants scored by AlphaGenome (Supplementary Figure S2)
0.614 AUROC (ClinVar pathogenic vs benign canonical splice SNVs (N=11,047); AlphaGenome scorer 'All outputs (quantile)')
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

AlphaGenome All outputs (quantile) on ClinVar splice variants (Lu et al. 2025 Supplementary Figure S2)

lu-hetero-20261019-protocol-clinvar-variant-type-auroc

Aggregation: Not reported

Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2) · Supplementary Figure S2 (page 21), row 'All outputs (quantile)', bar label
Configuration: AlphaGenome all outputs, quantile, maximum (Lu et al. 2025)Protocol: ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)
Dataset subset: Lu et al. 2025 ClinVar benchmark: Start loss (Figure 1)
0.523 AUROC (ClinVar pathogenic vs benign SNVs, Start loss)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

AlphaGenome on ClinVar Start loss SNVs (Lu et al. 2025 Figure 1)

lu-hetero-20261019-protocol-clinvar-variant-type-auroc

Aggregation: Not reported

Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2) · Figure 1 (page 8), column 2, panel 5 'Start loss (N=847, %P=97.53%)', row 'AlphaGenome', bar label
Configuration: AlphaGenome all outputs, quantile, maximum (Lu et al. 2025)Protocol: ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)
Dataset subset: Lu et al. 2025 ClinVar benchmark: Stop gain (Figure 1)
0.389 AUROC (ClinVar pathogenic vs benign SNVs, Stop gain)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

AlphaGenome on ClinVar Stop gain SNVs (Lu et al. 2025 Figure 1)

lu-hetero-20261019-protocol-clinvar-variant-type-auroc

Aggregation: Not reported

Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2) · Figure 1 (page 8), column 3, panel 4 'Stop gain (N=42,408, %P=98.13%)', row 'AlphaGenome', bar label
Configuration: AlphaGenome all outputs, quantile, maximum (Lu et al. 2025)Protocol: ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)
Dataset subset: Lu et al. 2025 ClinVar benchmark: Stop loss (Figure 1)
0.362 AUROC (ClinVar pathogenic vs benign SNVs, Stop loss)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

AlphaGenome on ClinVar Stop loss SNVs (Lu et al. 2025 Figure 1)

lu-hetero-20261019-protocol-clinvar-variant-type-auroc

Aggregation: Not reported

Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2) · Figure 1 (page 8), column 2, panel 4 'Stop loss (N=94, %P=75.53%)', row 'AlphaGenome', bar label
Configuration: AlphaGenome all outputs, quantile, maximum (Lu et al. 2025)Protocol: ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)
Dataset subset: Lu et al. 2025 ClinVar benchmark: Synonymous (Figure 1)
0.919 AUROC (ClinVar pathogenic vs benign SNVs, Synonymous)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

AlphaGenome on ClinVar Synonymous SNVs (Lu et al. 2025 Figure 1)

lu-hetero-20261019-protocol-clinvar-variant-type-auroc

Aggregation: Not reported

Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2) · Figure 1 (page 8), column 2, panel 3 'Synonymous (N=42,139, %P=0.66%)', row 'AlphaGenome', bar label
Configuration: AlphaGenome all outputs, quantile, maximum (Lu et al. 2025)Protocol: ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)
Dataset subset: Lu et al. 2025 ClinVar benchmark: 3' UTR (Figure 1)
0.789 AUROC (ClinVar pathogenic vs benign SNVs, 3' UTR)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

AlphaGenome on ClinVar 3' UTR SNVs (Lu et al. 2025 Figure 1)

lu-hetero-20261019-protocol-clinvar-variant-type-auroc

Aggregation: Not reported

Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2) · Figure 1 (page 8), column 1, panel 5 '3' UTR (N=11,851, %P=0.21%)', row 'AlphaGenome', bar label
Configuration: AlphaGenome all outputs, quantile, maximum (Lu et al. 2025)Protocol: ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)
Dataset subset: Lu et al. 2025 ClinVar benchmark: 5' UTR (Figure 1)
0.58 AUROC (ClinVar pathogenic vs benign SNVs, 5' UTR)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

AlphaGenome on ClinVar 5' UTR SNVs (Lu et al. 2025 Figure 1)

lu-hetero-20261019-protocol-clinvar-variant-type-auroc

Aggregation: Not reported

Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2) · Figure 1 (page 8), column 2, panel 1 '5' UTR (N=2,471, %P=2.38%)', row 'AlphaGenome', bar label

Source checking is not independent reproduction. Release 2026-11-02-a7f03c9e55a5.

Use this configuration

How it works, versions and access

Additional methodological details, versions and access terms have not yet been extracted into a structured profile for this configuration. Consult the linked sources and evaluation records below.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-02-a7f03c9e55a5
Property and statementOriginal source and locationReview and provenance

No evidence rows match these filters. Choose another scope or clear the search.

Sources and history

Release 2026-11-02-a7f03c9e55a5 · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: lu-hetero-20261019-config-alphagenome-all-outputs-quantile

areas
dna-genomes
contexts
clinical_research
method types
foundation_model
reported name
AlphaGenome
parameters
Official AlphaGenome API (deepmind.google.com/science/alphagenome), 1 Mbp input context centred on the variant, organism human, all output modalities enabled (5,930 human genomic annotations across 11 modalities). Recommended implementation: each output converted to quantiles; the variant gets the maximum percentile observed across all outputs, relevant or not to the variant type. Used for every Figure 1 panel.
access reuse
Official AlphaGenome API
source locator
Methods 'AlphaGenome' (pages 16 to 17); Supplementary Figure S2
missing metadata
model version: reason: unreported; note: API model version and query date not printed.
Related records

Suggest a correction