rewirebio.iobenchmarks
Contested result

Evo 2 and Nucleotide Transformer: BacBench LICENSE file at commit 64b7d45 reverses the order

  • Low severity
  • Not yet reviewed
  • Ordering reversal
  • unknown

BacBench LICENSE file at commit 64b7d45 ranks Nucleotide Transformer above Evo 2 in 10 of 10 comparisons; 4 of 4 other studies rank Evo 2 above Nucleotide Transformer.

An automatic lead, not a finding of error. The results below are shown as published, everywhere on the site, until a reviewer decides otherwise.

Which studies agree

6 papers rank Evo 2 above Nucleotide Transformer in 127 of their 147 comparisons and Nucleotide Transformer higher in 19; 1 is a tie. BacBench LICENSE file at commit 64b7d45 ranks Nucleotide Transformer above Evo 2 in all 10 of its comparisons.

Papers grouped by which system they rank higher: Evo 2 or Nucleotide TransformerRank Evo 2 higher: Genome modelling and design across all…, Genomic heterogeneity inflates…, mRNABench, RNAGym fitness leaderboard. Rank Nucleotide Transformer higher: BacBench LICENSE file at commit 64b7d45 (disagrees). Mixed: NABench, TraitGym official metrics.Rank Evo 2 higherMixedRank Nucleotide Transformer h…Genome modelling anddesign across all…Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026)Genomic heterogeneityinflates…Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2)mRNABenchmRNABench: A curated benchmark for mature mRNA property and function predictionRNAGym fitness leaderboardRNAGym fitness leaderboard (v0.1.1), leaderboard/fitness/README.mdNABenchNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness PredictionTraitGymofficial metricsTraitGym official metrics: AUPRC by chromosome, weighted average (Hugging Face dataset songlab/TraitGym)BacBench LICENSE fileat commit 64b7d45BacBench LICENSE file at commit 64b7d45
  • Rank Evo 2 higher (4): Genome modelling and design across all…, Genomic heterogeneity inflates…, mRNABench, RNAGym fitness leaderboard
  • Rank Nucleotide Transformer higher (1): BacBench LICENSE file at commit 64b7d45 (disagrees)
  • Mixed (2): NABench, TraitGym official metrics

Each paper sits where at least two thirds of its comparisons point; Mixed means neither model reaches two thirds. The larger, outlined dot is the paper that disagrees.

Comparisons in which each paper scores Evo 2 or Nucleotide Transformer higherBacBench LICENSE file at commit 64b7d45 (disagrees): Evo 2 higher in 0, Nucleotide Transformer higher in 10, 0 ties. Genome modelling and design across all…: Evo 2 higher in 90, Nucleotide Transformer higher in 0, 0 ties. NABench: Evo 2 higher in 11, Nucleotide Transformer higher in 16, 0 ties. Genomic heterogeneity inflates…: Evo 2 higher in 14, Nucleotide Transformer higher in 0, 0 ties. mRNABench: Evo 2 higher in 8, Nucleotide Transformer higher in 1, 1 tie. RNAGym fitness leaderboard: Evo 2 higher in 3, Nucleotide Transformer higher in 1, 0 ties. TraitGym official metrics: Evo 2 higher in 1, Nucleotide Transformer higher in 1, 0 ties.Disagrees: BacBench LICENSE file at commit 64b7d45BacBench LICENSE file at commit 64b7d4510 Nucleotide Transformer higher10Genome modelling and design across all…Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026)90 Evo 2 higher90NABenchNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction11 Evo 2 higher1116 Nucleotide Transformer higher16Genomic heterogeneity inflates…Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2)14 Evo 2 higher14mRNABenchmRNABench: A curated benchmark for mature mRNA property and function prediction8 Evo 2 higher81 tie11 Nucleotide Transformer higher1RNAGym fitness leaderboardRNAGym fitness leaderboard (v0.1.1), leaderboard/fitness/README.md3 Evo 2 higher31 Nucleotide Transformer higher1TraitGym official metricsTraitGym official metrics: AUPRC by chromosome, weighted average (Hugging Face dataset songlab/TraitGym)1 Evo 2 higher11 Nucleotide Transformer higher1
Evo 2 higherTieNucleotide Transformer higherNumbers are counts of comparisons; the outlined bar is the paper that disagrees.
Comparisons in BacBench LICENSE file at commit 64b7d45 (10)
ProtocolDatasetMetricEvo 2Nucleotide TransformerHigher
BacBench antibiotic resistance, binary linear probe AUPRCAntibiotic resistance binary prediction subset, 37 antibioticsAUPRC (linear head per drug on frozen genome embeddings, random 70/10/20 split, mean over 37 antibiotics), unitless38.459.7Nucleotide Transformer
BacBench antibiotic resistance, binary linear probe AUROCAntibiotic resistance binary prediction subset, 37 antibioticsAUROC (linear head per drug on frozen genome embeddings, random 70/10/20 split, mean over 37 antibiotics), unitless66.384.2Nucleotide Transformer
BacBench antibiotic resistance, MIC regression Pearson correlationAntibiotic resistance MIC regression subset, 56 antibioticsPearson (linear head per drug on frozen genome embeddings predicting log(1+MIC), random 70/10/20 split, mean over 56 antibiotics, printed as a percentage), unitless0.5351.2Nucleotide Transformer
BacBench antibiotic resistance, MIC regression R squaredAntibiotic resistance MIC regression subset, 56 antibioticsR² (linear head per drug on frozen genome embeddings predicting log(1+MIC), random 70/10/20 split, mean over 56 antibiotics, printed as a percentage), unitless3.9527.7Nucleotide Transformer
BacBench essential gene prediction, linear probe AUPRCBacBench essential gene dataset from the Database of Essential GenesAUPRC (linear head on frozen gene embeddings, genus-level split, median over held-out test genomes), unitless15.426Nucleotide Transformer
BacBench essential gene prediction, linear probe AUROCBacBench essential gene dataset from the Database of Essential GenesAUROC (linear head on frozen gene embeddings, genus-level split, median over held-out test genomes), unitless5665.7Nucleotide Transformer
BacBench phenotypic trait prediction, linear probe AUPRCBacBench phenotypic trait datasetAUPRC (linear head per trait on frozen genome embeddings, macro-averaged across classes of each trait, genus-level split, mean over traits and seeds), unitless2543Nucleotide Transformer
BacBench phenotypic trait prediction, linear probe AUROCBacBench phenotypic trait datasetAUROC (linear head per trait on frozen genome embeddings, macro-averaged across classes of each trait, genus-level split, mean over traits and seeds), unitless55.466Nucleotide Transformer
BacBench protein-protein interaction, linear probe AUPRCBacBench protein-protein interaction dataset from STRING DBAUPRC (linear head on frozen pair embeddings plus their cosine similarity, genus-level split, mean over held-out test genomes), unitless1631.7Nucleotide Transformer
BacBench protein-protein interaction, linear probe AUROCBacBench protein-protein interaction dataset from STRING DBAUROC (linear head on frozen pair embeddings plus their cosine similarity, genus-level split, mean over held-out test genomes), unitless5063.9Nucleotide Transformer
Comparisons in Genome modelling and design across all… (90)
ProtocolDatasetMetricEvo 2Nucleotide TransformerHigher
Zero-shot BRCA1 'Both' (coding and noncoding) SNVs classification (Evo 2 paper, Supplementary Data 1)BRCA1 saturation genome editing SNVs, Findlay et al. 2018 classes (Brixi et al. 2026)AUPRC (zero-shot; BRCA1 'Both' (coding and noncoding) SNVs), unitless0.6770.285Evo 2
Zero-shot BRCA1 'Both' (coding and noncoding) SNVs classification (Evo 2 paper, Supplementary Data 1)BRCA1 saturation genome editing SNVs, Findlay et al. 2018 classes (Brixi et al. 2026)AUROC (zero-shot; BRCA1 'Both' (coding and noncoding) SNVs), unitless0.9010.55Evo 2
Zero-shot BRCA1 coding SNVs classification (Evo 2 paper, Supplementary Data 1)BRCA1 saturation genome editing SNVs, Findlay et al. 2018 classes (Brixi et al. 2026)AUPRC (zero-shot; BRCA1 coding SNVs), unitless0.5720.212Evo 2
Zero-shot BRCA1 coding SNVs classification (Evo 2 paper, Supplementary Data 1)BRCA1 saturation genome editing SNVs, Findlay et al. 2018 classes (Brixi et al. 2026)AUROC (zero-shot; BRCA1 coding SNVs), unitless0.8430.509Evo 2
Zero-shot BRCA1 intronic SNVs classification (Evo 2 paper, Supplementary Data 1)BRCA1 saturation genome editing SNVs, Findlay et al. 2018 classes (Brixi et al. 2026)AUPRC (zero-shot; BRCA1 intronic SNVs), unitless0.4240.0725Evo 2
Zero-shot BRCA1 intronic SNVs classification (Evo 2 paper, Supplementary Data 1)BRCA1 saturation genome editing SNVs, Findlay et al. 2018 classes (Brixi et al. 2026)AUROC (zero-shot; BRCA1 intronic SNVs), unitless0.8870.688Evo 2
Zero-shot BRCA1 noncoding SNVs classification (Evo 2 paper, Supplementary Data 1)BRCA1 saturation genome editing SNVs, Findlay et al. 2018 classes (Brixi et al. 2026)AUPRC (zero-shot; BRCA1 noncoding SNVs), unitless0.9030.451Evo 2
Zero-shot BRCA1 noncoding SNVs classification (Evo 2 paper, Supplementary Data 1)BRCA1 saturation genome editing SNVs, Findlay et al. 2018 classes (Brixi et al. 2026)AUROC (zero-shot; BRCA1 noncoding SNVs), unitless0.9740.649Evo 2
Zero-shot BRCA1 splice region SNVs classification (Evo 2 paper, Supplementary Data 1)BRCA1 saturation genome editing SNVs, Findlay et al. 2018 classes (Brixi et al. 2026)AUPRC (zero-shot; BRCA1 splice region SNVs), unitless0.9180.611Evo 2
Zero-shot BRCA1 splice region SNVs classification (Evo 2 paper, Supplementary Data 1)BRCA1 saturation genome editing SNVs, Findlay et al. 2018 classes (Brixi et al. 2026)AUROC (zero-shot; BRCA1 splice region SNVs), unitless0.9590.634Evo 2
Zero-shot BRCA2 'Both' (coding and noncoding) SNVs classification (Evo 2 paper, Supplementary Data 1)BRCA2 SNVs with functional classifications, Huang et al. 2025 (Brixi et al. 2026)AUPRC (zero-shot; BRCA2 'Both' (coding and noncoding) SNVs), unitless0.5330.176Evo 2
Zero-shot BRCA2 'Both' (coding and noncoding) SNVs classification (Evo 2 paper, Supplementary Data 1)BRCA2 SNVs with functional classifications, Huang et al. 2025 (Brixi et al. 2026)AUROC (zero-shot; BRCA2 'Both' (coding and noncoding) SNVs), unitless0.8450.514Evo 2
Zero-shot BRCA2 coding SNVs classification (Evo 2 paper, Supplementary Data 1)BRCA2 SNVs with functional classifications, Huang et al. 2025 (Brixi et al. 2026)AUPRC (zero-shot; BRCA2 coding SNVs), unitless0.3330.134Evo 2
Zero-shot BRCA2 coding SNVs classification (Evo 2 paper, Supplementary Data 1)BRCA2 SNVs with functional classifications, Huang et al. 2025 (Brixi et al. 2026)AUROC (zero-shot; BRCA2 coding SNVs), unitless0.7680.501Evo 2
Zero-shot BRCA2 noncoding SNVs classification (Evo 2 paper, Supplementary Data 1)BRCA2 SNVs with functional classifications, Huang et al. 2025 (Brixi et al. 2026)AUPRC (zero-shot; BRCA2 noncoding SNVs), unitless0.7860.361Evo 2
Zero-shot BRCA2 noncoding SNVs classification (Evo 2 paper, Supplementary Data 1)BRCA2 SNVs with functional classifications, Huang et al. 2025 (Brixi et al. 2026)AUROC (zero-shot; BRCA2 noncoding SNVs), unitless0.910.555Evo 2
Zero-shot ClinVar 'Both' (coding and noncoding) indels classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUPRC (zero-shot; ClinVar 'Both' (coding and noncoding) indels), unitless0.9950.852Evo 2
Zero-shot ClinVar 'Both' (coding and noncoding) indels classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUROC (zero-shot; ClinVar 'Both' (coding and noncoding) indels), unitless0.9830.505Evo 2
Zero-shot ClinVar 'Both' (coding and noncoding) microsatellite variants classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUPRC (zero-shot; ClinVar 'Both' (coding and noncoding) microsatellite variants), unitless0.9870.461Evo 2
Zero-shot ClinVar 'Both' (coding and noncoding) microsatellite variants classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUROC (zero-shot; ClinVar 'Both' (coding and noncoding) microsatellite variants), unitless0.9820.53Evo 2
Zero-shot ClinVar 'Both' (coding and noncoding) SNVs classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUPRC (zero-shot; ClinVar 'Both' (coding and noncoding) SNVs), unitless0.950.426Evo 2
Zero-shot ClinVar 'Both' (coding and noncoding) SNVs classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUROC (zero-shot; ClinVar 'Both' (coding and noncoding) SNVs), unitless0.970.506Evo 2
Zero-shot ClinVar coding indels classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUPRC (zero-shot; ClinVar coding indels), unitless0.9520.701Evo 2
Zero-shot ClinVar coding indels classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUROC (zero-shot; ClinVar coding indels), unitless0.9040.503Evo 2
Zero-shot ClinVar coding microsatellite variants classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUPRC (zero-shot; ClinVar coding microsatellite variants), unitless0.8120.171Evo 2
Zero-shot ClinVar coding microsatellite variants classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUROC (zero-shot; ClinVar coding microsatellite variants), unitless0.8420.535Evo 2
Zero-shot ClinVar coding non-SNVs, far from splice site classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUPRC (zero-shot; ClinVar coding non-SNVs, far from splice site), unitless0.9480.671Evo 2
Zero-shot ClinVar coding non-SNVs, far from splice site classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUROC (zero-shot; ClinVar coding non-SNVs, far from splice site), unitless0.9110.507Evo 2
Zero-shot ClinVar coding non-SNVs, highly conserved classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUPRC (zero-shot; ClinVar coding non-SNVs, highly conserved), unitless0.9740.937Evo 2
Zero-shot ClinVar coding non-SNVs, highly conserved classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUROC (zero-shot; ClinVar coding non-SNVs, highly conserved), unitless0.790.521Evo 2
Zero-shot ClinVar coding non-SNVs, moderately conserved classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUPRC (zero-shot; ClinVar coding non-SNVs, moderately conserved), unitless0.9140.694Evo 2
Zero-shot ClinVar coding non-SNVs, moderately conserved classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUROC (zero-shot; ClinVar coding non-SNVs, moderately conserved), unitless0.8130.517Evo 2
Zero-shot ClinVar coding non-SNVs, not conserved classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUPRC (zero-shot; ClinVar coding non-SNVs, not conserved), unitless0.8350.577Evo 2
Zero-shot ClinVar coding non-SNVs, not conserved classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUROC (zero-shot; ClinVar coding non-SNVs, not conserved), unitless0.7570.52Evo 2
Zero-shot ClinVar coding non-SNVs, poorly conserved classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUPRC (zero-shot; ClinVar coding non-SNVs, poorly conserved), unitless0.8890.568Evo 2
Zero-shot ClinVar coding non-SNVs, poorly conserved classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUROC (zero-shot; ClinVar coding non-SNVs, poorly conserved), unitless0.820.501Evo 2
Zero-shot ClinVar coding SNVs classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUPRC (zero-shot; ClinVar coding SNVs), unitless0.8890.659Evo 2
Zero-shot ClinVar coding SNVs classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUROC (zero-shot; ClinVar coding SNVs), unitless0.8410.505Evo 2
Zero-shot ClinVar coding SNVs, far from splice site classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUPRC (zero-shot; ClinVar coding SNVs, far from splice site), unitless0.8850.649Evo 2
Zero-shot ClinVar coding SNVs, far from splice site classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUROC (zero-shot; ClinVar coding SNVs, far from splice site), unitless0.8410.506Evo 2
Zero-shot ClinVar coding SNVs, highly conserved classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUPRC (zero-shot; ClinVar coding SNVs, highly conserved), unitless0.9180.797Evo 2
Zero-shot ClinVar coding SNVs, highly conserved classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUROC (zero-shot; ClinVar coding SNVs, highly conserved), unitless0.7760.501Evo 2
Zero-shot ClinVar coding SNVs, moderately conserved classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUPRC (zero-shot; ClinVar coding SNVs, moderately conserved), unitless0.6670.323Evo 2
Zero-shot ClinVar coding SNVs, moderately conserved classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUROC (zero-shot; ClinVar coding SNVs, moderately conserved), unitless0.830.514Evo 2
Zero-shot ClinVar coding SNVs, near splice site classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUPRC (zero-shot; ClinVar coding SNVs, near splice site), unitless0.9310.777Evo 2
Zero-shot ClinVar coding SNVs, near splice site classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUROC (zero-shot; ClinVar coding SNVs, near splice site), unitless0.8270.509Evo 2
Zero-shot ClinVar coding SNVs, not conserved classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUPRC (zero-shot; ClinVar coding SNVs, not conserved), unitless0.520.144Evo 2
Zero-shot ClinVar coding SNVs, not conserved classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUROC (zero-shot; ClinVar coding SNVs, not conserved), unitless0.8680.545Evo 2
Zero-shot ClinVar coding SNVs, poorly conserved classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUPRC (zero-shot; ClinVar coding SNVs, poorly conserved), unitless0.6020.193Evo 2
Zero-shot ClinVar coding SNVs, poorly conserved classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUROC (zero-shot; ClinVar coding SNVs, poorly conserved), unitless0.860.526Evo 2
Zero-shot ClinVar low SpliceAI and Pangolin scores (both below 0.1) non-SNVs classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUPRC (zero-shot; ClinVar low SpliceAI and Pangolin scores (both below 0.1) non-SNVs), unitless0.60.0157Evo 2
Zero-shot ClinVar low SpliceAI and Pangolin scores (both below 0.1) non-SNVs classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUROC (zero-shot; ClinVar low SpliceAI and Pangolin scores (both below 0.1) non-SNVs), unitless0.9090.51Evo 2
Zero-shot ClinVar low SpliceAI and Pangolin scores (both below 0.1) SNVs classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUPRC (zero-shot; ClinVar low SpliceAI and Pangolin scores (both below 0.1) SNVs), unitless0.3110.00545Evo 2
Zero-shot ClinVar low SpliceAI and Pangolin scores (both below 0.1) SNVs classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUROC (zero-shot; ClinVar low SpliceAI and Pangolin scores (both below 0.1) SNVs), unitless0.920.52Evo 2
Zero-shot ClinVar noncoding indels classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUPRC (zero-shot; ClinVar noncoding indels), unitless0.9170.177Evo 2
Zero-shot ClinVar noncoding indels classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUROC (zero-shot; ClinVar noncoding indels), unitless0.9710.505Evo 2
Zero-shot ClinVar noncoding microsatellite variants classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUPRC (zero-shot; ClinVar noncoding microsatellite variants), unitless0.8330.0364Evo 2
Zero-shot ClinVar noncoding microsatellite variants classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUROC (zero-shot; ClinVar noncoding microsatellite variants), unitless0.9970.786Evo 2
Zero-shot ClinVar noncoding non-SNVs, far from splice site classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUPRC (zero-shot; ClinVar noncoding non-SNVs, far from splice site), unitless0.7440.0443Evo 2
Zero-shot ClinVar noncoding non-SNVs, far from splice site classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUROC (zero-shot; ClinVar noncoding non-SNVs, far from splice site), unitless0.9230.518Evo 2
Zero-shot ClinVar noncoding non-SNVs, highly conserved classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUPRC (zero-shot; ClinVar noncoding non-SNVs, highly conserved), unitless0.9740.732Evo 2
Zero-shot ClinVar noncoding non-SNVs, highly conserved classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUROC (zero-shot; ClinVar noncoding non-SNVs, highly conserved), unitless0.9490.503Evo 2
Zero-shot ClinVar noncoding non-SNVs, intergenic classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUPRC (zero-shot; ClinVar noncoding non-SNVs, intergenic), unitless0.8750.729Evo 2
Zero-shot ClinVar noncoding non-SNVs, intergenic classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUROC (zero-shot; ClinVar noncoding non-SNVs, intergenic), unitless0.750.625Evo 2
Zero-shot ClinVar noncoding non-SNVs, moderately conserved classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUPRC (zero-shot; ClinVar noncoding non-SNVs, moderately conserved), unitless0.8620.164Evo 2
Zero-shot ClinVar noncoding non-SNVs, moderately conserved classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUROC (zero-shot; ClinVar noncoding non-SNVs, moderately conserved), unitless0.9580.502Evo 2
Zero-shot ClinVar noncoding non-SNVs, near splice site classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUPRC (zero-shot; ClinVar noncoding non-SNVs, near splice site), unitless0.9630.5Evo 2
Zero-shot ClinVar noncoding non-SNVs, near splice site classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUROC (zero-shot; ClinVar noncoding non-SNVs, near splice site), unitless0.9680.519Evo 2
Zero-shot ClinVar noncoding non-SNVs, not conserved classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUPRC (zero-shot; ClinVar noncoding non-SNVs, not conserved), unitless0.3620.0471Evo 2
Zero-shot ClinVar noncoding non-SNVs, not conserved classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUROC (zero-shot; ClinVar noncoding non-SNVs, not conserved), unitless0.7990.584Evo 2
Zero-shot ClinVar noncoding non-SNVs, poorly conserved classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUPRC (zero-shot; ClinVar noncoding non-SNVs, poorly conserved), unitless0.4980.0243Evo 2
Zero-shot ClinVar noncoding non-SNVs, poorly conserved classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUROC (zero-shot; ClinVar noncoding non-SNVs, poorly conserved), unitless0.8930.543Evo 2
Zero-shot ClinVar noncoding SNVs, far from splice site classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUPRC (zero-shot; ClinVar noncoding SNVs, far from splice site), unitless0.3430.0145Evo 2
Zero-shot ClinVar noncoding SNVs, far from splice site classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUROC (zero-shot; ClinVar noncoding SNVs, far from splice site), unitless0.8550.51Evo 2
Zero-shot ClinVar noncoding SNVs, highly conserved classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUPRC (zero-shot; ClinVar noncoding SNVs, highly conserved), unitless0.9940.92Evo 2
Zero-shot ClinVar noncoding SNVs, highly conserved classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUROC (zero-shot; ClinVar noncoding SNVs, highly conserved), unitless0.9650.552Evo 2
Zero-shot ClinVar noncoding SNVs, intergenic classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUPRC (zero-shot; ClinVar noncoding SNVs, intergenic), unitless0.7750.216Evo 2
Zero-shot ClinVar noncoding SNVs, intergenic classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUROC (zero-shot; ClinVar noncoding SNVs, intergenic), unitless0.8740.655Evo 2
Zero-shot ClinVar noncoding SNVs, moderately conserved classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUPRC (zero-shot; ClinVar noncoding SNVs, moderately conserved), unitless0.7920.0773Evo 2
Zero-shot ClinVar noncoding SNVs, moderately conserved classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUROC (zero-shot; ClinVar noncoding SNVs, moderately conserved), unitless0.9410.523Evo 2
Zero-shot ClinVar noncoding SNVs, near splice site classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUPRC (zero-shot; ClinVar noncoding SNVs, near splice site), unitless0.9970.841Evo 2
Zero-shot ClinVar noncoding SNVs, near splice site classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUROC (zero-shot; ClinVar noncoding SNVs, near splice site), unitless0.9880.533Evo 2
Zero-shot ClinVar noncoding SNVs, not conserved classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUPRC (zero-shot; ClinVar noncoding SNVs, not conserved), unitless0.3560.011Evo 2
Zero-shot ClinVar noncoding SNVs, not conserved classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUROC (zero-shot; ClinVar noncoding SNVs, not conserved), unitless0.8480.516Evo 2
Zero-shot ClinVar noncoding SNVs, poorly conserved classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUPRC (zero-shot; ClinVar noncoding SNVs, poorly conserved), unitless0.5540.023Evo 2
Zero-shot ClinVar noncoding SNVs, poorly conserved classification (Evo 2 paper, Supplementary Data 1)ClinVar October 2024 release, filtered (Brixi et al. 2026)AUROC (zero-shot; ClinVar noncoding SNVs, poorly conserved), unitless0.8970.502Evo 2
Zero-shot SpliceVarDB 'Both' (coding and noncoding) SNVs classification (Evo 2 paper, Supplementary Data 1)SpliceVarDB experimentally validated splice variants (Brixi et al. 2026)AUPRC (zero-shot; SpliceVarDB 'Both' (coding and noncoding) SNVs), unitless0.850.601Evo 2
Zero-shot SpliceVarDB 'Both' (coding and noncoding) SNVs classification (Evo 2 paper, Supplementary Data 1)SpliceVarDB experimentally validated splice variants (Brixi et al. 2026)AUROC (zero-shot; SpliceVarDB 'Both' (coding and noncoding) SNVs), unitless0.8150.491Evo 2
Zero-shot SpliceVarDB exonic SNVs classification (Evo 2 paper, Supplementary Data 1)SpliceVarDB experimentally validated splice variants (Brixi et al. 2026)AUPRC (zero-shot; SpliceVarDB exonic SNVs), unitless0.5230.385Evo 2
Zero-shot SpliceVarDB exonic SNVs classification (Evo 2 paper, Supplementary Data 1)SpliceVarDB experimentally validated splice variants (Brixi et al. 2026)AUROC (zero-shot; SpliceVarDB exonic SNVs), unitless0.6840.49Evo 2
Comparisons in NABench (27)
ProtocolDatasetMetricEvo 2Nucleotide TransformerHigher
NABench FS-CORR-APTAMER: Fitness prediction on aptamer assays, few-shotNABench aptamer assays (NABench split)Spearman, unitless0.0950.166Nucleotide Transformer
NABench FS-CORR-ENHANCER: Fitness prediction on enhancer assays, few-shotNABench enhancer assays (NABench split)Spearman, unitless0.0480.053Nucleotide Transformer
NABench FS-CORR-MRNA: Fitness prediction on mRNA assays, few-shotNABench mRNA assays (NABench split)Spearman, unitless0.2070.256Nucleotide Transformer
NABench FS-CORR-PROMOTER: Fitness prediction on promoter assays, few-shotNABench promoter assays (NABench split)Spearman, unitless0.0670.071Nucleotide Transformer
NABench FS-CORR-RIBOZYME: Fitness prediction on ribozyme assays, few-shotNABench ribozyme assays (NABench split)Spearman, unitless0.0790.135Nucleotide Transformer
NABench RCV-CORR-APTAMER: Fitness prediction on aptamer assays, supervised, random cross validationNABench aptamer assays (NABench split)Spearman, unitless0.1720.36Nucleotide Transformer
NABench RCV-CORR-ENHANCER: Fitness prediction on enhancer assays, supervised, random cross validationNABench enhancer assays (NABench split)Spearman, unitless0.0920.21Nucleotide Transformer
NABench RCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, random cross validationNABench mRNA assays (NABench split)Spearman, unitless0.4290.56Nucleotide Transformer
NABench RCV-CORR-PROMOTER: Fitness prediction on promoter assays, supervised, random cross validationNABench promoter assays (NABench split)Spearman, unitless0.2490.636Nucleotide Transformer
NABench RCV-CORR-RIBOZYME: Fitness prediction on ribozyme assays, supervised, random cross validationNABench ribozyme assays (NABench split)Spearman, unitless0.2020.429Nucleotide Transformer
NABench RCV-CORR-TRNA: Fitness prediction on tRNA assays, supervised, random cross validationNABench tRNA assays (NABench split)Spearman, unitless0.3930.433Nucleotide Transformer
NABench SELEX-FS: Overall fitness prediction on NABench SELEX assays, Few-shot Spearman ρNABench SELEX assays (NABench split)Spearman, unitless0.5540.564Nucleotide Transformer
NABench SELEX-RCV: Overall fitness prediction on NABench SELEX assays, Random cross validation Spearman ρNABench SELEX assays (NABench split)Spearman, unitless0.5970.626Nucleotide Transformer
NABench SELEX-ZS-AUC: Overall fitness prediction on NABench SELEX assays, Zero-shot AUCNABench SELEX assays (NABench split)AUROC, unitless0.5560.526Evo 2
NABench SELEX-ZS-CORR: Overall fitness prediction on NABench SELEX assays, Zero-shot Spearman ρNABench SELEX assays (NABench split)Spearman, unitless0.1010.039Evo 2
NABench SELEX-ZS-MCC: Overall fitness prediction on NABench SELEX assays, Zero-shot MCCNABench SELEX assays (NABench split)MCC, unitless0.0620.027Evo 2
NABench SELEX-ZS-NDCG: Overall fitness prediction on NABench SELEX assays, Zero-shot NDCGNABench SELEX assays (NABench split)NDCG (cutoff not stated), unitless0.3210.195Evo 2
NABench ZS-AUC-APTAMER: Fitness prediction on aptamer assays, zero-shotNABench aptamer assays (NABench split)AUROC, unitless0.5410.524Evo 2
NABench ZS-AUC-ENHANCER: Fitness prediction on enhancer assays, zero-shotNABench enhancer assays (NABench split)AUROC, unitless0.5540.528Evo 2
NABench ZS-AUC-MRNA: Fitness prediction on mRNA assays, zero-shotNABench mRNA assays (NABench split)AUROC, unitless0.5750.521Evo 2
NABench ZS-AUC-PROMOTER: Fitness prediction on promoter assays, zero-shotNABench promoter assays (NABench split)AUROC, unitless0.5370.573Nucleotide Transformer
NABench ZS-AUC-RIBOZYME: Fitness prediction on ribozyme assays, zero-shotNABench ribozyme assays (NABench split)AUROC, unitless0.5530.537Evo 2
NABench ZS-CORR-APTAMER: Fitness prediction on aptamer assays, zero-shotNABench aptamer assays (NABench split)Spearman, unitless0.0660.081Nucleotide Transformer
NABench ZS-CORR-ENHANCER: Fitness prediction on enhancer assays, zero-shotNABench enhancer assays (NABench split)Spearman, unitless0.0680.006Evo 2
NABench ZS-CORR-MRNA: Fitness prediction on mRNA assays, zero-shotNABench mRNA assays (NABench split)Spearman, unitless0.1230.074Evo 2
NABench ZS-CORR-PROMOTER: Fitness prediction on promoter assays, zero-shotNABench promoter assays (NABench split)Spearman, unitless0.0650.091Nucleotide Transformer
NABench ZS-CORR-RIBOZYME: Fitness prediction on ribozyme assays, zero-shotNABench ribozyme assays (NABench split)Spearman, unitless0.1010.064Evo 2
Comparisons in Genomic heterogeneity inflates… (14)
ProtocolDatasetMetricEvo 2Nucleotide TransformerHigher
ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)Lu et al. 2025 ClinVar benchmark: All variants (Figure 1)AUROC (ClinVar pathogenic vs benign SNVs, All variants), unitless0.9690.793Evo 2
ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)Lu et al. 2025 ClinVar benchmark: Intron (Non-splice) (Figure 1)AUROC (ClinVar pathogenic vs benign SNVs, Intron (Non-splice)), unitless0.9030.75Evo 2
ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)Lu et al. 2025 ClinVar benchmark: Missense (Figure 1)AUROC (ClinVar pathogenic vs benign SNVs, Missense), unitless0.8360.594Evo 2
ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)Lu et al. 2025 ClinVar benchmark: Missense & Intron (Non-splice) (Figure 1)AUROC (ClinVar pathogenic vs benign SNVs, Missense & Intron (Non-splice)), unitless0.8350.664Evo 2
ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)Lu et al. 2025 ClinVar benchmark: Missense & 3'UTR (Figure 1)AUROC (ClinVar pathogenic vs benign SNVs, Missense & 3'UTR), unitless0.8960.546Evo 2
ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)Lu et al. 2025 ClinVar benchmark: Noncoding (Figure 1)AUROC (ClinVar pathogenic vs benign SNVs, Noncoding), unitless0.9750.851Evo 2
ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)Lu et al. 2025 ClinVar benchmark: RNA gene (Figure 1)AUROC (ClinVar pathogenic vs benign SNVs, RNA gene), unitless0.4590.371Evo 2
ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)Lu et al. 2025 ClinVar benchmark: Splice (Figure 1)AUROC (ClinVar pathogenic vs benign SNVs, Splice), unitless0.6970.617Evo 2
ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)Lu et al. 2025 ClinVar benchmark: Start loss (Figure 1)AUROC (ClinVar pathogenic vs benign SNVs, Start loss), unitless0.7110.569Evo 2
ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)Lu et al. 2025 ClinVar benchmark: Stop gain (Figure 1)AUROC (ClinVar pathogenic vs benign SNVs, Stop gain), unitless0.6630.618Evo 2
ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)Lu et al. 2025 ClinVar benchmark: Stop loss (Figure 1)AUROC (ClinVar pathogenic vs benign SNVs, Stop loss), unitless0.8260.609Evo 2
ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)Lu et al. 2025 ClinVar benchmark: Synonymous (Figure 1)AUROC (ClinVar pathogenic vs benign SNVs, Synonymous), unitless0.8850.77Evo 2
ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)Lu et al. 2025 ClinVar benchmark: 3' UTR (Figure 1)AUROC (ClinVar pathogenic vs benign SNVs, 3' UTR), unitless0.7470.564Evo 2
ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)Lu et al. 2025 ClinVar benchmark: 5' UTR (Figure 1)AUROC (ClinVar pathogenic vs benign SNVs, 5' UTR), unitless0.7670.567Evo 2
Comparisons in mRNABench (10)
Comparisons in RNAGym fitness leaderboard (4)
ProtocolDatasetMetricEvo 2Nucleotide TransformerHigher
RNAGym v0.1.1 fitness, signed Spearman, AptamerRNAGym Aptamer DMS assays (2)Spearman (mean signed Spearman over the 2 Aptamer assays), unitless0.097-0.0886Evo 2
RNAGym v0.1.1 fitness, signed Spearman, macro over 3 ncRNA categoriesRNAGym ncRNA DMS assays (31)Spearman (macro-mean over 3 ncRNA categories (equal category weights)), unitless0.2120.12Evo 2
RNAGym v0.1.1 fitness, signed Spearman, RibozymeRNAGym Ribozyme DMS assays (26)Spearman (mean signed Spearman over the 26 Ribozyme assays), unitless0.1080.133Nucleotide Transformer
RNAGym v0.1.1 fitness, signed Spearman, tRNARNAGym tRNA DMS assays (3)Spearman (mean signed Spearman over the 3 tRNA assays), unitless0.4310.317Evo 2
Comparisons in TraitGym official metrics (2)
ProtocolDatasetMetricEvo 2Nucleotide TransformerHigher
TraitGym Complex traits, zero-shot, AUPRC by chromosome weighted averageTraitGym Complex traits, matched 9 controlsAUPRC (weighted average over chromosomes of per-chromosome AUPRC; subset 'all'), unitless0.09760.1Nucleotide Transformer
TraitGym Mendelian traits, zero-shot, AUPRC by chromosome weighted averageTraitGym Mendelian traits, matched 9 controlsAUPRC (weighted average over chromosomes of per-chromosome AUPRC; subset 'all'), unitless0.1590.0981Evo 2

What disagrees

Other studies
rank Evo 2 above Nucleotide Transformer in 115 of 117 comparisons
This study
ranks Nucleotide Transformer above Evo 2 in 10 of 10 comparisons
Compared
Evo 2, Nucleotide Transformer
Study that disagrees
BacBench LICENSE file at commit 64b7d45, BacBench repository README at commit 64b7d45, Bacformer LICENSE file at commit 61dca95, Bacformer repository README at commit 61dca95, Hugging Face model card for macwiatrak/bacformer-causal-complete-genomes, Hugging Face model card for macwiatrak/bacformer-causal-MAG, Hugging Face model card for macwiatrak/bacformer-for-ppi-prediction, Hugging Face model card for macwiatrak/bacformer-large-masked-complete-genomes, Hugging Face model card for macwiatrak/bacformer-large-masked-MAG, Hugging Face model card for macwiatrak/bacformer-masked-complete-genomes, Hugging Face model card for macwiatrak/bacformer-masked-MAG, Bacformer preprint, bioRxiv 2025.07.20.665723 version 2, Bacformer preprint, bioRxiv 2025.07.20.665723 version 3
Other studies
6 studiesmRNABench: A curated benchmark for mature mRNA property and function prediction, Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026), Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026), RNAGym fitness leaderboard (v0.1.1), leaderboard/fitness/README.md, Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2), mRNABench: A curated benchmark for mature mRNA property and function prediction
Rule
Ordering reversal; unknown
Model identity
Matched across studies partly through links not yet reviewed

The compared numbers

Each value links to its result record and source. Compare values within one protocol; the rule compares rankings, not raw values across protocols.

In the study that disagrees (20)
StudyToolProtocol or benchmarkMetricValue
Bacformer preprint, bioRxiv 2025.07.20.665723 version 3Evo-2 (frozen embeddings with a trained linear head)BacBench antibiotic resistance, binary linear probe AUPRCAUPRC (linear head per drug on frozen genome embeddings, random 70/10/20 split, mean over 37 antibiotics)38.35 ± 23.08
Bacformer preprint, bioRxiv 2025.07.20.665723 version 3Evo-2 (frozen embeddings with a trained linear head)BacBench antibiotic resistance, binary linear probe AUROCAUROC (linear head per drug on frozen genome embeddings, random 70/10/20 split, mean over 37 antibiotics)66.27 ± 10.19
Bacformer preprint, bioRxiv 2025.07.20.665723 version 3Evo-2 (frozen embeddings with a trained linear head)BacBench antibiotic resistance, MIC regression Pearson correlationPearson (linear head per drug on frozen genome embeddings predicting log(1+MIC), random 70/10/20 split, mean over 56 antibiotics, printed as a percentage)00.53 ± 00.72
Bacformer preprint, bioRxiv 2025.07.20.665723 version 3Evo-2 (frozen embeddings with a trained linear head)BacBench antibiotic resistance, MIC regression R squaredR² (linear head per drug on frozen genome embeddings predicting log(1+MIC), random 70/10/20 split, mean over 56 antibiotics, printed as a percentage)03.95 ± 21.04
Bacformer preprint, bioRxiv 2025.07.20.665723 version 3Nucleotide Transformer (frozen embeddings with a trained linear head)BacBench antibiotic resistance, binary linear probe AUPRCAUPRC (linear head per drug on frozen genome embeddings, random 70/10/20 split, mean over 37 antibiotics)59.70 ± 22.90
Bacformer preprint, bioRxiv 2025.07.20.665723 version 3Nucleotide Transformer (frozen embeddings with a trained linear head)BacBench antibiotic resistance, binary linear probe AUROCAUROC (linear head per drug on frozen genome embeddings, random 70/10/20 split, mean over 37 antibiotics)84.22 ± 6.47
Bacformer preprint, bioRxiv 2025.07.20.665723 version 3Nucleotide Transformer (frozen embeddings with a trained linear head)BacBench antibiotic resistance, MIC regression Pearson correlationPearson (linear head per drug on frozen genome embeddings predicting log(1+MIC), random 70/10/20 split, mean over 56 antibiotics, printed as a percentage)51.19 ± 16.76
Bacformer preprint, bioRxiv 2025.07.20.665723 version 3Nucleotide Transformer (frozen embeddings with a trained linear head)BacBench antibiotic resistance, MIC regression R squaredR² (linear head per drug on frozen genome embeddings predicting log(1+MIC), random 70/10/20 split, mean over 56 antibiotics, printed as a percentage)27.74 ± 17.80
Bacformer preprint, bioRxiv 2025.07.20.665723 version 3Evo-2 (frozen embeddings with a trained linear head)BacBench essential gene prediction, linear probe AUPRCAUPRC (linear head on frozen gene embeddings, genus-level split, median over held-out test genomes)15.37 ± 23.71
Bacformer preprint, bioRxiv 2025.07.20.665723 version 3Evo-2 (frozen embeddings with a trained linear head)BacBench essential gene prediction, linear probe AUROCAUROC (linear head on frozen gene embeddings, genus-level split, median over held-out test genomes)56.05 ± 9.46
Bacformer preprint, bioRxiv 2025.07.20.665723 version 3Nucleotide Transformer (frozen embeddings with a trained linear head)BacBench essential gene prediction, linear probe AUPRCAUPRC (linear head on frozen gene embeddings, genus-level split, median over held-out test genomes)25.96 ± 21.26
Bacformer preprint, bioRxiv 2025.07.20.665723 version 3Nucleotide Transformer (frozen embeddings with a trained linear head)BacBench essential gene prediction, linear probe AUROCAUROC (linear head on frozen gene embeddings, genus-level split, median over held-out test genomes)65.68 ± 8.02
Bacformer preprint, bioRxiv 2025.07.20.665723 version 3Evo-2 (frozen embeddings with a trained linear head)BacBench phenotypic trait prediction, linear probe AUPRCAUPRC (linear head per trait on frozen genome embeddings, macro-averaged across classes of each trait, genus-level split, mean over traits and seeds)24.96 ± 20.52
Bacformer preprint, bioRxiv 2025.07.20.665723 version 3Evo-2 (frozen embeddings with a trained linear head)BacBench phenotypic trait prediction, linear probe AUROCAUROC (linear head per trait on frozen genome embeddings, macro-averaged across classes of each trait, genus-level split, mean over traits and seeds)55.41 ± 8.85
Bacformer preprint, bioRxiv 2025.07.20.665723 version 3Nucleotide Transformer (frozen embeddings with a trained linear head)BacBench phenotypic trait prediction, linear probe AUPRCAUPRC (linear head per trait on frozen genome embeddings, macro-averaged across classes of each trait, genus-level split, mean over traits and seeds)43.05 ± 34.91
Bacformer preprint, bioRxiv 2025.07.20.665723 version 3Nucleotide Transformer (frozen embeddings with a trained linear head)BacBench phenotypic trait prediction, linear probe AUROCAUROC (linear head per trait on frozen genome embeddings, macro-averaged across classes of each trait, genus-level split, mean over traits and seeds)65.98 ± 11.54
Bacformer preprint, bioRxiv 2025.07.20.665723 version 3Evo-2 (frozen embeddings with a trained linear head)BacBench protein-protein interaction, linear probe AUPRCAUPRC (linear head on frozen pair embeddings plus their cosine similarity, genus-level split, mean over held-out test genomes)15.98 ± 7.37
Bacformer preprint, bioRxiv 2025.07.20.665723 version 3Evo-2 (frozen embeddings with a trained linear head)BacBench protein-protein interaction, linear probe AUROCAUROC (linear head on frozen pair embeddings plus their cosine similarity, genus-level split, mean over held-out test genomes)50.00 ± 0.00
Bacformer preprint, bioRxiv 2025.07.20.665723 version 3Nucleotide Transformer (frozen embeddings with a trained linear head)BacBench protein-protein interaction, linear probe AUPRCAUPRC (linear head on frozen pair embeddings plus their cosine similarity, genus-level split, mean over held-out test genomes)31.66 ± 9.86
Bacformer preprint, bioRxiv 2025.07.20.665723 version 3Nucleotide Transformer (frozen embeddings with a trained linear head)BacBench protein-protein interaction, linear probe AUROCAUROC (linear head on frozen pair embeddings plus their cosine similarity, genus-level split, mean over held-out test genomes)63.92 ± 2.98
In the other studies (234 results)
In the other studies
StudyToolProtocol or benchmarkMetricValue
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot BRCA1 'Both' (coding and noncoding) SNVs classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; BRCA1 'Both' (coding and noncoding) SNVs)0.677
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot BRCA1 'Both' (coding and noncoding) SNVs classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; BRCA1 'Both' (coding and noncoding) SNVs)0.901
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot BRCA1 coding SNVs classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; BRCA1 coding SNVs)0.572
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot BRCA1 coding SNVs classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; BRCA1 coding SNVs)0.843
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot BRCA1 intronic SNVs classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; BRCA1 intronic SNVs)0.424
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot BRCA1 intronic SNVs classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; BRCA1 intronic SNVs)0.888
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot BRCA1 noncoding SNVs classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; BRCA1 noncoding SNVs)0.903
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot BRCA1 noncoding SNVs classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; BRCA1 noncoding SNVs)0.974
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot BRCA1 splice region SNVs classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; BRCA1 splice region SNVs)0.918
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot BRCA1 splice region SNVs classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; BRCA1 splice region SNVs)0.959
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot BRCA2 'Both' (coding and noncoding) SNVs classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; BRCA2 'Both' (coding and noncoding) SNVs)0.533
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot BRCA2 'Both' (coding and noncoding) SNVs classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; BRCA2 'Both' (coding and noncoding) SNVs)0.845
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot BRCA2 coding SNVs classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; BRCA2 coding SNVs)0.333
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot BRCA2 coding SNVs classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; BRCA2 coding SNVs)0.768
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot BRCA2 noncoding SNVs classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; BRCA2 noncoding SNVs)0.786
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot BRCA2 noncoding SNVs classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; BRCA2 noncoding SNVs)0.91
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar 'Both' (coding and noncoding) indels classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar 'Both' (coding and noncoding) indels)0.995
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar 'Both' (coding and noncoding) indels classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar 'Both' (coding and noncoding) indels)0.983
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar 'Both' (coding and noncoding) microsatellite variants classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar 'Both' (coding and noncoding) microsatellite variants)0.987
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar 'Both' (coding and noncoding) microsatellite variants classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar 'Both' (coding and noncoding) microsatellite variants)0.982
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar 'Both' (coding and noncoding) SNVs classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar 'Both' (coding and noncoding) SNVs)0.95
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar 'Both' (coding and noncoding) SNVs classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar 'Both' (coding and noncoding) SNVs)0.97
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding indels classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar coding indels)0.952
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding indels classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar coding indels)0.904
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding microsatellite variants classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar coding microsatellite variants)0.812
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding microsatellite variants classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar coding microsatellite variants)0.842
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding non-SNVs, far from splice site classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar coding non-SNVs, far from splice site)0.948
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding non-SNVs, far from splice site classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar coding non-SNVs, far from splice site)0.911
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding non-SNVs, highly conserved classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar coding non-SNVs, highly conserved)0.974
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding non-SNVs, highly conserved classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar coding non-SNVs, highly conserved)0.79
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding non-SNVs, moderately conserved classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar coding non-SNVs, moderately conserved)0.914
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding non-SNVs, moderately conserved classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar coding non-SNVs, moderately conserved)0.813
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding non-SNVs, not conserved classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar coding non-SNVs, not conserved)0.835
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding non-SNVs, not conserved classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar coding non-SNVs, not conserved)0.757
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding non-SNVs, poorly conserved classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar coding non-SNVs, poorly conserved)0.889
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding non-SNVs, poorly conserved classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar coding non-SNVs, poorly conserved)0.82
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding SNVs classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar coding SNVs)0.889
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding SNVs classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar coding SNVs)0.841
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding SNVs, far from splice site classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar coding SNVs, far from splice site)0.885
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding SNVs, far from splice site classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar coding SNVs, far from splice site)0.841
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding SNVs, highly conserved classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar coding SNVs, highly conserved)0.918
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding SNVs, highly conserved classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar coding SNVs, highly conserved)0.776
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding SNVs, moderately conserved classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar coding SNVs, moderately conserved)0.667
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding SNVs, moderately conserved classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar coding SNVs, moderately conserved)0.83
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding SNVs, near splice site classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar coding SNVs, near splice site)0.931
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding SNVs, near splice site classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar coding SNVs, near splice site)0.827
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding SNVs, not conserved classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar coding SNVs, not conserved)0.52
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding SNVs, not conserved classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar coding SNVs, not conserved)0.868
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding SNVs, poorly conserved classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar coding SNVs, poorly conserved)0.602
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding SNVs, poorly conserved classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar coding SNVs, poorly conserved)0.86
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar low SpliceAI and Pangolin scores (both below 0.1) non-SNVs classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar low SpliceAI and Pangolin scores (both below 0.1) non-SNVs)0.6
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar low SpliceAI and Pangolin scores (both below 0.1) non-SNVs classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar low SpliceAI and Pangolin scores (both below 0.1) non-SNVs)0.909
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar low SpliceAI and Pangolin scores (both below 0.1) SNVs classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar low SpliceAI and Pangolin scores (both below 0.1) SNVs)0.311
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar low SpliceAI and Pangolin scores (both below 0.1) SNVs classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar low SpliceAI and Pangolin scores (both below 0.1) SNVs)0.92
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding indels classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar noncoding indels)0.917
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding indels classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar noncoding indels)0.971
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding microsatellite variants classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar noncoding microsatellite variants)0.833
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding microsatellite variants classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar noncoding microsatellite variants)0.997
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding non-SNVs, far from splice site classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar noncoding non-SNVs, far from splice site)0.744
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding non-SNVs, far from splice site classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar noncoding non-SNVs, far from splice site)0.923
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding non-SNVs, highly conserved classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar noncoding non-SNVs, highly conserved)0.974
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding non-SNVs, highly conserved classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar noncoding non-SNVs, highly conserved)0.949
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding non-SNVs, intergenic classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar noncoding non-SNVs, intergenic)0.875
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding non-SNVs, intergenic classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar noncoding non-SNVs, intergenic)0.75
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding non-SNVs, moderately conserved classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar noncoding non-SNVs, moderately conserved)0.862
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding non-SNVs, moderately conserved classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar noncoding non-SNVs, moderately conserved)0.958
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding non-SNVs, near splice site classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar noncoding non-SNVs, near splice site)0.963
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding non-SNVs, near splice site classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar noncoding non-SNVs, near splice site)0.968
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding non-SNVs, not conserved classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar noncoding non-SNVs, not conserved)0.362
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding non-SNVs, not conserved classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar noncoding non-SNVs, not conserved)0.799
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding non-SNVs, poorly conserved classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar noncoding non-SNVs, poorly conserved)0.498
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding non-SNVs, poorly conserved classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar noncoding non-SNVs, poorly conserved)0.893
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding SNVs, far from splice site classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar noncoding SNVs, far from splice site)0.343
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding SNVs, far from splice site classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar noncoding SNVs, far from splice site)0.855
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding SNVs, highly conserved classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar noncoding SNVs, highly conserved)0.994
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding SNVs, highly conserved classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar noncoding SNVs, highly conserved)0.965
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding SNVs, intergenic classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar noncoding SNVs, intergenic)0.775
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding SNVs, intergenic classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar noncoding SNVs, intergenic)0.874
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding SNVs, moderately conserved classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar noncoding SNVs, moderately conserved)0.792
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding SNVs, moderately conserved classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar noncoding SNVs, moderately conserved)0.941
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding SNVs, near splice site classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar noncoding SNVs, near splice site)0.997
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding SNVs, near splice site classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar noncoding SNVs, near splice site)0.988
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding SNVs, not conserved classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar noncoding SNVs, not conserved)0.356
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding SNVs, not conserved classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar noncoding SNVs, not conserved)0.848
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding SNVs, poorly conserved classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar noncoding SNVs, poorly conserved)0.554
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding SNVs, poorly conserved classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar noncoding SNVs, poorly conserved)0.897
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot SpliceVarDB 'Both' (coding and noncoding) SNVs classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; SpliceVarDB 'Both' (coding and noncoding) SNVs)0.85
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot SpliceVarDB 'Both' (coding and noncoding) SNVs classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; SpliceVarDB 'Both' (coding and noncoding) SNVs)0.815
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot SpliceVarDB exonic SNVs classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; SpliceVarDB exonic SNVs)0.523
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLEvo 2 40B (Evo 2 paper variant effect evaluations)Zero-shot SpliceVarDB exonic SNVs classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; SpliceVarDB exonic SNVs)0.684
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot BRCA1 'Both' (coding and noncoding) SNVs classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; BRCA1 'Both' (coding and noncoding) SNVs)0.285
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot BRCA1 'Both' (coding and noncoding) SNVs classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; BRCA1 'Both' (coding and noncoding) SNVs)0.55
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot BRCA1 coding SNVs classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; BRCA1 coding SNVs)0.212
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot BRCA1 coding SNVs classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; BRCA1 coding SNVs)0.509
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot BRCA1 intronic SNVs classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; BRCA1 intronic SNVs)0.072
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot BRCA1 intronic SNVs classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; BRCA1 intronic SNVs)0.688
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot BRCA1 noncoding SNVs classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; BRCA1 noncoding SNVs)0.451
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot BRCA1 noncoding SNVs classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; BRCA1 noncoding SNVs)0.649
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot BRCA1 splice region SNVs classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; BRCA1 splice region SNVs)0.611
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot BRCA1 splice region SNVs classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; BRCA1 splice region SNVs)0.634
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot BRCA2 'Both' (coding and noncoding) SNVs classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; BRCA2 'Both' (coding and noncoding) SNVs)0.176
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot BRCA2 'Both' (coding and noncoding) SNVs classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; BRCA2 'Both' (coding and noncoding) SNVs)0.514
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot BRCA2 coding SNVs classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; BRCA2 coding SNVs)0.134
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot BRCA2 coding SNVs classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; BRCA2 coding SNVs)0.501
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot BRCA2 noncoding SNVs classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; BRCA2 noncoding SNVs)0.361
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot BRCA2 noncoding SNVs classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; BRCA2 noncoding SNVs)0.555
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar 'Both' (coding and noncoding) indels classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar 'Both' (coding and noncoding) indels)0.852
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar 'Both' (coding and noncoding) indels classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar 'Both' (coding and noncoding) indels)0.505
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar 'Both' (coding and noncoding) microsatellite variants classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar 'Both' (coding and noncoding) microsatellite variants)0.461
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar 'Both' (coding and noncoding) microsatellite variants classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar 'Both' (coding and noncoding) microsatellite variants)0.53
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar 'Both' (coding and noncoding) SNVs classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar 'Both' (coding and noncoding) SNVs)0.426
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar 'Both' (coding and noncoding) SNVs classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar 'Both' (coding and noncoding) SNVs)0.506
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding indels classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar coding indels)0.701
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding indels classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar coding indels)0.503
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding microsatellite variants classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar coding microsatellite variants)0.171
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding microsatellite variants classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar coding microsatellite variants)0.535
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding non-SNVs, far from splice site classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar coding non-SNVs, far from splice site)0.671
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding non-SNVs, far from splice site classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar coding non-SNVs, far from splice site)0.507
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding non-SNVs, highly conserved classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar coding non-SNVs, highly conserved)0.937
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding non-SNVs, highly conserved classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar coding non-SNVs, highly conserved)0.521
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding non-SNVs, moderately conserved classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar coding non-SNVs, moderately conserved)0.694
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding non-SNVs, moderately conserved classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar coding non-SNVs, moderately conserved)0.517
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding non-SNVs, not conserved classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar coding non-SNVs, not conserved)0.577
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding non-SNVs, not conserved classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar coding non-SNVs, not conserved)0.52
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding non-SNVs, poorly conserved classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar coding non-SNVs, poorly conserved)0.568
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding non-SNVs, poorly conserved classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar coding non-SNVs, poorly conserved)0.501
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding SNVs classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar coding SNVs)0.659
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding SNVs classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar coding SNVs)0.505
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding SNVs, far from splice site classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar coding SNVs, far from splice site)0.649
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding SNVs, far from splice site classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar coding SNVs, far from splice site)0.506
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding SNVs, highly conserved classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar coding SNVs, highly conserved)0.797
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding SNVs, highly conserved classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar coding SNVs, highly conserved)0.501
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding SNVs, moderately conserved classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar coding SNVs, moderately conserved)0.323
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding SNVs, moderately conserved classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar coding SNVs, moderately conserved)0.514
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding SNVs, near splice site classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar coding SNVs, near splice site)0.777
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding SNVs, near splice site classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar coding SNVs, near splice site)0.509
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding SNVs, not conserved classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar coding SNVs, not conserved)0.144
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding SNVs, not conserved classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar coding SNVs, not conserved)0.545
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding SNVs, poorly conserved classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar coding SNVs, poorly conserved)0.193
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar coding SNVs, poorly conserved classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar coding SNVs, poorly conserved)0.526
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar low SpliceAI and Pangolin scores (both below 0.1) non-SNVs classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar low SpliceAI and Pangolin scores (both below 0.1) non-SNVs)0.016
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar low SpliceAI and Pangolin scores (both below 0.1) non-SNVs classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar low SpliceAI and Pangolin scores (both below 0.1) non-SNVs)0.51
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar low SpliceAI and Pangolin scores (both below 0.1) SNVs classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar low SpliceAI and Pangolin scores (both below 0.1) SNVs)0.005
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar low SpliceAI and Pangolin scores (both below 0.1) SNVs classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar low SpliceAI and Pangolin scores (both below 0.1) SNVs)0.52
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding indels classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar noncoding indels)0.177
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding indels classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar noncoding indels)0.505
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding microsatellite variants classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar noncoding microsatellite variants)0.036
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding microsatellite variants classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar noncoding microsatellite variants)0.786
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding non-SNVs, far from splice site classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar noncoding non-SNVs, far from splice site)0.044
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding non-SNVs, far from splice site classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar noncoding non-SNVs, far from splice site)0.518
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding non-SNVs, highly conserved classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar noncoding non-SNVs, highly conserved)0.732
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding non-SNVs, highly conserved classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar noncoding non-SNVs, highly conserved)0.503
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding non-SNVs, intergenic classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar noncoding non-SNVs, intergenic)0.729
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding non-SNVs, intergenic classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar noncoding non-SNVs, intergenic)0.625
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding non-SNVs, moderately conserved classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar noncoding non-SNVs, moderately conserved)0.164
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding non-SNVs, moderately conserved classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar noncoding non-SNVs, moderately conserved)0.502
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding non-SNVs, near splice site classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar noncoding non-SNVs, near splice site)0.5
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding non-SNVs, near splice site classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar noncoding non-SNVs, near splice site)0.519
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding non-SNVs, not conserved classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar noncoding non-SNVs, not conserved)0.047
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding non-SNVs, not conserved classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar noncoding non-SNVs, not conserved)0.584
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding non-SNVs, poorly conserved classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar noncoding non-SNVs, poorly conserved)0.024
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding non-SNVs, poorly conserved classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar noncoding non-SNVs, poorly conserved)0.543
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding SNVs, far from splice site classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar noncoding SNVs, far from splice site)0.014
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding SNVs, far from splice site classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar noncoding SNVs, far from splice site)0.51
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding SNVs, highly conserved classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar noncoding SNVs, highly conserved)0.92
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding SNVs, highly conserved classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar noncoding SNVs, highly conserved)0.552
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding SNVs, intergenic classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar noncoding SNVs, intergenic)0.216
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding SNVs, intergenic classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar noncoding SNVs, intergenic)0.655
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding SNVs, moderately conserved classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar noncoding SNVs, moderately conserved)0.077
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding SNVs, moderately conserved classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar noncoding SNVs, moderately conserved)0.523
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding SNVs, near splice site classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar noncoding SNVs, near splice site)0.841
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding SNVs, near splice site classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar noncoding SNVs, near splice site)0.533
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding SNVs, not conserved classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar noncoding SNVs, not conserved)0.011
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding SNVs, not conserved classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar noncoding SNVs, not conserved)0.516
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding SNVs, poorly conserved classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; ClinVar noncoding SNVs, poorly conserved)0.023
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot ClinVar noncoding SNVs, poorly conserved classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; ClinVar noncoding SNVs, poorly conserved)0.502
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot SpliceVarDB 'Both' (coding and noncoding) SNVs classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; SpliceVarDB 'Both' (coding and noncoding) SNVs)0.601
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot SpliceVarDB 'Both' (coding and noncoding) SNVs classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; SpliceVarDB 'Both' (coding and noncoding) SNVs)0.491
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot SpliceVarDB exonic SNVs classification (Evo 2 paper, Supplementary Data 1)AUPRC (zero-shot; SpliceVarDB exonic SNVs)0.385
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026); Genome modelling and design across all domains of life with Evo 2: Supplementary Information (Nature 2026); evo2: Journal full-text XMLNT (Evo 2 paper variant effect evaluations)Zero-shot SpliceVarDB exonic SNVs classification (Evo 2 paper, Supplementary Data 1)AUROC (zero-shot; SpliceVarDB exonic SNVs)0.49
RNAGym fitness leaderboard (v0.1.1), leaderboard/fitness/README.mdEvo 2 (40B) (RNAGym fitness leaderboard v0.1.1)RNAGym v0.1.1 fitness, signed Spearman, AptamerSpearman (mean signed Spearman over the 2 Aptamer assays)0.097
RNAGym fitness leaderboard (v0.1.1), leaderboard/fitness/README.mdEvo 2 (40B) (RNAGym fitness leaderboard v0.1.1)RNAGym v0.1.1 fitness, signed Spearman, macro over 3 ncRNA categoriesSpearman (macro-mean over 3 ncRNA categories (equal category weights))0.212
RNAGym fitness leaderboard (v0.1.1), leaderboard/fitness/README.mdEvo 2 (40B) (RNAGym fitness leaderboard v0.1.1)RNAGym v0.1.1 fitness, signed Spearman, RibozymeSpearman (mean signed Spearman over the 26 Ribozyme assays)0.108
RNAGym fitness leaderboard (v0.1.1), leaderboard/fitness/README.mdEvo 2 (40B) (RNAGym fitness leaderboard v0.1.1)RNAGym v0.1.1 fitness, signed Spearman, tRNASpearman (mean signed Spearman over the 3 tRNA assays)0.431
RNAGym fitness leaderboard (v0.1.1), leaderboard/fitness/README.mdNucleotide Transformer (RNAGym fitness leaderboard v0.1.1)RNAGym v0.1.1 fitness, signed Spearman, AptamerSpearman (mean signed Spearman over the 2 Aptamer assays)-0.0886
RNAGym fitness leaderboard (v0.1.1), leaderboard/fitness/README.mdNucleotide Transformer (RNAGym fitness leaderboard v0.1.1)RNAGym v0.1.1 fitness, signed Spearman, macro over 3 ncRNA categoriesSpearman (macro-mean over 3 ncRNA categories (equal category weights))0.12
RNAGym fitness leaderboard (v0.1.1), leaderboard/fitness/README.mdNucleotide Transformer (RNAGym fitness leaderboard v0.1.1)RNAGym v0.1.1 fitness, signed Spearman, RibozymeSpearman (mean signed Spearman over the 26 Ribozyme assays)0.133
RNAGym fitness leaderboard (v0.1.1), leaderboard/fitness/README.mdNucleotide Transformer (RNAGym fitness leaderboard v0.1.1)RNAGym v0.1.1 fitness, signed Spearman, tRNASpearman (mean signed Spearman over the 3 tRNA assays)0.317
Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2)Evo 2 7B base, 8,192 bp log-likelihood ratio (Lu et al. 2025)ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)AUROC (ClinVar pathogenic vs benign SNVs, All variants)0.969
Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2)Nucleotide Transformer 2.5B multi-species, CLS embedding L2 distance (Lu et al. 2025)ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)AUROC (ClinVar pathogenic vs benign SNVs, All variants)0.793
Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2)Evo 2 7B base, 8,192 bp log-likelihood ratio (Lu et al. 2025)ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)AUROC (ClinVar pathogenic vs benign SNVs, Intron (Non-splice))0.903
Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2)Nucleotide Transformer 2.5B multi-species, CLS embedding L2 distance (Lu et al. 2025)ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)AUROC (ClinVar pathogenic vs benign SNVs, Intron (Non-splice))0.75
Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2)Evo 2 7B base, 8,192 bp log-likelihood ratio (Lu et al. 2025)ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)AUROC (ClinVar pathogenic vs benign SNVs, Missense & Intron (Non-splice))0.835
Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2)Nucleotide Transformer 2.5B multi-species, CLS embedding L2 distance (Lu et al. 2025)ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)AUROC (ClinVar pathogenic vs benign SNVs, Missense & Intron (Non-splice))0.664
Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2)Evo 2 7B base, 8,192 bp log-likelihood ratio (Lu et al. 2025)ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)AUROC (ClinVar pathogenic vs benign SNVs, Missense & 3'UTR)0.896
Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2)Nucleotide Transformer 2.5B multi-species, CLS embedding L2 distance (Lu et al. 2025)ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)AUROC (ClinVar pathogenic vs benign SNVs, Missense & 3'UTR)0.546
Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2)Evo 2 7B base, 8,192 bp log-likelihood ratio (Lu et al. 2025)ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)AUROC (ClinVar pathogenic vs benign SNVs, Missense)0.836
Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2)Nucleotide Transformer 2.5B multi-species, CLS embedding L2 distance (Lu et al. 2025)ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)AUROC (ClinVar pathogenic vs benign SNVs, Missense)0.594
Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2)Evo 2 7B base, 8,192 bp log-likelihood ratio (Lu et al. 2025)ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)AUROC (ClinVar pathogenic vs benign SNVs, Noncoding)0.975
Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2)Nucleotide Transformer 2.5B multi-species, CLS embedding L2 distance (Lu et al. 2025)ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)AUROC (ClinVar pathogenic vs benign SNVs, Noncoding)0.851
Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2)Evo 2 7B base, 8,192 bp log-likelihood ratio (Lu et al. 2025)ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)AUROC (ClinVar pathogenic vs benign SNVs, RNA gene)0.459
Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2)Nucleotide Transformer 2.5B multi-species, CLS embedding L2 distance (Lu et al. 2025)ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)AUROC (ClinVar pathogenic vs benign SNVs, RNA gene)0.371
Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2)Evo 2 7B base, 8,192 bp log-likelihood ratio (Lu et al. 2025)ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)AUROC (ClinVar pathogenic vs benign SNVs, Splice)0.697
Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2)Nucleotide Transformer 2.5B multi-species, CLS embedding L2 distance (Lu et al. 2025)ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)AUROC (ClinVar pathogenic vs benign SNVs, Splice)0.617
Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2)Evo 2 7B base, 8,192 bp log-likelihood ratio (Lu et al. 2025)ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)AUROC (ClinVar pathogenic vs benign SNVs, Start loss)0.711
Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2)Nucleotide Transformer 2.5B multi-species, CLS embedding L2 distance (Lu et al. 2025)ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)AUROC (ClinVar pathogenic vs benign SNVs, Start loss)0.569
Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2)Evo 2 7B base, 8,192 bp log-likelihood ratio (Lu et al. 2025)ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)AUROC (ClinVar pathogenic vs benign SNVs, Stop gain)0.663
Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2)Nucleotide Transformer 2.5B multi-species, CLS embedding L2 distance (Lu et al. 2025)ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)AUROC (ClinVar pathogenic vs benign SNVs, Stop gain)0.618
Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2)Evo 2 7B base, 8,192 bp log-likelihood ratio (Lu et al. 2025)ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)AUROC (ClinVar pathogenic vs benign SNVs, Stop loss)0.826
Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2)Nucleotide Transformer 2.5B multi-species, CLS embedding L2 distance (Lu et al. 2025)ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)AUROC (ClinVar pathogenic vs benign SNVs, Stop loss)0.609
Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2)Evo 2 7B base, 8,192 bp log-likelihood ratio (Lu et al. 2025)ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)AUROC (ClinVar pathogenic vs benign SNVs, Synonymous)0.885
Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2)Nucleotide Transformer 2.5B multi-species, CLS embedding L2 distance (Lu et al. 2025)ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)AUROC (ClinVar pathogenic vs benign SNVs, Synonymous)0.77
Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2)Evo 2 7B base, 8,192 bp log-likelihood ratio (Lu et al. 2025)ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)AUROC (ClinVar pathogenic vs benign SNVs, 3' UTR)0.747
Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2)Nucleotide Transformer 2.5B multi-species, CLS embedding L2 distance (Lu et al. 2025)ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)AUROC (ClinVar pathogenic vs benign SNVs, 3' UTR)0.564
Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2)Evo 2 7B base, 8,192 bp log-likelihood ratio (Lu et al. 2025)ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)AUROC (ClinVar pathogenic vs benign SNVs, 5' UTR)0.767
Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2)Nucleotide Transformer 2.5B multi-species, CLS embedding L2 distance (Lu et al. 2025)ClinVar pathogenic versus benign SNVs within variant type, AUROC (Lu et al. 2025)AUROC (ClinVar pathogenic vs benign SNVs, 5' UTR)0.567
mRNABench: A curated benchmark for mature mRNA property and function predictionEvo2mRNABench ECLIP: eCLIP binding site predictionAUPRC47.3
mRNABench: A curated benchmark for mature mRNA property and function predictionEvo2mRNABench GO: Gene Ontology term predictionAUPRC46.7
mRNABench: A curated benchmark for mature mRNA property and function predictionEvo2mRNABench HL: mRNA half lifePearson0.66
mRNABench: A curated benchmark for mature mRNA property and function predictionEvo2mRNABench MRL-HL-PAIR: Paired mean ribosome load and half lifePearson0.51
mRNABench: A curated benchmark for mature mRNA property and function predictionEvo2mRNABench MRL-MPRA: Mean ribosome load on an MPRA libraryPearson0.7
mRNABench: A curated benchmark for mature mRNA property and function predictionEvo2mRNABench MRL: Mean ribosome loadPearson0.45
mRNABench: A curated benchmark for mature mRNA property and function predictionEvo2mRNABench MRNA-LOC-LR: mRNA localisation, long rangeAUPRC79.5
mRNABench: A curated benchmark for mature mRNA property and function predictionEvo2mRNABench MRNA-LOC-SR: mRNA localisation, short rangeAUPRC76.7
mRNABench: A curated benchmark for mature mRNA property and function predictionEvo2mRNABench PROT-LOC: Protein localisationAUPRC40.8
mRNABench: A curated benchmark for mature mRNA property and function predictionNTmRNABench ECLIP: eCLIP binding site predictionAUPRC40.5
mRNABench: A curated benchmark for mature mRNA property and function predictionNTmRNABench GO: Gene Ontology term predictionAUPRC36
mRNABench: A curated benchmark for mature mRNA property and function predictionNTmRNABench HL: mRNA half lifePearson0.57
mRNABench: A curated benchmark for mature mRNA property and function predictionNTmRNABench MRL-HL-PAIR: Paired mean ribosome load and half lifePearson0.57
mRNABench: A curated benchmark for mature mRNA property and function predictionNTmRNABench MRL-MPRA: Mean ribosome load on an MPRA libraryPearson0.6
mRNABench: A curated benchmark for mature mRNA property and function predictionNTmRNABench MRL: Mean ribosome loadPearson0.34
mRNABench: A curated benchmark for mature mRNA property and function predictionNTmRNABench MRNA-LOC-LR: mRNA localisation, long rangeAUPRC76.6
mRNABench: A curated benchmark for mature mRNA property and function predictionNTmRNABench MRNA-LOC-SR: mRNA localisation, short rangeAUPRC72.2
mRNABench: A curated benchmark for mature mRNA property and function predictionNTmRNABench PROT-LOC: Protein localisationAUPRC32

Follow-up

Current state: Not yet reviewed.

No one has reviewed this finding yet.

How to help resolve this

If you know why these studies disagree, for example a different population, metric or preprocessing step, or you have a corrected value, tell us through the contribution form. A reviewer checks every submission against its source before anything changes, and the step is added to the follow-up above.

Finding discrepancy-a673c04acbf824b7 · All contested results · How findings are made and followed up