Where one study disagrees with what other studies report for the same models, and what we are doing to resolve each case.
These are automatic leads, not findings of error. Each release, a check compares how every study ranks the models it shares with other studies. It flags a study that reverses the order the others agree on, or whose gap to a shared reference model lies well outside theirs. Different tasks, populations or metrics often explain a flag.
A flag never hides a result. Flagged results stay in every table, page and download, marked Contested. A result is withheld only when a reviewer marks it disputed.
Brandes et al. 2023 Supplementary Table 2: full benchmark evaluations of ESM1b and all other methods ranks LRT above phyloP in 4 of 4 comparisons; Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks phyloP above LRT in 6 of 7 comparisons. No other study gives a verdict, so neither is the outlier.
3 papers rank LRT above phyloP in 7 of their 17 comparisons and phyloP higher in 10. Of those papers, Livesey and Marsh 2025, Clinical likelihood ratios and balanced… rank phyloP higher on their own (6 of 7, 4 of 6).
Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks VARITY above MutScore in 6 of 7 comparisons; An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers ranks MutScore above VARITY in 4 of 4 comparisons. No other study gives a verdict, so neither is the outlier.
2 papers rank MutScore above VARITY in 5 of their 13 comparisons and VARITY higher in 6; 2 are ties. Of those papers, Livesey and Marsh 2025 ranks VARITY higher on its own (6 of 7).
Benchmarking pre-trained genomic language models for RNA sequence-related predictive applications ranks SpliceBERT above RNA-FM in 3 of 3 comparisons; Zero-shot benchmarking of RNA language models in structural, functional, and evolutionary learning ranks RNA-FM above SpliceBERT in 31 of 36 comparisons. No other study gives a verdict, so neither is the outlier.
2 papers rank RNA-FM above SpliceBERT in 31 of their 51 comparisons and SpliceBERT higher in 8; 12 are ties. Of those papers, Benchmarking pre-trained genomic… ranks SpliceBERT higher on its own (3 of 15).
ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design ranks VESPA above DeepSequence in 13 of 17 comparisons; Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks DeepSequence above VESPA in 5 of 6 comparisons. No other study gives a verdict, so neither is the outlier.
2 papers rank DeepSequence above VESPA in 9 of their 26 comparisons and VESPA higher in 14; 3 are ties. Of those papers, ProteinGym ranks VESPA higher on its own (13 of 19).
GUANinE v1.1 reveals complementarity of supervised and genomic language models ranks Caduceus above Evo 2 in 4 of 4 comparisons; GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models ranks Evo 2 above Caduceus in 35 of 46 comparisons. No other study gives a verdict, so neither is the outlier.
3 papers rank Evo 2 above Caduceus in 36 of their 58 comparisons and Caduceus higher in 15; 7 are ties. Of those papers, GUANinE v1.1 reveals complementarity… ranks Caduceus higher on its own (4 of 6).
Clinical likelihood ratios and balanced accuracy for 44 in silico tools against multiple large-scale functional assays of cancer susceptibility genes ranks MetaSVM above SuSPect in 5 of 6 comparisons; Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks SuSPect above MetaSVM in 7 of 7 comparisons. No other study gives a verdict, so neither is the outlier.
2 papers rank SuSPect above MetaSVM in 8 of their 13 comparisons and MetaSVM higher in 5. Of those papers, Clinical likelihood ratios and balanced… ranks MetaSVM higher on its own (5 of 6).
Comprehensive assessment of computational algorithms in predicting cancer driver mutations ranks MPC above MutPred in 4 of 5 comparisons; An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers ranks MutPred above MPC in 6 of 6 comparisons. No other study gives a verdict, so neither is the outlier.
3 papers rank MPC above MutPred in 9 of their 23 comparisons and MutPred higher in 9; 5 are ties. Of those papers, An openly licensed benchmark… ranks MutPred higher on its own (6 of 6).
Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks MutFormer above REVEL in 6 of 7 comparisons; An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers ranks REVEL above MutFormer in 6 of 6 comparisons. No other study gives a verdict, so neither is the outlier.
2 papers rank MutFormer above REVEL in 6 of their 13 comparisons and REVEL higher in 7. Of those papers, An openly licensed benchmark… ranks REVEL higher on its own (6 of 6).
Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks PHACTboost above MutScore in 7 of 7 comparisons; An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers ranks MutScore above PHACTboost in 5 of 5 comparisons. No other study gives a verdict, so neither is the outlier.
2 papers rank MutScore above PHACTboost in 5 of their 13 comparisons and PHACTboost higher in 7; 1 is a tie. Of those papers, Livesey and Marsh 2025 ranks PHACTboost higher on its own (7 of 7).
Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks MutFormer above PROVEAN in 7 of 7 comparisons; An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers ranks PROVEAN above MutFormer in 6 of 6 comparisons. No other study gives a verdict, so neither is the outlier.
2 papers rank MutFormer above PROVEAN in 7 of their 13 comparisons and PROVEAN higher in 6. Of those papers, An openly licensed benchmark… ranks PROVEAN higher on its own (6 of 6).
GUANinE v1.1 reveals complementarity of supervised and genomic language models ranks Borzoi above Sei in 6 of 6 comparisons; Comparative Analysis of Deep Learning Models for Predicting Causative Regulatory Variants ranks Sei above Borzoi in 4 of 4 comparisons. No other study gives a verdict, so neither is the outlier.
2 papers rank Borzoi above Sei in 6 of their 11 comparisons and Sei higher in 4; 1 is a tie. Of those papers, Comparative Analysis of Deep Learning… ranks Sei higher on its own (4 of 4).
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026) ranks CADD above ESM-2 in 14 of 14 comparisons; Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks ESM-2 above CADD in 6 of 7 comparisons. No other study gives a verdict, so neither is the outlier.
2 papers rank ESM-2 above CADD in 6 of their 21 comparisons and CADD higher in 15. Of those papers, Genome modelling and design across all… ranks CADD higher on its own (14 of 14).
Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks MutFormer above ESM-1b in 7 of 7 comparisons; An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers ranks ESM-1b above MutFormer in 6 of 6 comparisons. No other study gives a verdict, so neither is the outlier.
2 papers rank MutFormer above ESM-1b in 7 of their 13 comparisons and ESM-1b higher in 6. Of those papers, An openly licensed benchmark… ranks ESM-1b higher on its own (6 of 6).
Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks Eigen above PROVEAN in 6 of 7 comparisons; An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers ranks PROVEAN above Eigen in 4 of 5 comparisons. No other study gives a verdict, so neither is the outlier.
4 papers rank Eigen above PROVEAN in 16 of their 29 comparisons and PROVEAN higher in 12; 1 is a tie. Of those papers, An openly licensed benchmark… ranks PROVEAN higher on its own (4 of 6).
Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks MutFormer above M-CAP in 7 of 7 comparisons; An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers ranks M-CAP above MutFormer in 4 of 5 comparisons. No other study gives a verdict, so neither is the outlier.
2 papers rank M-CAP above MutFormer in 4 of their 13 comparisons and MutFormer higher in 8; 1 is a tie. Of those papers, Livesey and Marsh 2025 ranks MutFormer higher on its own (7 of 7).
Clinical likelihood ratios and balanced accuracy for 44 in silico tools against multiple large-scale functional assays of cancer susceptibility genes ranks MVP above Condel in 4 of 5 comparisons; Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks Condel above MVP in 6 of 7 comparisons. No other study gives a verdict, so neither is the outlier.
2 papers rank Condel above MVP in 7 of their 12 comparisons and MVP higher in 5. Of those papers, Clinical likelihood ratios and balanced… ranks MVP higher on its own (4 of 5).
Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks MutFormer above FATHMM-XF in 7 of 7 comparisons; An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers ranks FATHMM-XF above MutFormer in 6 of 6 comparisons. No other study gives a verdict, so neither is the outlier.
2 papers rank FATHMM-XF above MutFormer in 6 of their 13 comparisons and MutFormer higher in 7. Of those papers, Livesey and Marsh 2025 ranks MutFormer higher on its own (7 of 7).
Clinical likelihood ratios and balanced accuracy for 44 in silico tools against multiple large-scale functional assays of cancer susceptibility genes ranks FATHMM above Integrated_fitCons in 6 of 6 comparisons; Comprehensive assessment of computational algorithms in predicting cancer driver mutations ranks Integrated_fitCons above FATHMM in 8 of 9 comparisons. No other study gives a verdict, so neither is the outlier.
2 papers rank FATHMM above Integrated_fitCons in 7 of their 16 comparisons and Integrated_fitCons higher in 8; 1 is a tie. Of those papers, Comprehensive assessment… ranks Integrated_fitCons higher on its own (8 of 10).
Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026) ranks CADD above Evo 2 in 36 of 47 comparisons; evo2-cloud-operations recorded run b75c67aa: run receipt, Google Cloud H100 (P2, attempt-1) ranks Evo 2 above CADD in 3 of 3 comparisons. No other study gives a verdict, so neither is the outlier.
2 papers rank Evo 2 above CADD in 14 of their 56 comparisons and CADD higher in 36; 6 are ties. Of those papers, Genome modelling and design across all… ranks CADD higher on its own (36 of 52).
Zero-shot benchmarking of RNA language models in structural, functional, and evolutionary learning ranks Evo above LucaOne in 6 of 6 comparisons; GENEB leaderboard (leaderboard.json, 13 task-type aggregates) ranks LucaOne above Evo in 40 of 45 comparisons. No other study gives a verdict, so neither is the outlier.
2 papers rank Evo above LucaOne in 11 of their 51 comparisons and LucaOne higher in 40. Of those papers, GENEB leaderboard ranks LucaOne higher on its own (40 of 45).
Clinical likelihood ratios and balanced accuracy for 44 in silico tools against multiple large-scale functional assays of cancer susceptibility genes ranks PolyPhen-2 above Condel in 4 of 5 comparisons; Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks Condel above PolyPhen-2 in 6 of 6 comparisons. No other study gives a verdict, so neither is the outlier.
2 papers rank Condel above PolyPhen-2 in 7 of their 12 comparisons and PolyPhen-2 higher in 4; 1 is a tie. Of those papers, Clinical likelihood ratios and balanced… ranks PolyPhen-2 higher on its own (4 of 6).
Comprehensive assessment of computational algorithms in predicting cancer driver mutations ranks GenoCanyon above FATHMM in 8 of 10 comparisons; Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks FATHMM above GenoCanyon in 7 of 7 comparisons. No other study gives a verdict, so neither is the outlier.
3 papers rank FATHMM above GenoCanyon in 12 of their 23 comparisons and GenoCanyon higher in 11. Of those papers, Comprehensive assessment… ranks GenoCanyon higher on its own (8 of 10).
Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks MutFormer above BayesDel in 6 of 7 comparisons; An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers ranks BayesDel above MutFormer in 6 of 6 comparisons. No other study gives a verdict, so neither is the outlier.
2 papers rank MutFormer above BayesDel in 6 of their 13 comparisons and BayesDel higher in 7. Of those papers, An openly licensed benchmark… ranks BayesDel higher on its own (6 of 6).
Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks PROVEAN above CADD in 6 of 7 comparisons; An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers ranks CADD above PROVEAN in 3 of 3 comparisons. No other study gives a verdict, so neither is the outlier.
4 papers rank CADD above PROVEAN in 9 of their 28 comparisons and PROVEAN higher in 13; 6 are ties. Of those papers, Comprehensive assessment…, Livesey and Marsh 2025 rank PROVEAN higher on their own (5 of 10, 6 of 7).
Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks PHACTboost above BayesDel in 7 of 7 comparisons; An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers ranks BayesDel above PHACTboost in 4 of 5 comparisons. No other study gives a verdict, so neither is the outlier.
2 papers rank PHACTboost above BayesDel in 8 of their 13 comparisons and BayesDel higher in 4; 1 is a tie. Of those papers, An openly licensed benchmark… ranks BayesDel higher on its own (4 of 6).
Taxonomic classification of DNA sequences beyond sequence similarity using deep neural networks (PNAS PDF) ranks Kraken2 above sourmash in 2 of 2 comparisons; Evaluation of taxonomic classification and profiling methods for long-read shotgun metagenomic sequencing datasets ranks sourmash above Kraken2 in 24 of 29 comparisons. No other study gives a verdict, so neither is the outlier.
2 papers rank Kraken2 above sourmash in 7 of their 52 comparisons and sourmash higher in 24; 21 are ties. Of those papers, Evaluation of taxonomic classification… ranks sourmash higher on its own (24 of 48).
Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks VARITY above ClinPred in 7 of 7 comparisons; An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers ranks ClinPred above VARITY in 4 of 4 comparisons. No other study gives a verdict, so neither is the outlier.
3 papers rank ClinPred above VARITY in 5 of their 14 comparisons and VARITY higher in 7; 2 are ties. Of those papers, Livesey and Marsh 2025 ranks VARITY higher on its own (7 of 7).
Comprehensive assessment of computational algorithms in predicting cancer driver mutations ranks FATHMM-MKL above M-CAP in 16 of 20 comparisons; Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks M-CAP above FATHMM-MKL in 7 of 7 comparisons. No other study gives a verdict, so neither is the outlier.
3 papers rank FATHMM-MKL above M-CAP in 18 of their 31 comparisons and M-CAP higher in 12; 1 is a tie. Of those papers, Livesey and Marsh 2025 ranks M-CAP higher on its own (7 of 7).
Benchmarking pre-trained genomic language models for RNA sequence-related predictive applications ranks SpliceBERT above RNAErnie in 3 of 3 comparisons; Zero-shot benchmarking of RNA language models in structural, functional, and evolutionary learning ranks RNAErnie above SpliceBERT in 26 of 33 comparisons. No other study gives a verdict, so neither is the outlier.
2 papers rank RNAErnie above SpliceBERT in 26 of their 51 comparisons and SpliceBERT higher in 10; 15 are ties. Of those papers, Benchmarking pre-trained genomic… ranks SpliceBERT higher on its own (3 of 15).
Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks MutFormer above MVP in 7 of 7 comparisons; An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers ranks MVP above MutFormer in 6 of 6 comparisons. No other study gives a verdict, so neither is the outlier.
2 papers rank MutFormer above MVP in 7 of their 13 comparisons and MVP higher in 6. Of those papers, An openly licensed benchmark… ranks MVP higher on its own (6 of 6).
Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks Eigen above FATHMM-XF in 7 of 7 comparisons; An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers ranks FATHMM-XF above Eigen in 4 of 5 comparisons. No other study gives a verdict, so neither is the outlier.
3 papers rank Eigen above FATHMM-XF in 13 of their 23 comparisons and FATHMM-XF higher in 9; 1 is a tie. Of those papers, An openly licensed benchmark… ranks FATHMM-XF higher on its own (4 of 6).
Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks MutFormer above ClinPred in 7 of 7 comparisons; An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers ranks ClinPred above MutFormer in 6 of 6 comparisons. No other study gives a verdict, so neither is the outlier.
2 papers rank ClinPred above MutFormer in 6 of their 13 comparisons and MutFormer higher in 7. Of those papers, Livesey and Marsh 2025 ranks MutFormer higher on its own (7 of 7).
Shen et al. 2025, Chemical Science (Europe PMC full text) ranks AlphaFold 3 above Boltz-2 in 9 of 9 comparisons; Kim, Correy, Hall et al. 2026, eLife 15:RP110475 (Europe PMC full text) ranks Boltz-2 above AlphaFold 3 in 2 of 2 comparisons. No other study gives a verdict, so neither is the outlier.
3 papers rank Boltz-2 above AlphaFold 3 in 4 of their 19 comparisons and AlphaFold 3 higher in 14; 1 is a tie. Of those papers, Shen et al. 2025, Structural Plausibility Without Binding… rank AlphaFold 3 higher on their own (9 of 10, 5 of 7).
Brandes et al. 2023 Supplementary Table 2: full benchmark evaluations of ESM1b and all other methods ranks ESM-1b above MutationTaster in 4 of 4 comparisons; An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers ranks MutationTaster above ESM-1b in 5 of 5 comparisons. No other study gives a verdict, so neither is the outlier.
2 papers rank MutationTaster above ESM-1b in 5 of their 10 comparisons and ESM-1b higher in 4; 1 is a tie. Of those papers, Brandes et al. 2023 ranks ESM-1b higher on its own (4 of 4).
Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks PHACTboost above ClinPred in 6 of 6 comparisons; An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers ranks ClinPred above PHACTboost in 6 of 6 comparisons. No other study gives a verdict, so neither is the outlier.
2 papers rank ClinPred above PHACTboost in 6 of their 13 comparisons and PHACTboost higher in 6; 1 is a tie. Of those papers, Livesey and Marsh 2025 ranks PHACTboost higher on its own (6 of 7).
Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks MutationAssessor above CADD in 6 of 7 comparisons; An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers ranks CADD above MutationAssessor in 6 of 6 comparisons. No other study gives a verdict, so neither is the outlier.
4 papers rank CADD above MutationAssessor in 15 of their 28 comparisons and MutationAssessor higher in 13. Of those papers, Livesey and Marsh 2025 ranks MutationAssessor higher on its own (6 of 7).
Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks MutFormer above MutationAssessor in 7 of 7 comparisons; An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers ranks MutationAssessor above MutFormer in 5 of 5 comparisons. No other study gives a verdict, so neither is the outlier.
2 papers rank MutationAssessor above MutFormer in 5 of their 13 comparisons and MutFormer higher in 7; 1 is a tie. Of those papers, Livesey and Marsh 2025 ranks MutFormer higher on its own (7 of 7).
A benchmarking study of individual somatic variant callers and voting-based ensembles for whole-exome sequencing ranks MuSE above NeuSomatic in 3 of 3 comparisons; Achieving robust somatic mutation detection with deep learning models derived from reference data sets of a cancer sample ranks NeuSomatic above MuSE in 67 of 74 comparisons. No other study gives a verdict, so neither is the outlier.
3 papers rank MuSE above NeuSomatic in 25 of their 107 comparisons and NeuSomatic higher in 75; 7 are ties. Of those papers, Achieving robust somatic mutation… ranks NeuSomatic higher on its own (67 of 77).
Comprehensive assessment of computational algorithms in predicting cancer driver mutations ranks MPC above DEOGEN2 in 10 of 10 comparisons; Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks DEOGEN2 above MPC in 6 of 7 comparisons. No other study gives a verdict, so neither is the outlier.
4 papers rank DEOGEN2 above MPC in 10 of their 24 comparisons and MPC higher in 13; 1 is a tie. Of those papers, Comprehensive assessment… ranks MPC higher on its own (10 of 10).
Transfer learning to leverage larger datasets for improved prediction of protein stability changes ranks MUpro above ThermoNet in 5 of 6 comparisons; Predicting protein stability changes upon single-point mutation: a thorough comparison of the available tools on a new dataset ranks ThermoNet above MUpro in 9 of 9 comparisons. No other study gives a verdict, so neither is the outlier.
2 papers rank MUpro above ThermoNet in 5 of their 16 comparisons and ThermoNet higher in 10; 1 is a tie. Of those papers, Predicting protein stability changes… ranks ThermoNet higher on its own (9 of 10).
Clinical likelihood ratios and balanced accuracy for 44 in silico tools against multiple large-scale functional assays of cancer susceptibility genes ranks FATHMM-MKL above Condel in 5 of 5 comparisons; Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks Condel above FATHMM-MKL in 7 of 7 comparisons. No other study gives a verdict, so neither is the outlier.
2 papers rank Condel above FATHMM-MKL in 7 of their 12 comparisons and FATHMM-MKL higher in 5. Of those papers, Clinical likelihood ratios and balanced… ranks FATHMM-MKL higher on its own (5 of 5).
Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks MutFormer above MetaSVM in 7 of 7 comparisons; An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers ranks MetaSVM above MutFormer in 4 of 5 comparisons. No other study gives a verdict, so neither is the outlier.
2 papers rank MetaSVM above MutFormer in 4 of their 13 comparisons and MutFormer higher in 8; 1 is a tie. Of those papers, Livesey and Marsh 2025 ranks MutFormer higher on its own (7 of 7).
Comprehensive assessment of computational algorithms in predicting cancer driver mutations ranks LRT above FATHMM in 18 of 20 comparisons; Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks FATHMM above LRT in 6 of 7 comparisons. No other study gives a verdict, so neither is the outlier.
3 papers rank FATHMM above LRT in 10 of their 33 comparisons and LRT higher in 23. Of those papers, Comprehensive assessment…, Clinical likelihood ratios and balanced… rank LRT higher on their own (18 of 20, 4 of 6).
Comprehensive assessment of computational algorithms in predicting cancer driver mutations ranks LRT above M-CAP in 16 of 20 comparisons; Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks M-CAP above LRT in 7 of 7 comparisons. No other study gives a verdict, so neither is the outlier.
3 papers rank LRT above M-CAP in 18 of their 31 comparisons and M-CAP higher in 13. Of those papers, Livesey and Marsh 2025 ranks M-CAP higher on its own (7 of 7).
A Phylogenetic Approach to Genomic Language Modeling ranks PhyloGPN above Caduceus in 12 of 12 comparisons; GUANinE v1.1 reveals complementarity of supervised and genomic language models ranks Caduceus above PhyloGPN in 6 of 6 comparisons. No other study gives a verdict, so neither is the outlier.
2 papers rank PhyloGPN above Caduceus in 12 of their 18 comparisons and Caduceus higher in 6. Of those papers, GUANinE v1.1 reveals complementarity… ranks Caduceus higher on its own (6 of 6).
Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks MutFormer above MutPred in 6 of 7 comparisons; An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers ranks MutPred above MutFormer in 6 of 6 comparisons. No other study gives a verdict, so neither is the outlier.
2 papers rank MutFormer above MutPred in 6 of their 13 comparisons and MutPred higher in 7. Of those papers, An openly licensed benchmark… ranks MutPred higher on its own (6 of 6).
Comprehensive assessment of computational algorithms in predicting cancer driver mutations ranks PrimateAI above FATHMM-XF in 15 of 19 comparisons; Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks FATHMM-XF above PrimateAI in 7 of 7 comparisons. No other study gives a verdict, so neither is the outlier.
3 papers rank FATHMM-XF above PrimateAI in 14 of their 33 comparisons and PrimateAI higher in 17; 2 are ties. Of those papers, Comprehensive assessment… ranks PrimateAI higher on its own (15 of 20).
Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks VEST4 above MutPred in 6 of 7 comparisons; An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers ranks MutPred above VEST4 in 6 of 6 comparisons. No other study gives a verdict, so neither is the outlier.
4 papers rank MutPred above VEST4 in 14 of their 29 comparisons and VEST4 higher in 14; 1 is a tie. Of those papers, Livesey and Marsh 2025, Clinical likelihood ratios and balanced… rank VEST4 higher on their own (6 of 7, 4 of 6).
Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks MutFormer above phyloP in 7 of 7 comparisons; An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers ranks phyloP above MutFormer in 4 of 5 comparisons. No other study gives a verdict, so neither is the outlier.
2 papers rank MutFormer above phyloP in 8 of their 13 comparisons and phyloP higher in 4; 1 is a tie. Of those papers, An openly licensed benchmark… ranks phyloP higher on its own (4 of 6).
Benchmarking pre-trained genomic language models for RNA sequence-related predictive applications ranks DNABERT above RNABERT in 12 of 12 comparisons; Zero-shot benchmarking of RNA language models in structural, functional, and evolutionary learning ranks RNABERT above DNABERT in 24 of 26 comparisons. No other study gives a verdict, so neither is the outlier.
2 papers rank DNABERT above RNABERT in 14 of their 42 comparisons and RNABERT higher in 24; 4 are ties. Of those papers, Zero-shot benchmarking of RNA language… ranks RNABERT higher on its own (24 of 30).