rewirebio.iobenchmarks
Evidence and investigation

Contested results

Where one study disagrees with what other studies report for the same models, and what we are doing to resolve each case.

These are automatic leads, not findings of error. Each release, a check compares how every study ranks the models it shares with other studies. It flags a study that reverses the order the others agree on, or whose gap to a shared reference model lies well outside theirs. Different tasks, populations or metrics often explain a flag.

A flag never hides a result. Flagged results stay in every table, page and download, marked Contested. A result is withheld only when a reviewer marks it disputed.

How the check works, and how each follow-up is recorded: discrepancies between studies.

In this release

  • 192open
  • 6settled
  • 7resolved
  • 3medium severity
  • 202low severity

Release 2026-11-22-bbed7dce2323 · 205 findings in all · rules version 5

Findings

Status: All · Open · Settled · Resolved

Severity: All · Medium · Low

State: All · Not yet reviewed · Under investigation · Explained · Confirmed error · Not a real disagreement

192 findings match, most severe first.

LRT and MutPred: Clinical likelihood ratios and balanced accuracy for 44 in silico tools against multiple large-scale functional assays of cancer susceptibility genes and Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • unknown

Clinical likelihood ratios and balanced accuracy for 44 in silico tools against multiple large-scale functional assays of cancer susceptibility genes ranks LRT above MutPred in 5 of 6 comparisons; Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks MutPred above LRT in 7 of 7 comparisons. No other study gives a verdict, so neither is the outlier.

4 papers rank LRT above MutPred in 12 of their 24 comparisons and MutPred higher in 12. Of those papers, Livesey and Marsh 2025, ProteinGym rank MutPred higher on their own (7 of 7, 1 of 1).

Comparisons in which each paper scores LRT or MutPred higher4 other papers: LRT higher in 12, MutPred higher in 12, 0 ties.4 other papers12 LRT higher1212 MutPred higher12
LRT higherTieMutPred higher
Compared
LRT, MutPred

Not reviewed yet.

FATHMM-MKL and BayesDel: Clinical likelihood ratios and balanced accuracy for 44 in silico tools against multiple large-scale functional assays of cancer susceptibility genes and Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • unknown

Clinical likelihood ratios and balanced accuracy for 44 in silico tools against multiple large-scale functional assays of cancer susceptibility genes ranks FATHMM-MKL above BayesDel in 3 of 4 comparisons; Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks BayesDel above FATHMM-MKL in 7 of 7 comparisons. No other study gives a verdict, so neither is the outlier.

2 papers rank FATHMM-MKL above BayesDel in 3 of their 12 comparisons and BayesDel higher in 8; 1 is a tie. Of those papers, Livesey and Marsh 2025 ranks BayesDel higher on its own (7 of 7).

Comparisons in which each paper scores FATHMM-MKL or BayesDel higher2 other papers: FATHMM-MKL higher in 3, BayesDel higher in 8, 1 tie.2 other papers3 FATHMM-MKL higher31 tie8 BayesDel higher8
FATHMM-MKL higherTieBayesDel higher
Compared
FATHMM-MKL, BayesDel

Not reviewed yet.

MutScore and REVEL: Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) and An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • unknown

Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks REVEL above MutScore in 6 of 6 comparisons; An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers ranks MutScore above REVEL in 6 of 6 comparisons. No other study gives a verdict, so neither is the outlier.

2 papers rank MutScore above REVEL in 6 of their 13 comparisons and REVEL higher in 6; 1 is a tie. Of those papers, Livesey and Marsh 2025 ranks REVEL higher on its own (6 of 7).

Comparisons in which each paper scores MutScore or REVEL higher2 other papers: MutScore higher in 6, REVEL higher in 6, 1 tie.2 other papers6 MutScore higher61 tie6 REVEL higher6
MutScore higherTieREVEL higher
Compared
MutScore, REVEL

Not reviewed yet.

MutFormer and PrimateAI: Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) and An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • unknown

Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks MutFormer above PrimateAI in 7 of 7 comparisons; An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers ranks PrimateAI above MutFormer in 6 of 6 comparisons. No other study gives a verdict, so neither is the outlier.

2 papers rank MutFormer above PrimateAI in 7 of their 13 comparisons and PrimateAI higher in 6. Of those papers, An openly licensed benchmark… ranks PrimateAI higher on its own (6 of 6).

Comparisons in which each paper scores MutFormer or PrimateAI higher2 other papers: MutFormer higher in 7, PrimateAI higher in 6, 0 ties.2 other papers7 MutFormer higher76 PrimateAI higher6
MutFormer higherTiePrimateAI higher
Compared
MutFormer, PrimateAI

Not reviewed yet.

ESM-1v and MSA Transformer: ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design and Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • different-task

ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design ranks MSA Transformer above ESM-1v in 16 of 19 comparisons; Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks ESM-1v above MSA Transformer in 5 of 5 comparisons. No other study gives a verdict, so neither is the outlier.

2 papers rank ESM-1v above MSA Transformer in 8 of their 25 comparisons and MSA Transformer higher in 16; 1 is a tie. Of those papers, ProteinGym ranks MSA Transformer higher on its own (16 of 19).

Comparisons in which each paper scores ESM-1v or MSA Transformer higher2 other papers: ESM-1v higher in 8, MSA Transformer higher in 16, 1 tie.2 other papers8 ESM-1v higher81 tie16 MSA Transformer higher16
ESM-1v higherTieMSA Transformer higher
Compared
ESM-1v, MSA Transformer

Not reviewed yet.

MPC and REVEL: Comprehensive assessment of computational algorithms in predicting cancer driver mutations and Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • unknown

Comprehensive assessment of computational algorithms in predicting cancer driver mutations ranks MPC above REVEL in 10 of 10 comparisons; Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks REVEL above MPC in 7 of 7 comparisons. No other study gives a verdict, so neither is the outlier.

4 papers rank MPC above REVEL in 12 of their 24 comparisons and REVEL higher in 10; 2 are ties. Of those papers, Livesey and Marsh 2025, ProteinGym rank REVEL higher on their own (7 of 7, 1 of 1).

Comparisons in which each paper scores MPC or REVEL higher4 other papers: MPC higher in 12, REVEL higher in 10, 2 ties.4 other papers12 MPC higher122 tie10 REVEL higher10
MPC higherTieREVEL higher
Compared
MPC, REVEL

Not reviewed yet.

RNAErnie and Evo: Zero-shot benchmarking of RNA language models in structural, functional, and evolutionary learning and RNAGym fitness leaderboard (v0.1.1), leaderboard/fitness/README.md disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • Same task, different protocols

Zero-shot benchmarking of RNA language models in structural, functional, and evolutionary learning ranks Evo above RNAErnie in 6 of 6 comparisons; RNAGym fitness leaderboard (v0.1.1), leaderboard/fitness/README.md ranks RNAErnie above Evo in 4 of 4 comparisons. No other study gives a verdict, so neither is the outlier.

2 papers rank RNAErnie above Evo in 4 of their 10 comparisons and Evo higher in 6. Of those papers, Zero-shot benchmarking of RNA language… ranks Evo higher on its own (6 of 6).

Comparisons in which each paper scores RNAErnie or Evo higher2 other papers: RNAErnie higher in 4, Evo higher in 6, 0 ties.2 other papers4 RNAErnie higher46 Evo higher6
RNAErnie higherTieEvo higher
Compared
RNAErnie, Evo

Not reviewed yet.

RNA-MSM and UTR-LM: Benchmarking pre-trained genomic language models for RNA sequence-related predictive applications and Zero-shot benchmarking of RNA language models in structural, functional, and evolutionary learning disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • unknown

Benchmarking pre-trained genomic language models for RNA sequence-related predictive applications ranks UTR-LM above RNA-MSM in 3 of 3 comparisons; Zero-shot benchmarking of RNA language models in structural, functional, and evolutionary learning ranks RNA-MSM above UTR-LM in 8 of 8 comparisons. No other study gives a verdict, so neither is the outlier.

2 papers rank RNA-MSM above UTR-LM in 8 of their 23 comparisons and UTR-LM higher in 3; 12 are ties. Of those papers, Benchmarking pre-trained genomic… ranks UTR-LM higher on its own (3 of 15).

Comparisons in which each paper scores RNA-MSM or UTR-LM higher2 other papers: RNA-MSM higher in 8, UTR-LM higher in 3, 12 ties.2 other papers8 RNA-MSM higher812 tie123 UTR-LM higher3
RNA-MSM higherTieUTR-LM higher
Compared
RNA-MSM, UTR-LM

Not reviewed yet.

VEST4 and BayesDel: Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) and An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • unknown

Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks VEST4 above BayesDel in 6 of 7 comparisons; An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers ranks BayesDel above VEST4 in 5 of 5 comparisons. No other study gives a verdict, so neither is the outlier.

4 papers rank VEST4 above BayesDel in 8 of their 20 comparisons and BayesDel higher in 10; 2 are ties. Of those papers, An openly licensed benchmark…, ProteinGym rank BayesDel higher on their own (5 of 6, 1 of 1).

Comparisons in which each paper scores VEST4 or BayesDel higher4 other papers: VEST4 higher in 8, BayesDel higher in 10, 2 ties.4 other papers8 VEST4 higher82 tie210 BayesDel higher10
VEST4 higherTieBayesDel higher
Compared
VEST4, BayesDel

Not reviewed yet.

ACDC-NN and MAESTRO: Transfer learning to leverage larger datasets for improved prediction of protein stability changes and Predicting protein stability changes upon single-point mutation: a thorough comparison of the available tools on a new dataset disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • unknown

Transfer learning to leverage larger datasets for improved prediction of protein stability changes ranks MAESTRO above ACDC-NN in 5 of 5 comparisons; Predicting protein stability changes upon single-point mutation: a thorough comparison of the available tools on a new dataset ranks ACDC-NN above MAESTRO in 7 of 9 comparisons. No other study gives a verdict, so neither is the outlier.

2 papers rank ACDC-NN above MAESTRO in 7 of their 16 comparisons and MAESTRO higher in 7; 2 are ties. Of those papers, Transfer learning to leverage larger… ranks MAESTRO higher on its own (5 of 6).

Comparisons in which each paper scores ACDC-NN or MAESTRO higher2 other papers: ACDC-NN higher in 7, MAESTRO higher in 7, 2 ties.2 other papers7 ACDC-NN higher72 tie27 MAESTRO higher7
ACDC-NN higherTieMAESTRO higher
Compared
ACDC-NN, MAESTRO

Not reviewed yet.

Centrifuge and Genome Detective: de Vries et al. medRxiv preprint v1, Supplementary Tables 2-4 and Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • unknown

de Vries et al. medRxiv preprint v1, Supplementary Tables 2-4 ranks Centrifuge above Genome Detective in 5 of 5 comparisons; Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 ranks Genome Detective above Centrifuge in 12 of 13 comparisons. No other study gives a verdict, so neither is the outlier.

2 papers rank Centrifuge above Genome Detective in 6 of their 35 comparisons and Genome Detective higher in 12; 17 are ties. Of those papers, Carbo et al. 2022 ranks Genome Detective higher on its own (12 of 28).

Comparisons in which each paper scores Centrifuge or Genome Detective higher2 other papers: Centrifuge higher in 6, Genome Detective higher in 12, 17 ties.2 other papers6 Centrifuge higher617 tie1712 Genome Detective higher12
Centrifuge higherTieGenome Detective higher
Compared
Centrifuge, Genome Detective

Not reviewed yet.

EVmutation and Tranception: ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design and Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • different-task

ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design ranks Tranception above EVmutation in 15 of 18 comparisons; Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks EVmutation above Tranception in 7 of 7 comparisons. No other study gives a verdict, so neither is the outlier.

2 papers rank EVmutation above Tranception in 10 of their 26 comparisons and Tranception higher in 15; 1 is a tie. Of those papers, ProteinGym ranks Tranception higher on its own (15 of 19).

Comparisons in which each paper scores EVmutation or Tranception higher2 other papers: EVmutation higher in 10, Tranception higher in 15, 1 tie.2 other papers10 EVmutation higher101 tie15 Tranception higher15
EVmutation higherTieTranception higher
Compared
EVmutation, Tranception

Not reviewed yet.

Tranception and VESPAl: ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design and Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • different-task

ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design ranks Tranception above VESPAl in 17 of 18 comparisons; Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks VESPAl above Tranception in 6 of 7 comparisons. No other study gives a verdict, so neither is the outlier.

2 papers rank Tranception above VESPAl in 18 of their 26 comparisons and VESPAl higher in 7; 1 is a tie. Of those papers, Livesey and Marsh 2025 ranks VESPAl higher on its own (6 of 7).

Comparisons in which each paper scores Tranception or VESPAl higher2 other papers: Tranception higher in 18, VESPAl higher in 7, 1 tie.2 other papers18 Tranception higher181 tie7 VESPAl higher7
Tranception higherTieVESPAl higher
Compared
Tranception, VESPAl

Not reviewed yet.

ESM-1v and ESM-1b: Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2) and Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • unknown

Genomic heterogeneity inflates the performance of variant pathogenicity predictions (Lu, Liu, Lin and Brandes, bioRxiv 2025, v2) ranks ESM-1b above ESM-1v in 5 of 5 comparisons; Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks ESM-1v above ESM-1b in 7 of 7 comparisons. No other study gives a verdict, so neither is the outlier.

3 papers rank ESM-1v above ESM-1b in 18 of their 31 comparisons and ESM-1b higher in 12; 1 is a tie. Of those papers, Genomic heterogeneity inflates… ranks ESM-1b higher on its own (5 of 5).

Comparisons in which each paper scores ESM-1v or ESM-1b higher3 other papers: ESM-1v higher in 18, ESM-1b higher in 12, 1 tie.3 other papers18 ESM-1v higher181 tie12 ESM-1b higher12
ESM-1v higherTieESM-1b higher
Compared
ESM-1v, ESM-1b

Not reviewed yet.

ESM-1v and Tranception: ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design and Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • different-task

ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design ranks Tranception above ESM-1v in 14 of 17 comparisons; Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks ESM-1v above Tranception in 7 of 7 comparisons. No other study gives a verdict, so neither is the outlier.

2 papers rank ESM-1v above Tranception in 10 of their 26 comparisons and Tranception higher in 14; 2 are ties. Of those papers, ProteinGym ranks Tranception higher on its own (14 of 19).

Comparisons in which each paper scores ESM-1v or Tranception higher2 other papers: ESM-1v higher in 10, Tranception higher in 14, 2 ties.2 other papers10 ESM-1v higher102 tie14 Tranception higher14
ESM-1v higherTieTranception higher
Compared
ESM-1v, Tranception

Not reviewed yet.

Evo 2 and Mistral-DNA: GUANinE v1.1 reveals complementarity of supervised and genomic language models and BacBench LICENSE file at commit 64b7d45 disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • different-task

GUANinE v1.1 reveals complementarity of supervised and genomic language models ranks Evo 2 above Mistral-DNA in 6 of 6 comparisons; BacBench LICENSE file at commit 64b7d45 ranks Mistral-DNA above Evo 2 in 9 of 10 comparisons. No other study gives a verdict, so neither is the outlier.

2 papers rank Evo 2 above Mistral-DNA in 7 of their 16 comparisons and Mistral-DNA higher in 9. Of those papers, BacBench LICENSE file at commit 64b7d45 ranks Mistral-DNA higher on its own (9 of 10).

Comparisons in which each paper scores Evo 2 or Mistral-DNA higher2 other papers: Evo 2 higher in 7, Mistral-DNA higher in 9, 0 ties.2 other papers7 Evo 2 higher79 Mistral-DNA higher9
Evo 2 higherTieMistral-DNA higher
Compared
Evo 2, Mistral-DNA

Not reviewed yet.

ESM-2 and Evo 2: Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026) and BacBench LICENSE file at commit 64b7d45 disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • different-task

Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026) ranks Evo 2 above ESM-2 in 28 of 28 comparisons; BacBench LICENSE file at commit 64b7d45 ranks ESM-2 above Evo 2 in 10 of 10 comparisons. No other study gives a verdict, so neither is the outlier.

3 papers rank ESM-2 above Evo 2 in 12 of their 43 comparisons and Evo 2 higher in 30; 1 is a tie. Of those papers, Genome modelling and design across all… ranks Evo 2 higher on its own (28 of 28).

Comparisons in which each paper scores ESM-2 or Evo 2 higher3 other papers: ESM-2 higher in 12, Evo 2 higher in 30, 1 tie.3 other papers12 ESM-2 higher121 tie30 Evo 2 higher30
ESM-2 higherTieEvo 2 higher
Compared
ESM-2, Evo 2

Not reviewed yet.

ESM-2 and ESM-1b: Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026) and Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • different-task

Genome modelling and design across all domains of life with Evo 2: Supplementary Data 1, human variant effect prediction results (Nature 2026) ranks ESM-1b above ESM-2 in 26 of 28 comparisons; Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks ESM-2 above ESM-1b in 6 of 7 comparisons. No other study gives a verdict, so neither is the outlier.

5 papers rank ESM-2 above ESM-1b in 31 of their 87 comparisons and ESM-1b higher in 47; 9 are ties. Of those papers, Genome modelling and design across all… ranks ESM-1b higher on its own (26 of 28).

Comparisons in which each paper scores ESM-2 or ESM-1b higher5 other papers: ESM-2 higher in 31, ESM-1b higher in 47, 9 ties.5 other papers31 ESM-2 higher319 tie947 ESM-1b higher47
ESM-2 higherTieESM-1b higher
Compared
ESM-2, ESM-1b

Not reviewed yet.

Eigen and MutFormer: Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) and An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • unknown

Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks MutFormer above Eigen in 7 of 7 comparisons; An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers ranks Eigen above MutFormer in 6 of 6 comparisons. No other study gives a verdict, so neither is the outlier.

2 papers rank Eigen above MutFormer in 6 of their 13 comparisons and MutFormer higher in 7. Of those papers, Livesey and Marsh 2025 ranks MutFormer higher on its own (7 of 7).

Comparisons in which each paper scores Eigen or MutFormer higher2 other papers: Eigen higher in 6, MutFormer higher in 7, 0 ties.2 other papers6 Eigen higher67 MutFormer higher7
Eigen higherTieMutFormer higher
Compared
Eigen, MutFormer

Not reviewed yet.

RNA-MSM and SpliceBERT: Benchmarking pre-trained genomic language models for RNA sequence-related predictive applications and Zero-shot benchmarking of RNA language models in structural, functional, and evolutionary learning disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • unknown

Benchmarking pre-trained genomic language models for RNA sequence-related predictive applications ranks SpliceBERT above RNA-MSM in 7 of 7 comparisons; Zero-shot benchmarking of RNA language models in structural, functional, and evolutionary learning ranks RNA-MSM above SpliceBERT in 8 of 8 comparisons. No other study gives a verdict, so neither is the outlier.

2 papers rank RNA-MSM above SpliceBERT in 8 of their 23 comparisons and SpliceBERT higher in 7; 8 are ties. Of those papers, Benchmarking pre-trained genomic… ranks SpliceBERT higher on its own (7 of 15).

Comparisons in which each paper scores RNA-MSM or SpliceBERT higher2 other papers: RNA-MSM higher in 8, SpliceBERT higher in 7, 8 ties.2 other papers8 RNA-MSM higher88 tie87 SpliceBERT higher7
RNA-MSM higherTieSpliceBERT higher
Compared
RNA-MSM, SpliceBERT

Not reviewed yet.

Evo and AIDO.RNA: Zero-shot benchmarking of RNA language models in structural, functional, and evolutionary learning and RNAGym fitness leaderboard (v0.1.1), leaderboard/fitness/README.md disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • Same task, different protocols

Zero-shot benchmarking of RNA language models in structural, functional, and evolutionary learning ranks Evo above AIDO.RNA in 5 of 5 comparisons; RNAGym fitness leaderboard (v0.1.1), leaderboard/fitness/README.md ranks AIDO.RNA above Evo in 3 of 3 comparisons. No other study gives a verdict, so neither is the outlier.

2 papers rank Evo above AIDO.RNA in 5 of their 10 comparisons and AIDO.RNA higher in 3; 2 are ties. Of those papers, RNAGym fitness leaderboard ranks AIDO.RNA higher on its own (3 of 4).

Comparisons in which each paper scores Evo or AIDO.RNA higher2 other papers: Evo higher in 5, AIDO.RNA higher in 3, 2 ties.2 other papers5 Evo higher52 tie23 AIDO.RNA higher3
Evo higherTieAIDO.RNA higher
Compared
Evo, AIDO.RNA

Not reviewed yet.

ProGen2 and Tranception: ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design and Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • different-task

ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design ranks Tranception above ProGen2 in 19 of 19 comparisons; Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks ProGen2 above Tranception in 6 of 6 comparisons. No other study gives a verdict, so neither is the outlier.

2 papers rank ProGen2 above Tranception in 6 of their 26 comparisons and Tranception higher in 19; 1 is a tie. Of those papers, ProteinGym ranks Tranception higher on its own (19 of 20).

Comparisons in which each paper scores ProGen2 or Tranception higher2 other papers: ProGen2 higher in 6, Tranception higher in 19, 1 tie.2 other papers6 ProGen2 higher61 tie19 Tranception higher19
ProGen2 higherTieTranception higher
Compared
ProGen2, Tranception

Not reviewed yet.

EVmutation and CARP: ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design and Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • different-task

ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design ranks EVmutation above CARP in 15 of 19 comparisons; Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks CARP above EVmutation in 5 of 6 comparisons. No other study gives a verdict, so neither is the outlier.

2 papers rank EVmutation above CARP in 16 of their 25 comparisons and CARP higher in 9. Of those papers, Livesey and Marsh 2025 ranks CARP higher on its own (5 of 6).

Comparisons in which each paper scores EVmutation or CARP higher2 other papers: EVmutation higher in 16, CARP higher in 9, 0 ties.2 other papers16 EVmutation higher169 CARP higher9
EVmutation higherTieCARP higher
Compared
EVmutation, CARP

Not reviewed yet.

MutFormer and VEST4: Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) and An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • unknown

Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks MutFormer above VEST4 in 6 of 7 comparisons; An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers ranks VEST4 above MutFormer in 6 of 6 comparisons. No other study gives a verdict, so neither is the outlier.

2 papers rank MutFormer above VEST4 in 6 of their 13 comparisons and VEST4 higher in 7. Of those papers, An openly licensed benchmark… ranks VEST4 higher on its own (6 of 6).

Comparisons in which each paper scores MutFormer or VEST4 higher2 other papers: MutFormer higher in 6, VEST4 higher in 7, 0 ties.2 other papers6 MutFormer higher67 VEST4 higher7
MutFormer higherTieVEST4 higher
Compared
MutFormer, VEST4

Not reviewed yet.

MutationAssessor and PrimateAI: Comprehensive assessment of computational algorithms in predicting cancer driver mutations and Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • unknown

Comprehensive assessment of computational algorithms in predicting cancer driver mutations ranks PrimateAI above MutationAssessor in 19 of 20 comparisons; Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks MutationAssessor above PrimateAI in 7 of 7 comparisons. No other study gives a verdict, so neither is the outlier.

5 papers rank MutationAssessor above PrimateAI in 15 of their 40 comparisons and PrimateAI higher in 24; 1 is a tie. Of those papers, Comprehensive assessment… ranks PrimateAI higher on its own (19 of 20).

Comparisons in which each paper scores MutationAssessor or PrimateAI higher5 other papers: MutationAssessor higher in 15, PrimateAI higher in 24, 1 tie.5 other papers15 MutationAssessor higher151 tie24 PrimateAI higher24
MutationAssessor higherTiePrimateAI higher
Compared
MutationAssessor, PrimateAI

Not reviewed yet.

LIST-S2 and MetaLR: Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) and An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • unknown

Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks MetaLR above LIST-S2 in 7 of 7 comparisons; An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers ranks LIST-S2 above MetaLR in 4 of 5 comparisons. No other study gives a verdict, so neither is the outlier.

2 papers rank LIST-S2 above MetaLR in 4 of their 13 comparisons and MetaLR higher in 8; 1 is a tie. Of those papers, Livesey and Marsh 2025 ranks MetaLR higher on its own (7 of 7).

Comparisons in which each paper scores LIST-S2 or MetaLR higher2 other papers: LIST-S2 higher in 4, MetaLR higher in 8, 1 tie.2 other papers4 LIST-S2 higher41 tie8 MetaLR higher8
LIST-S2 higherTieMetaLR higher
Compared
LIST-S2, MetaLR

Not reviewed yet.

mCSM and ThermoNet: Transfer learning to leverage larger datasets for improved prediction of protein stability changes and Predicting protein stability changes upon single-point mutation: a thorough comparison of the available tools on a new dataset disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • unknown

Transfer learning to leverage larger datasets for improved prediction of protein stability changes ranks mCSM above ThermoNet in 6 of 6 comparisons; Predicting protein stability changes upon single-point mutation: a thorough comparison of the available tools on a new dataset ranks ThermoNet above mCSM in 8 of 10 comparisons. No other study gives a verdict, so neither is the outlier.

2 papers rank mCSM above ThermoNet in 8 of their 16 comparisons and ThermoNet higher in 8. Of those papers, Predicting protein stability changes… ranks ThermoNet higher on its own (8 of 10).

Comparisons in which each paper scores mCSM or ThermoNet higher2 other papers: mCSM higher in 8, ThermoNet higher in 8, 0 ties.2 other papers8 mCSM higher88 ThermoNet higher8
mCSM higherTieThermoNet higher
Compared
mCSM, ThermoNet

Not reviewed yet.

Eigen and PrimateAI: Comprehensive assessment of computational algorithms in predicting cancer driver mutations and Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • unknown

Comprehensive assessment of computational algorithms in predicting cancer driver mutations ranks PrimateAI above Eigen in 5 of 5 comparisons; Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks Eigen above PrimateAI in 7 of 7 comparisons. No other study gives a verdict, so neither is the outlier.

4 papers rank Eigen above PrimateAI in 13 of their 29 comparisons and PrimateAI higher in 9; 7 are ties. Of those papers, Comprehensive assessment… ranks PrimateAI higher on its own (5 of 10).

Comparisons in which each paper scores Eigen or PrimateAI higher4 other papers: Eigen higher in 13, PrimateAI higher in 9, 7 ties.4 other papers13 Eigen higher137 tie79 PrimateAI higher9
Eigen higherTiePrimateAI higher
Compared
Eigen, PrimateAI

Not reviewed yet.

MutScore and ESM-1b: Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) and An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • unknown

Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks ESM-1b above MutScore in 6 of 7 comparisons; An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers ranks MutScore above ESM-1b in 6 of 6 comparisons. No other study gives a verdict, so neither is the outlier.

2 papers rank MutScore above ESM-1b in 7 of their 13 comparisons and ESM-1b higher in 6. Of those papers, Livesey and Marsh 2025 ranks ESM-1b higher on its own (6 of 7).

Comparisons in which each paper scores MutScore or ESM-1b higher2 other papers: MutScore higher in 7, ESM-1b higher in 6, 0 ties.2 other papers7 MutScore higher76 ESM-1b higher6
MutScore higherTieESM-1b higher
Compared
MutScore, ESM-1b

Not reviewed yet.

MutPred and REVEL: Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) and An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • unknown

Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks REVEL above MutPred in 6 of 7 comparisons; An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers ranks MutPred above REVEL in 6 of 6 comparisons. No other study gives a verdict, so neither is the outlier.

4 papers rank MutPred above REVEL in 15 of their 29 comparisons and REVEL higher in 14. Of those papers, Livesey and Marsh 2025, Clinical likelihood ratios and balanced… rank REVEL higher on their own (6 of 7, 4 of 6).

Comparisons in which each paper scores MutPred or REVEL higher4 other papers: MutPred higher in 15, REVEL higher in 14, 0 ties.4 other papers15 MutPred higher1514 REVEL higher14
MutPred higherTieREVEL higher
Compared
MutPred, REVEL

Not reviewed yet.

ChromBPNet and GENA-LM: GUANinE v1.1 reveals complementarity of supervised and genomic language models and Comparative Analysis of Deep Learning Models for Predicting Causative Regulatory Variants disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • unknown

GUANinE v1.1 reveals complementarity of supervised and genomic language models ranks GENA-LM above ChromBPNet in 3 of 4 comparisons; Comparative Analysis of Deep Learning Models for Predicting Causative Regulatory Variants ranks ChromBPNet above GENA-LM in 4 of 4 comparisons. No other study gives a verdict, so neither is the outlier.

2 papers rank ChromBPNet above GENA-LM in 5 of their 10 comparisons and GENA-LM higher in 3; 2 are ties. Of those papers, GUANinE v1.1 reveals complementarity… ranks GENA-LM higher on its own (3 of 6).

Comparisons in which each paper scores ChromBPNet or GENA-LM higher2 other papers: ChromBPNet higher in 5, GENA-LM higher in 3, 2 ties.2 other papers5 ChromBPNet higher52 tie23 GENA-LM higher3
ChromBPNet higherTieGENA-LM higher
Compared
ChromBPNet, GENA-LM

Not reviewed yet.

MetaLR and PolyPhen-2: Comprehensive assessment of computational algorithms in predicting cancer driver mutations and Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • unknown

Comprehensive assessment of computational algorithms in predicting cancer driver mutations ranks PolyPhen-2 above MetaLR in 17 of 19 comparisons; Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks MetaLR above PolyPhen-2 in 6 of 6 comparisons. No other study gives a verdict, so neither is the outlier.

4 papers rank MetaLR above PolyPhen-2 in 13 of their 38 comparisons and PolyPhen-2 higher in 22; 3 are ties. Of those papers, Comprehensive assessment… ranks PolyPhen-2 higher on its own (17 of 20).

Comparisons in which each paper scores MetaLR or PolyPhen-2 higher4 other papers: MetaLR higher in 13, PolyPhen-2 higher in 22, 3 ties.4 other papers13 MetaLR higher133 tie22 PolyPhen-2 higher22
MetaLR higherTiePolyPhen-2 higher
Compared
MetaLR, PolyPhen-2

Not reviewed yet.

LIST-S2 and M-CAP: Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) and An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • unknown

Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks M-CAP above LIST-S2 in 7 of 7 comparisons; An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers ranks LIST-S2 above M-CAP in 5 of 6 comparisons. No other study gives a verdict, so neither is the outlier.

2 papers rank LIST-S2 above M-CAP in 5 of their 13 comparisons and M-CAP higher in 8. Of those papers, Livesey and Marsh 2025 ranks M-CAP higher on its own (7 of 7).

Comparisons in which each paper scores LIST-S2 or M-CAP higher2 other papers: LIST-S2 higher in 5, M-CAP higher in 8, 0 ties.2 other papers5 LIST-S2 higher58 M-CAP higher8
LIST-S2 higherTieM-CAP higher
Compared
LIST-S2, M-CAP

Not reviewed yet.

PANTHER and SIFT: Clinical likelihood ratios and balanced accuracy for 44 in silico tools against multiple large-scale functional assays of cancer susceptibility genes and Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • unknown

Clinical likelihood ratios and balanced accuracy for 44 in silico tools against multiple large-scale functional assays of cancer susceptibility genes ranks SIFT above PANTHER in 3 of 4 comparisons; Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks PANTHER above SIFT in 5 of 6 comparisons. No other study gives a verdict, so neither is the outlier.

2 papers rank PANTHER above SIFT in 6 of their 11 comparisons and SIFT higher in 4; 1 is a tie. Of those papers, Clinical likelihood ratios and balanced… ranks SIFT higher on its own (3 of 5).

Comparisons in which each paper scores PANTHER or SIFT higher2 other papers: PANTHER higher in 6, SIFT higher in 4, 1 tie.2 other papers6 PANTHER higher61 tie14 SIFT higher4
PANTHER higherTieSIFT higher
Compared
PANTHER, SIFT

Not reviewed yet.

ChromBPNet and Borzoi: GUANinE v1.1 reveals complementarity of supervised and genomic language models and Comparative Analysis of Deep Learning Models for Predicting Causative Regulatory Variants disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • unknown

GUANinE v1.1 reveals complementarity of supervised and genomic language models ranks Borzoi above ChromBPNet in 5 of 5 comparisons; Comparative Analysis of Deep Learning Models for Predicting Causative Regulatory Variants ranks ChromBPNet above Borzoi in 4 of 4 comparisons. No other study gives a verdict, so neither is the outlier.

3 papers rank ChromBPNet above Borzoi in 7 of their 21 comparisons and Borzoi higher in 12; 2 are ties. Of those papers, AlphaGenome Nature 2026, GUANinE v1.1 reveals complementarity… rank Borzoi higher on their own (7 of 10, 5 of 7).

Comparisons in which each paper scores ChromBPNet or Borzoi higher3 other papers: ChromBPNet higher in 7, Borzoi higher in 12, 2 ties.3 other papers7 ChromBPNet higher72 tie212 Borzoi higher12
ChromBPNet higherTieBorzoi higher
Compared
ChromBPNet, Borzoi

Not reviewed yet.

Condel and CADD: Clinical likelihood ratios and balanced accuracy for 44 in silico tools against multiple large-scale functional assays of cancer susceptibility genes and Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • unknown

Clinical likelihood ratios and balanced accuracy for 44 in silico tools against multiple large-scale functional assays of cancer susceptibility genes ranks CADD above Condel in 4 of 5 comparisons; Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks Condel above CADD in 6 of 7 comparisons. No other study gives a verdict, so neither is the outlier.

2 papers rank Condel above CADD in 7 of their 12 comparisons and CADD higher in 5. Of those papers, Clinical likelihood ratios and balanced… ranks CADD higher on its own (4 of 5).

Comparisons in which each paper scores Condel or CADD higher2 other papers: Condel higher in 7, CADD higher in 5, 0 ties.2 other papers7 Condel higher75 CADD higher5
Condel higherTieCADD higher
Compared
Condel, CADD

Not reviewed yet.

MutFormer and MutScore: Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) and An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • unknown

Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks MutFormer above MutScore in 6 of 7 comparisons; An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers ranks MutScore above MutFormer in 6 of 6 comparisons. No other study gives a verdict, so neither is the outlier.

2 papers rank MutFormer above MutScore in 6 of their 13 comparisons and MutScore higher in 7. Of those papers, An openly licensed benchmark… ranks MutScore higher on its own (6 of 6).

Comparisons in which each paper scores MutFormer or MutScore higher2 other papers: MutFormer higher in 6, MutScore higher in 7, 0 ties.2 other papers6 MutFormer higher67 MutScore higher7
MutFormer higherTieMutScore higher
Compared
MutFormer, MutScore

Not reviewed yet.

REVEL and VEST4: Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) and An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • unknown

Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks REVEL above VEST4 in 6 of 7 comparisons; An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers ranks VEST4 above REVEL in 3 of 4 comparisons. No other study gives a verdict, so neither is the outlier.

5 papers rank REVEL above VEST4 in 14 of their 30 comparisons and VEST4 higher in 12; 4 are ties. Of those papers, An openly licensed benchmark… ranks VEST4 higher on its own (3 of 6).

Comparisons in which each paper scores REVEL or VEST4 higher5 other papers: REVEL higher in 14, VEST4 higher in 12, 4 ties.5 other papers14 REVEL higher144 tie412 VEST4 higher12
REVEL higherTieVEST4 higher
Compared
REVEL, VEST4

Not reviewed yet.

LIST-S2 and MetaSVM: Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) and An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • unknown

Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks MetaSVM above LIST-S2 in 7 of 7 comparisons; An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers ranks LIST-S2 above MetaSVM in 3 of 4 comparisons. No other study gives a verdict, so neither is the outlier.

2 papers rank LIST-S2 above MetaSVM in 3 of their 13 comparisons and MetaSVM higher in 8; 2 are ties. Of those papers, Livesey and Marsh 2025 ranks MetaSVM higher on its own (7 of 7).

Comparisons in which each paper scores LIST-S2 or MetaSVM higher2 other papers: LIST-S2 higher in 3, MetaSVM higher in 8, 2 ties.2 other papers3 LIST-S2 higher32 tie28 MetaSVM higher8
LIST-S2 higherTieMetaSVM higher
Compared
LIST-S2, MetaSVM

Not reviewed yet.

MutationAssessor and MVP: Comprehensive assessment of computational algorithms in predicting cancer driver mutations and Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • unknown

Comprehensive assessment of computational algorithms in predicting cancer driver mutations ranks MVP above MutationAssessor in 10 of 10 comparisons; Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks MutationAssessor above MVP in 7 of 7 comparisons. No other study gives a verdict, so neither is the outlier.

4 papers rank MutationAssessor above MVP in 11 of their 28 comparisons and MVP higher in 17. Of those papers, Comprehensive assessment…, An openly licensed benchmark… rank MVP higher on their own (10 of 10, 4 of 6).

Comparisons in which each paper scores MutationAssessor or MVP higher4 other papers: MutationAssessor higher in 11, MVP higher in 17, 0 ties.4 other papers11 MutationAssessor higher1117 MVP higher17
MutationAssessor higherTieMVP higher
Compared
MutationAssessor, MVP

Not reviewed yet.

Geneformer and UCE (Universal Cell Embeddings): Deep-learning-based gene perturbation effect prediction does not yet outperform simple linear baselines and Wu et al. 2025, Additional file 3 (Supplementary Tables S1-S13) disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • unknown

Deep-learning-based gene perturbation effect prediction does not yet outperform simple linear baselines ranks Geneformer above UCE (Universal Cell Embeddings) in 2 of 2 comparisons; Wu et al. 2025, Additional file 3 (Supplementary Tables S1-S13) ranks UCE (Universal Cell Embeddings) above Geneformer in 3 of 3 comparisons. No other study gives a verdict, so neither is the outlier.

3 papers rank Geneformer above UCE (Universal Cell Embeddings) in 6 of their 18 comparisons and UCE (Universal Cell Embeddings) higher in 9; 3 are ties. Of those papers, Wu et al. 2025 ranks UCE (Universal Cell Embeddings) higher on its own (3 of 4).

Comparisons in which each paper scores Geneformer or UCE (Universal Cell Embeddings) higher3 other papers: Geneformer higher in 6, UCE (Universal Cell Embeddings) higher in 9, 3 ties.3 other papers6 Geneformer higher63 tie39 UCE (Universal Cell Embeddings) higher9
Geneformer higherTieUCE (Universal Cell Embeddings) higher
Compared
Geneformer, UCE (Universal Cell Embeddings)

Not reviewed yet.

CADD and MutFormer: Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) and An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • unknown

Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks MutFormer above CADD in 7 of 7 comparisons; An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers ranks CADD above MutFormer in 6 of 6 comparisons. No other study gives a verdict, so neither is the outlier.

2 papers rank CADD above MutFormer in 6 of their 13 comparisons and MutFormer higher in 7. Of those papers, Livesey and Marsh 2025 ranks MutFormer higher on its own (7 of 7).

Comparisons in which each paper scores CADD or MutFormer higher2 other papers: CADD higher in 6, MutFormer higher in 7, 0 ties.2 other papers6 CADD higher67 MutFormer higher7
CADD higherTieMutFormer higher
Compared
CADD, MutFormer

Not reviewed yet.

First page