LRT and PolyPhen-2: Comprehensive assessment of computational algorithms in predicting cancer driver mutations and Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) disagree
- Low severity
- Not yet reviewed
- Two-study conflict
- unknown
Comprehensive assessment of computational algorithms in predicting cancer driver mutations ranks LRT above PolyPhen-2 in 14 of 18 comparisons; Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) ranks PolyPhen-2 above LRT in 6 of 6 comparisons. No other study gives a verdict, so neither is the outlier.
An automatic lead, not a finding of error. The results below are shown as published, everywhere on the site, until a reviewer decides otherwise.
Which studies agree
3 papers rank LRT above PolyPhen-2 in 17 of their 32 comparisons and PolyPhen-2 higher in 13; 2 are ties. Of those papers, Livesey and Marsh 2025 ranks PolyPhen-2 higher on its own (6 of 6).
- Rank LRT higher (1): Comprehensive assessment…
- Rank PolyPhen-2 higher (1): Livesey and Marsh 2025
- Mixed (1): Clinical likelihood ratios and balanced…
Each paper sits where at least two thirds of its comparisons point; Mixed means neither model reaches two thirds. The larger, outlined dot is the paper that disagrees.
| Paper | Role | Ranks LRT higher | Ranks PolyPhen-2 higher | Ties |
|---|---|---|---|---|
| Comprehensive assessment of computational algorithms in predicting cancer driver mutations and 4 more records · DOI | Agrees | 14 | 4 | 2 |
| Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) and 1 more record · DOI | Agrees | 0 | 6 | 0 |
| Clinical likelihood ratios and balanced accuracy for 44 in silico tools against multiple large-scale functional assays of cancer susceptibility genes and 1 more record · DOI | Agrees | 3 | 3 | 0 |
Comparisons in Comprehensive assessment… (20)
Comparisons in Livesey and Marsh 2025 (6)
| Protocol | Dataset | Metric | LRT | PolyPhen-2 | Higher |
|---|---|---|---|---|---|
| Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, all 36 DMS sets | Livesey and Marsh 2025 human DMS benchmark set (36 proteins) | Pairwise win rate (average pairwise win rate against all other VEPs, |Spearman| with DMS on shared variants, 36 human DMS sets), percent | 13.6 | 42.4 | PolyPhen-2 |
| Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, all 36 DMS sets | Livesey and Marsh 2025 human DMS benchmark set (36 proteins) | Pairwise win rate (average pairwise win rate against the five top-ranked VEPs (column top_5_winrate; the five are not listed in the table), |Spearman| with DMS on shared variants, 36 human DMS sets), percent | 1.22 | 6.76 | PolyPhen-2 |
| Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, direct assays only | Livesey and Marsh 2025 human DMS benchmark set (36 proteins) | Pairwise win rate (average pairwise win rate against all other VEPs, |Spearman| with DMS on shared variants, direct DMS assays only), percent | 15.4 | 41.5 | PolyPhen-2 |
| Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, indirect assays only | Livesey and Marsh 2025 human DMS benchmark set (36 proteins) | Pairwise win rate (average pairwise win rate against all other VEPs, |Spearman| with DMS on shared variants, indirect DMS assays only), percent | 12.3 | 43.1 | PolyPhen-2 |
| Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, SNV-accessible substitutions only | Livesey and Marsh 2025 human DMS benchmark set (36 proteins) | Pairwise win rate (average pairwise win rate against all other VEPs, |Spearman| with DMS on shared variants, SNV-accessible substitutions only), percent | 13.6 | 42.4 | PolyPhen-2 |
| Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, SNV-accessible substitutions with gaps filled | Livesey and Marsh 2025 human DMS benchmark set (36 proteins) | Pairwise win rate (average pairwise win rate against all other VEPs, |Spearman| with DMS, SNV-accessible substitutions, missing predictions filled with the VEP's most benign score), percent | 14.3 | 44.1 | PolyPhen-2 |
Comparisons in Clinical likelihood ratios and balanced… (6)
What disagrees
- studies
- 2
- Compared
- LRT, PolyPhen-2
- Study that disagrees
- Other studies
- Rule
- Two-study conflict; unknown
- Model identity
- Matched across studies partly through links not yet reviewed
Follow-up
Current state: Not yet reviewed.
No one has reviewed this finding yet.
How to help resolve this
If you know why these studies disagree, for example a different population, metric or preprocessing step, or you have a corrected value, tell us through the contribution form. A reviewer checks every submission against its source before anything changes, and the step is added to the follow-up above.
Finding discrepancy-38aa6b70c75c912b · All contested results · How findings are made and followed up