rewirebio.iobenchmarks
Evidence and investigation

Contested results

Where one study disagrees with what other studies report for the same models, and what we are doing to resolve each case.

These are automatic leads, not findings of error. Each release, a check compares how every study ranks the models it shares with other studies. It flags a study that reverses the order the others agree on, or whose gap to a shared reference model lies well outside theirs. Different tasks, populations or metrics often explain a flag.

A flag never hides a result. Flagged results stay in every table, page and download, marked Contested. A result is withheld only when a reviewer marks it disputed.

How the check works, and how each follow-up is recorded: discrepancies between studies.

In this release

  • 121open
  • 5settled
  • 7resolved
  • 1medium severity
  • 132low severity

Release 2026-11-02-a7f03c9e55a5 · 133 findings in all · rules version 4

Findings

Status: All · Open · Settled · Resolved

Severity: All · Medium · Low

State: All · Not yet reviewed · Under investigation · Explained · Confirmed error · Not a real disagreement

Showing findings that compare LRT. All models

2 findings match, most severe first.

LRT and MetaLR: Comprehensive assessment of computational algorithms in predicting cancer driver mutations reverses the order

  • Low severity
  • Not yet reviewed
  • Ordering reversal
  • unknown

Comprehensive assessment of computational algorithms in predicting cancer driver mutations ranks LRT above MetaLR in 15 of 17 comparisons; 2 of 2 other studies rank MetaLR above LRT.

2 papers rank MetaLR above LRT in 12 of their 13 comparisons and LRT higher in 1. Comprehensive assessment… ranks LRT above MetaLR in 15 of its 20 comparisons and MetaLR higher in 2; 3 are ties.

Comparisons in which each paper scores MetaLR or LRT higher2 other papers: MetaLR higher in 12, LRT higher in 1, 0 ties. Comprehensive assessment… (disagrees): MetaLR higher in 2, LRT higher in 15, 3 ties.2 other papers12 MetaLR higher121 LRT higherDisagrees: Comprehensive assessment…Comprehensive assessment of computational algorithms in predicting cancer driver mutations2 MetaLR higher23 tie315 LRT higher15
MetaLR higherTieLRT higher
Compared
LRT, MetaLR

Not reviewed yet.

LRT and MetaSVM: Comprehensive assessment of computational algorithms in predicting cancer driver mutations reverses the order

  • Low severity
  • Not yet reviewed
  • Ordering reversal
  • unknown

Comprehensive assessment of computational algorithms in predicting cancer driver mutations ranks LRT above MetaSVM in 16 of 20 comparisons; 2 of 2 other studies rank MetaSVM above LRT.

2 papers rank MetaSVM above LRT in 12 of their 13 comparisons and LRT higher in 1. Comprehensive assessment… ranks LRT above MetaSVM in 16 of its 20 comparisons and MetaSVM higher in 4.

Comparisons in which each paper scores MetaSVM or LRT higher2 other papers: MetaSVM higher in 12, LRT higher in 1, 0 ties. Comprehensive assessment… (disagrees): MetaSVM higher in 4, LRT higher in 16, 0 ties.2 other papers12 MetaSVM higher121 LRT higherDisagrees: Comprehensive assessment…Comprehensive assessment of computational algorithms in predicting cancer driver mutations4 MetaSVM higher416 LRT higher16
MetaSVM higherTieLRT higher
Compared
LRT, MetaSVM

Not reviewed yet.