rewirebio.iobenchmarks
Evidence and investigation

Contested results

Where one study disagrees with what other studies report for the same models, and what we are doing to resolve each case.

These are automatic leads, not findings of error. Each release, a check compares how every study ranks the models it shares with other studies. It flags a study that reverses the order the others agree on, or whose gap to a shared reference model lies well outside theirs. Different tasks, populations or metrics often explain a flag.

A flag never hides a result. Flagged results stay in every table, page and download, marked Contested. A result is withheld only when a reviewer marks it disputed.

How the check works, and how each follow-up is recorded: discrepancies between studies.

In this release

  • 220open
  • 0settled
  • 1resolved
  • 1high severity
  • 12medium severity
  • 208low severity

Release 2026-10-23-5347695500ed · 221 findings in all · rules version 3

Findings

Status: All · Open · Settled · Resolved

Severity: All · High · Medium · Low

State: All · Not yet reviewed · Confirmed error

Showing findings that compare Enformer. All models

1 finding matches, most severe first.

ChromBPNet and Enformer: Comparative Analysis of Deep Learning Models for Predicting Causative Regulatory Variants reverses the order

  • Low severity
  • Not yet reviewed
  • Ordering reversal
  • Different tasks across studies

Comparative Analysis of Deep Learning Models for Predicting Causative Regulatory Variants ranks ChromBPNet above Enformer in 4 of 4 comparisons; other studies rank Enformer above ChromBPNet in 4 of 5.

GUANinE v1.1 reveals complementarity… ranks Enformer above ChromBPNet in 4 of its 7 comparisons and ChromBPNet higher in 1; 2 are ties. Comparative Analysis of Deep Learning… ranks ChromBPNet above Enformer in all 4 of its comparisons.

Comparisons in which each paper scores Enformer or ChromBPNet higherGUANinE v1.1 reveals complementarity…: Enformer higher in 4, ChromBPNet higher in 1, 2 ties. Comparative Analysis of Deep Learning… (disagrees): Enformer higher in 0, ChromBPNet higher in 4, 0 ties.GUANinE v1.1 reveals complementarity…4 Enformer higher42 tie21 ChromBPNet higher1Disagrees: Comparative Analysis of Deep Learning…Comparative Analysis of Deep Learning Models for Predicting Causative Regulatory Variants4 ChromBPNet higher4
Enformer higherTieChromBPNet higher
Compared
ChromBPNet, Enformer

Not reviewed yet.