Evidence and investigation

Contested results

Where one study disagrees with what other studies report for the same models, and what we are doing to resolve each case.

These are automatic leads, not findings of error. Each release, a check compares how every study ranks the models it shares with other studies. It flags a study that reverses the order the others agree on, or whose gap to a shared reference model lies well outside theirs. Different tasks, populations or metrics often explain a flag.

A flag never hides a result. Flagged results stay in every table, page and download, marked Contested. A result is withheld only when a reviewer marks it disputed.

How the check works, and how each follow-up is recorded: discrepancies between studies.

In this release

220open
0settled
1resolved
1high severity
12medium severity
208low severity

Release 2026-10-23-5347695500ed · 221 findings in all · rules version 3

Findings

Status: All · Open · Settled · Resolved

Severity: All · High · Medium · Low

State: All · Not yet reviewed · Confirmed error

Showing findings that compare HyenaDNA. All models

1 finding matches, most severe first.

DNABERT-2 and HyenaDNA: Comparative Analysis of Deep Learning Models for Predicting Causative Regulatory Variants reverses the order

Low severity
Not yet reviewed
Ordering reversal
Different tasks across studies

Comparative Analysis of Deep Learning Models for Predicting Causative Regulatory Variants ranks HyenaDNA above DNABERT-2 in 3 of 4 comparisons; other studies rank DNABERT-2 above HyenaDNA in 89 of 108.

3 papers rank DNABERT-2 above HyenaDNA in 89 of their 115 comparisons and HyenaDNA higher in 19; 7 are ties. Comparative Analysis of Deep Learning… ranks HyenaDNA above DNABERT-2 in 3 of its 4 comparisons and DNABERT-2 higher in 1.

DNABERT-2 higherTieHyenaDNA higher

Compared: DNABERT-2, HyenaDNA

Not reviewed yet.