ChromBPNet and Borzoi: GUANinE v1.1 reveals complementarity of supervised and genomic language models and Comparative Analysis of Deep Learning Models for Predicting Causative Regulatory Variants disagree
- Low severity
- Not yet reviewed
- Two-study conflict
- unknown
GUANinE v1.1 reveals complementarity of supervised and genomic language models ranks Borzoi above ChromBPNet in 5 of 5 comparisons; Comparative Analysis of Deep Learning Models for Predicting Causative Regulatory Variants ranks ChromBPNet above Borzoi in 4 of 4 comparisons. No other study gives a verdict, so neither is the outlier.
An automatic lead, not a finding of error. The results below are shown as published, everywhere on the site, until a reviewer decides otherwise.
Which studies agree
3 papers rank ChromBPNet above Borzoi in 7 of their 21 comparisons and Borzoi higher in 12; 2 are ties. Of those papers, AlphaGenome Nature 2026, GUANinE v1.1 reveals complementarity… rank Borzoi higher on their own (7 of 10, 5 of 7).
- Rank ChromBPNet higher (1): Comparative Analysis of Deep Learning…
- Rank Borzoi higher (2): AlphaGenome Nature 2026, GUANinE v1.1 reveals complementarity…
- Mixed (0): none
Each paper sits where at least two thirds of its comparisons point; Mixed means neither model reaches two thirds. The larger, outlined dot is the paper that disagrees.
| Paper | Role | Ranks ChromBPNet higher | Ranks Borzoi higher | Ties |
|---|---|---|---|---|
| AlphaGenome Nature 2026 supplementary comparison tables · DOI | Agrees | 3 | 7 | 0 |
| GUANinE v1.1 reveals complementarity of supervised and genomic language models · DOI | Agrees | 0 | 5 | 2 |
| Comparative Analysis of Deep Learning Models for Predicting Causative Regulatory Variants · DOI | Agrees | 4 | 0 | 0 |
Comparisons in AlphaGenome Nature 2026 (10)
Comparisons in GUANinE v1.1 reveals complementarity… (7)
| Protocol | Dataset | Metric | ChromBPNet | Borzoi | Higher |
|---|---|---|---|---|---|
| GUANinE v1.1 cadd-snv, Spearman rho x100 (Table 3) | GUANinE cadd-snv test set | Spearman (GUANinE v1.1 test set), unitless | 17.3 | 21 | Borzoi |
| GUANinE v1.1 ccre-propensity, Spearman rho x100 (Table 2) | GUANinE ccre-propensity test set | Spearman (GUANinE v1.1 test set), unitless | 40.4 | 57.7 | Borzoi |
| GUANinE v1.1 cons100, Spearman rho x100 (Table 2) | GUANinE cons100 test set | Spearman (GUANinE v1.1 test set), unitless | 41.5 | 59.7 | Borzoi |
| GUANinE v1.1 cons30, Spearman rho x100 (Table 2) | GUANinE cons30 test set | Spearman (GUANinE v1.1 test set), unitless | 47.8 | 71.5 | Borzoi |
| GUANinE v1.1 dnase-propensity, Spearman rho x100 (Table 2) | GUANinE dnase-propensity test set | Spearman (GUANinE v1.1 test set), unitless | 41.5 | 70.7 | Borzoi |
| GUANinE v1.1 gpra-c, Spearman rho x100 (Table 2) | GUANinE gpra-c test set | Spearman (GUANinE v1.1 test set), unitless | 71.1 | 71.5 | Tie |
| GUANinE v1.1 gpra-d, Spearman rho x100 (Table 2) | GUANinE gpra-d test set | Spearman (GUANinE v1.1 test set), unitless | 74.9 | 75.2 | Tie |
Comparisons in Comparative Analysis of Deep Learning… (4)
| Protocol | Dataset | Metric | ChromBPNet | Borzoi | Higher |
|---|---|---|---|---|---|
| Allelic reporter effect correlation in HeLa (Manzo et al. 2025 Table 1) | HeLa regulatory variant reporter data (Manzo et al. 2025) | Pearson (predicted versus measured log2 fold-change of variant effect), unitless | 0.289 | -0.066 | ChromBPNet |
| Allelic reporter effect correlation in HepG2 (Manzo et al. 2025 Table 1) | HepG2 regulatory variant reporter data (Manzo et al. 2025) | Pearson (predicted versus measured log2 fold-change of variant effect), unitless | 0.295 | 0.125 | ChromBPNet |
| Allelic reporter effect correlation in K562 (Manzo et al. 2025 Table 1) | K562 regulatory variant reporter data (Manzo et al. 2025) | Pearson (predicted versus measured log2 fold-change of variant effect), unitless | 0.287 | 0.033 | ChromBPNet |
| Allelic reporter effect correlation in NPC (Manzo et al. 2025 Table 1) | NPC regulatory variant reporter data (Manzo et al. 2025) | Pearson (predicted versus measured log2 fold-change of variant effect), unitless | 0.08 | 0.023 | ChromBPNet |
What disagrees
- studies
- 2
- Compared
- ChromBPNet, Borzoi
- Study that disagrees
- Other studies
- Rule
- Two-study conflict; unknown
- Model identity
- Matched across studies partly through links not yet reviewed
Follow-up
Current state: Not yet reviewed.
No one has reviewed this finding yet.
How to help resolve this
If you know why these studies disagree, for example a different population, metric or preprocessing step, or you have a corrected value, tell us through the contribution form. A reviewer checks every submission against its source before anything changes, and the step is added to the follow-up above.
Finding discrepancy-ee4e9764074d9a0b · All contested results · How findings are made and followed up