Boltz-2 and AlphaFold 3: Shen et al. 2025, Chemical Science (Europe PMC full text) and Kim, Correy, Hall et al. 2026, eLife 15:RP110475 (Europe PMC full text) disagree
- Low severity
- Not yet reviewed
- Two-study conflict
- Same task, different protocols
Shen et al. 2025, Chemical Science (Europe PMC full text) ranks AlphaFold 3 above Boltz-2 in 9 of 9 comparisons; Kim, Correy, Hall et al. 2026, eLife 15:RP110475 (Europe PMC full text) ranks Boltz-2 above AlphaFold 3 in 2 of 2 comparisons. No other study gives a verdict, so neither is the outlier.
An automatic lead, not a finding of error. The results below are shown as published, everywhere on the site, until a reviewer decides otherwise.
Which studies agree
3 papers rank Boltz-2 above AlphaFold 3 in 4 of their 19 comparisons and AlphaFold 3 higher in 14; 1 is a tie. Of those papers, Shen et al. 2025, Structural Plausibility Without Binding… rank AlphaFold 3 higher on their own (9 of 10, 5 of 7).
- Rank Boltz-2 higher (1): Kim, Correy, Hall et al. 2026
- Rank AlphaFold 3 higher (2): Shen et al. 2025, Structural Plausibility Without Binding…
- Mixed (0): none
Each paper sits where at least two thirds of its comparisons point; Mixed means neither model reaches two thirds. The larger, outlined dot is the paper that disagrees.
| Paper | Role | Ranks Boltz-2 higher | Ranks AlphaFold 3 higher | Ties |
|---|---|---|---|---|
| Shen et al. 2025, Chemical Science (Europe PMC full text) · DOI | Agrees | 0 | 9 | 1 |
| Structural Plausibility Without Binding Specificity: Limits of AI-Based Antibody-Antigen Structure Prediction Confidence Scores · DOI | Agrees | 2 | 5 | 0 |
| Kim, Correy, Hall et al. 2026, eLife 15:RP110475 (Europe PMC full text) · DOI | Agrees | 2 | 0 | 0 |
Comparisons in Shen et al. 2025 (10)
Comparisons in Structural Plausibility Without Binding… (7)
Comparisons in Kim, Correy, Hall et al. 2026 (2)
| Protocol | Dataset | Metric | Boltz-2 | AlphaFold 3 | Higher |
|---|---|---|---|---|---|
| Re-ranking the AmpC beta-lactamase docking hit list by co-folding and docking scores (Kim, Correy, Hall et al. 2026) | AmpC beta-lactamase docking hit list, 1293 tested compounds | AUROC (Discrimination of measured binders from high-ranking docking false positives in the tested AmpC beta-lactamase hit list), unitless | 68.1 | 60.5 | Boltz-2 |
| Re-ranking the Sigma-2 receptor docking hit list by co-folding and docking scores (Kim, Correy, Hall et al. 2026) | Sigma-2 receptor docking hit list, 506 tested compounds | AUROC (Discrimination of measured binders from high-ranking docking false positives in the tested sigma-2 receptor hit list), unitless | 83.8 | 56.1 | Boltz-2 |
What disagrees
- studies
- 2
- Compared
- Boltz-2, AlphaFold 3
- Study that disagrees
- Other studies
- Rule
- Two-study conflict; same task, different protocols
- Model identity
- Matched across studies partly through links not yet reviewed
Follow-up
Current state: Not yet reviewed.
No one has reviewed this finding yet.
How to help resolve this
If you know why these studies disagree, for example a different population, metric or preprocessing step, or you have a corrected value, tell us through the contribution form. A reviewer checks every submission against its source before anything changes, and the step is added to the follow-up above.
Finding discrepancy-965ec4c8efac9e07 · All contested results · How findings are made and followed up