rewirebio.iobenchmarks

Use caseMolecular interactionsResearch only

Find hits for a target by virtual screening

Which computational screening workflow puts real binders at the top of a large compound library, and how many compounds must be tested to find one?

What the evidence shows

Three sources in this store score machine-learning and co-folding methods against docking on the same screening data, and what the numbers say depends on how the negatives were built.

On DEKOIS 2.0, whose 79 targets each pair 40 validated actives with 1,200 property-matched decoys selected from ZINC (1:30), the co-folding confidence scores enrich strongly and beat the docking arms. AF3 min-iPAE gives a mean EF1% of 23.15 and Boltz-2 min-iPAE 22.73, against 12.01 for the Glide SP row quoted from another paper, 5.16 for Gnina Vina and 2.94 for TankBind; the best rescoring of a co-folded pose, RTMScore on AF3 poses, reaches 21.34. The authors flag their own Boltz-2 affinity arms (mean EF1% 23.54 and 25.84) as likely over-estimates because Boltz-2 drew affinity data from the same public databases that source DEKOIS 2.0.

On GPCRrecent, 16 targets whose first crystal structures were released after 2022 with decoys generated by a conditional recurrent neural network at 1:50, every value falls and the margin narrows: Boltz-2 min-iPAE gives a mean EF1% of 13.96 against 5.02 for Glide SP and 3.65 for Gnina Vina. On the five LIT-PCBA targets where the inactives were experimentally measured, the margin largely disappears: averaged over the five targets Boltz-2 min-iPAE gives EF1% 9.30 and NEF1% 0.100 against Glide SP's 6.79 and 0.079, and on TP53 both Boltz-2 scores give EF1% 0.00 while Protenix ipTM gives 5.00 and Glide SP 3.75. A separate audit of LIT-PCBA reports 323 active training-validation analogue pairs at ECFP4 Tanimoto at or above 0.6 in ALDH1 alone and 2,491 2D-identical inactives shared between training and validation across targets, and concludes that a parameter-free memorisation baseline matches or exceeds published deep-learning results there, so every LIT-PCBA value above carries that limit.

Where the negatives are compounds a docking screen already ranked highly and every compound was synthesised and assayed, the ordering changes. On the AmpC list (247 inhibitors among 1,293 tested compounds from a 1.7-billion molecule screen) DOCK3.7 separates binders best, AUC 76.5, against 68.1 for Boltz-2 pIC50 and 60.5 for AF3 L-pLDDT. On the dopamine D4 list (205 binders among 541) docking and Boltz-2 are indistinguishable at the precision printed (both about 71) and AF3 L-pLDDT is worse than random at 46.4.

Only on the sigma-2 list (201 binders among 506) does a co-folding score lead, Boltz-2 pIC50 at 83.8 against DOCK3.7's 78.8, with AF3 L-pLDDT at 56.1. In the one blinded prospective challenge, CACHE #3 on the SARS-CoV-2 Nsp3 macrodomain, 23 workflows selected 1,739 compounds that were synthesised and assayed; 28 advanced to hit expansion and 29 confirmed hits scored above 15, four of them judged chemically novel. Twelve of the 23 workflows returned no confirmed hit from their own selection of 41 to 99 compounds.

When every workflow was applied to the same merged 1,739-compound library, WF1696, which the article describes as a purely physics-based method, captured 2 of the 4 Tier 1 and 9 of the 25 Tier 2 confirmed hits from 99 predicted actives, which the authors report as did better than any other method in retrieving hits from the collection of all molecules selected in Round 1. Cost bounds all of this: co-folding one protein-ligand pair takes 7.79 to 34.58 seconds per compound on one NVIDIA H100 with pre-computed MSAs, which is why the LIT-PCBA arm covers five targets rather than fifteen. No docking tool was timed on the same hardware, no ligand-similarity or pharmacophore baseline is scored anywhere in this batch, and no result here estimates the hit rate of an untested library.

You bring
  • One protein target, with a sequence and, for docking and rescoring methods, a prepared receptor structure
  • A compound library to rank, with the actives-to-inactives ratio and how any negatives were constructed
  • A compute budget, since cost per compound decides whether a method can run on the library at all
  • A synthesis and assay budget, which sets how many top-ranked compounds can be tested
You want
Enrichment of true actives at a stated fraction of the library for each method on each protocol, with the decoy construction and actives-to-inactives ratio of that protocol; measured counts of confirmed hits and compounds tested where a paper synthesised and assayed compounds; and compute per compound. No recommendation of a method and no prediction of a hit rate for an untested library.
Evidence in this release
4 comparisons shown · 1 held for review · 42 tools · 77 configurations
Kept up to date
Evidence last checked 22 October 2026 · re-checked monthly, next due 22 November 2026

Tools compared

Comparisons

Each table is one study or protocol with its own truth set and scoring. Compare tools within a table, not across tables.

Blinded prospective community challenge on the Nsp3 macrodomain

Direct evidenceAuthor-reported

Count (higher is better), with the other metrics below each value. Showing the top 10 of 23 rows. The best value in each column is highlighted.

Scroll sideways to see all 2 columns.

ToolRound 1: each workflow's own selection, synthesised and assayedRound 1: every workflow applied to the same merged 1,739-compound library
WF1695conventional99 (best in column)Compounds the workflow selected that were synthesised and experimentally testedCount (Experimentally confirmed hits) 0Count (Confirmed hits the Hit Evaluation Committee judged chemically novel,) 0Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit) 0Cache challenge activity score (Sum of the activity scores of all the workflow's confirmed Round 1 hits) 0
2 more valuesCache challenge novelty score 0Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit that was judged chemically novel) 0
Not reported
WF1707conventional97Compounds the workflow selected that were synthesised and experimentally testedCount (Experimentally confirmed hits) 0Count (Confirmed hits the Hit Evaluation Committee judged chemically novel,) 0Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit) 0Cache challenge activity score (Sum of the activity scores of all the workflow's confirmed Round 1 hits) 0
2 more valuesCache challenge novelty score 0Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit that was judged chemically novel) 0
516Compounds of the merged 1739-compound Round 1 library the workflow predicted to be activeCount (Compounds of the merged 1739-compound Round 1 library the workflow predicted to be weakly active) 0Count (Confirmed Tier 1 (chemically novel) hits among the workflow's predicted-active compounds on the merged library) 0Count (Confirmed Tier 2 (not novel) hits among the workflow's predicted-active compounds on the merged library) 12Count (Confirmed Tier 1 (chemically novel) hits among the workflow's predicted-weak compounds on the merged library) 0
4 more valuesCount (Confirmed Tier 2 (not novel) hits among the workflow's predicted-weak compounds on the merged library) 0Cache challenge normalized hit score (1 (chemically novel) hits among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula 1000*N/L, that is 1000 times the Tier 1 count in column N divided by the predicted-active count in column L.) 0Cache challenge normalized hit score (2 (not novel) hits among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula 1000*O/L, that is 1000 times the Tier 2 count in column O divided by the predicted-active count in column L.) 23.3Cache challenge normalized hit score (1 and Tier 2 hits combined among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula R+S, the sum of the two preceding columns.) 23.3
WF1708conventional96Compounds the workflow selected that were synthesised and experimentally testedCount (Experimentally confirmed hits) 2Count (Confirmed hits the Hit Evaluation Committee judged chemically novel,) 0Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit) 21.9Cache challenge activity score (Sum of the activity scores of all the workflow's confirmed Round 1 hits) 38.7
2 more valuesCache challenge novelty score 1Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit that was judged chemically novel) 0
295Compounds of the merged 1739-compound Round 1 library the workflow predicted to be activeCount (Compounds of the merged 1739-compound Round 1 library the workflow predicted to be weakly active) 0Count (Confirmed Tier 1 (chemically novel) hits among the workflow's predicted-active compounds on the merged library) 1Count (Confirmed Tier 2 (not novel) hits among the workflow's predicted-active compounds on the merged library) 11Count (Confirmed Tier 1 (chemically novel) hits among the workflow's predicted-weak compounds on the merged library) 0
4 more valuesCount (Confirmed Tier 2 (not novel) hits among the workflow's predicted-weak compounds on the merged library) 0Cache challenge normalized hit score (1 (chemically novel) hits among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula 1000*N/L, that is 1000 times the Tier 1 count in column N divided by the predicted-active count in column L.) 3.39Cache challenge normalized hit score (2 (not novel) hits among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula 1000*O/L, that is 1000 times the Tier 2 count in column O divided by the predicted-active count in column L.) 37.3Cache challenge normalized hit score (1 and Tier 2 hits combined among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula R+S, the sum of the two preceding columns.) 40.7
WF1715conventional92Compounds the workflow selected that were synthesised and experimentally testedCount (Experimentally confirmed hits) 11Count (Confirmed hits the Hit Evaluation Committee judged chemically novel,) 0Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit) 23.8Cache challenge activity score (Sum of the activity scores of all the workflow's confirmed Round 1 hits) 220.6
2 more valuesCache challenge novelty score 1Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit that was judged chemically novel) 0
284Compounds of the merged 1739-compound Round 1 library the workflow predicted to be activeCount (Compounds of the merged 1739-compound Round 1 library the workflow predicted to be weakly active) 0Count (Confirmed Tier 1 (chemically novel) hits among the workflow's predicted-active compounds on the merged library) 0Count (Confirmed Tier 2 (not novel) hits among the workflow's predicted-active compounds on the merged library) 9Count (Confirmed Tier 1 (chemically novel) hits among the workflow's predicted-weak compounds on the merged library) 0
4 more valuesCount (Confirmed Tier 2 (not novel) hits among the workflow's predicted-weak compounds on the merged library) 0Cache challenge normalized hit score (1 (chemically novel) hits among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula 1000*N/L, that is 1000 times the Tier 1 count in column N divided by the predicted-active count in column L.) 0Cache challenge normalized hit score (2 (not novel) hits among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula 1000*O/L, that is 1000 times the Tier 2 count in column O divided by the predicted-active count in column L.) 31.7Cache challenge normalized hit score (1 and Tier 2 hits combined among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula R+S, the sum of the two preceding columns.) 31.7
WF1702conventional91Compounds the workflow selected that were synthesised and experimentally testedCount (Experimentally confirmed hits) 0Count (Confirmed hits the Hit Evaluation Committee judged chemically novel,) 0Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit) 0Cache challenge activity score (Sum of the activity scores of all the workflow's confirmed Round 1 hits) 0
2 more valuesCache challenge novelty score 0Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit that was judged chemically novel) 0
207Compounds of the merged 1739-compound Round 1 library the workflow predicted to be activeCount (Compounds of the merged 1739-compound Round 1 library the workflow predicted to be weakly active) 0Count (Confirmed Tier 1 (chemically novel) hits among the workflow's predicted-active compounds on the merged library) 0Count (Confirmed Tier 2 (not novel) hits among the workflow's predicted-active compounds on the merged library) 5Count (Confirmed Tier 1 (chemically novel) hits among the workflow's predicted-weak compounds on the merged library) 0
4 more valuesCount (Confirmed Tier 2 (not novel) hits among the workflow's predicted-weak compounds on the merged library) 0Cache challenge normalized hit score (1 (chemically novel) hits among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula 1000*N/L, that is 1000 times the Tier 1 count in column N divided by the predicted-active count in column L.) 0Cache challenge normalized hit score (2 (not novel) hits among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula 1000*O/L, that is 1000 times the Tier 2 count in column O divided by the predicted-active count in column L.) 24.2Cache challenge normalized hit score (1 and Tier 2 hits combined among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula R+S, the sum of the two preceding columns.) 24.2
WF1689conventional89Compounds the workflow selected that were synthesised and experimentally testedCount (Experimentally confirmed hits) 0Count (Confirmed hits the Hit Evaluation Committee judged chemically novel,) 0Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit) 0Cache challenge activity score (Sum of the activity scores of all the workflow's confirmed Round 1 hits) 0
2 more valuesCache challenge novelty score 0Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit that was judged chemically novel) 0
516Compounds of the merged 1739-compound Round 1 library the workflow predicted to be activeCount (Compounds of the merged 1739-compound Round 1 library the workflow predicted to be weakly active) 0Count (Confirmed Tier 1 (chemically novel) hits among the workflow's predicted-active compounds on the merged library) 0Count (Confirmed Tier 2 (not novel) hits among the workflow's predicted-active compounds on the merged library) 0Count (Confirmed Tier 1 (chemically novel) hits among the workflow's predicted-weak compounds on the merged library) 0
4 more valuesCount (Confirmed Tier 2 (not novel) hits among the workflow's predicted-weak compounds on the merged library) 0Cache challenge normalized hit score (1 (chemically novel) hits among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula 1000*N/L, that is 1000 times the Tier 1 count in column N divided by the predicted-active count in column L.) 0Cache challenge normalized hit score (2 (not novel) hits among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula 1000*O/L, that is 1000 times the Tier 2 count in column O divided by the predicted-active count in column L.) 0Cache challenge normalized hit score (1 and Tier 2 hits combined among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula R+S, the sum of the two preceding columns.) 0
WF1704conventional89Compounds the workflow selected that were synthesised and experimentally testedCount (Experimentally confirmed hits) 0Count (Confirmed hits the Hit Evaluation Committee judged chemically novel,) 0Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit) 0Cache challenge activity score (Sum of the activity scores of all the workflow's confirmed Round 1 hits) 0
2 more valuesCache challenge novelty score 0Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit that was judged chemically novel) 0
100Compounds of the merged 1739-compound Round 1 library the workflow predicted to be activeCount (Compounds of the merged 1739-compound Round 1 library the workflow predicted to be weakly active) 0Count (Confirmed Tier 1 (chemically novel) hits among the workflow's predicted-active compounds on the merged library) 0Count (Confirmed Tier 2 (not novel) hits among the workflow's predicted-active compounds on the merged library) 5Count (Confirmed Tier 1 (chemically novel) hits among the workflow's predicted-weak compounds on the merged library) 0
4 more valuesCount (Confirmed Tier 2 (not novel) hits among the workflow's predicted-weak compounds on the merged library) 0Cache challenge normalized hit score (1 (chemically novel) hits among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula 1000*N/L, that is 1000 times the Tier 1 count in column N divided by the predicted-active count in column L.) 0Cache challenge normalized hit score (2 (not novel) hits among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula 1000*O/L, that is 1000 times the Tier 2 count in column O divided by the predicted-active count in column L.) 50Cache challenge normalized hit score (1 and Tier 2 hits combined among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula R+S, the sum of the two preceding columns.) 50
WF1718conventional86Compounds the workflow selected that were synthesised and experimentally testedCount (Experimentally confirmed hits) 2Count (Confirmed hits the Hit Evaluation Committee judged chemically novel,) 0Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit) 23.1Cache challenge activity score (Sum of the activity scores of all the workflow's confirmed Round 1 hits) 46.3
2 more valuesCache challenge novelty score 1Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit that was judged chemically novel) 0
191Compounds of the merged 1739-compound Round 1 library the workflow predicted to be activeCount (Compounds of the merged 1739-compound Round 1 library the workflow predicted to be weakly active) 0Count (Confirmed Tier 1 (chemically novel) hits among the workflow's predicted-active compounds on the merged library) 0Count (Confirmed Tier 2 (not novel) hits among the workflow's predicted-active compounds on the merged library) 7Count (Confirmed Tier 1 (chemically novel) hits among the workflow's predicted-weak compounds on the merged library) 0
4 more valuesCount (Confirmed Tier 2 (not novel) hits among the workflow's predicted-weak compounds on the merged library) 0Cache challenge normalized hit score (1 (chemically novel) hits among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula 1000*N/L, that is 1000 times the Tier 1 count in column N divided by the predicted-active count in column L.) 0Cache challenge normalized hit score (2 (not novel) hits among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula 1000*O/L, that is 1000 times the Tier 2 count in column O divided by the predicted-active count in column L.) 36.6Cache challenge normalized hit score (1 and Tier 2 hits combined among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula R+S, the sum of the two preceding columns.) 36.6
WF1694conventional83Compounds the workflow selected that were synthesised and experimentally testedCount (Experimentally confirmed hits) 0Count (Confirmed hits the Hit Evaluation Committee judged chemically novel,) 0Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit) 0Cache challenge activity score (Sum of the activity scores of all the workflow's confirmed Round 1 hits) 0
2 more valuesCache challenge novelty score 0Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit that was judged chemically novel) 0
Not reported
WF1706conventional83Compounds the workflow selected that were synthesised and experimentally testedCount (Experimentally confirmed hits) 1Count (Confirmed hits the Hit Evaluation Committee judged chemically novel,) 1Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit) 21.5Cache challenge activity score (Sum of the activity scores of all the workflow's confirmed Round 1 hits) 21.5
2 more valuesCache challenge novelty score 2Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit that was judged chemically novel) 21.5
284Compounds of the merged 1739-compound Round 1 library the workflow predicted to be activeCount (Compounds of the merged 1739-compound Round 1 library the workflow predicted to be weakly active) 0Count (Confirmed Tier 1 (chemically novel) hits among the workflow's predicted-active compounds on the merged library) 3Count (Confirmed Tier 2 (not novel) hits among the workflow's predicted-active compounds on the merged library) 21Count (Confirmed Tier 1 (chemically novel) hits among the workflow's predicted-weak compounds on the merged library) 0
4 more valuesCount (Confirmed Tier 2 (not novel) hits among the workflow's predicted-weak compounds on the merged library) 0Cache challenge normalized hit score (1 (chemically novel) hits among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula 1000*N/L, that is 1000 times the Tier 1 count in column N divided by the predicted-active count in column L.) 10.6Cache challenge normalized hit score (2 (not novel) hits among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula 1000*O/L, that is 1000 times the Tier 2 count in column O divided by the predicted-active count in column L.) 73.9Cache challenge normalized hit score (1 and Tier 2 hits combined among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula R+S, the sum of the two preceding columns.) 84.5
WF1690conventional82Compounds the workflow selected that were synthesised and experimentally testedCount (Experimentally confirmed hits) 6Count (Confirmed hits the Hit Evaluation Committee judged chemically novel,) 0Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit) 23Cache challenge activity score (Sum of the activity scores of all the workflow's confirmed Round 1 hits) 126
2 more valuesCache challenge novelty score 1Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit that was judged chemically novel) 0
161Compounds of the merged 1739-compound Round 1 library the workflow predicted to be activeCount (Compounds of the merged 1739-compound Round 1 library the workflow predicted to be weakly active) 0Count (Confirmed Tier 1 (chemically novel) hits among the workflow's predicted-active compounds on the merged library) 0Count (Confirmed Tier 2 (not novel) hits among the workflow's predicted-active compounds on the merged library) 6Count (Confirmed Tier 1 (chemically novel) hits among the workflow's predicted-weak compounds on the merged library) 0
4 more valuesCount (Confirmed Tier 2 (not novel) hits among the workflow's predicted-weak compounds on the merged library) 0Cache challenge normalized hit score (1 (chemically novel) hits among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula 1000*N/L, that is 1000 times the Tier 1 count in column N divided by the predicted-active count in column L.) 0Cache challenge normalized hit score (2 (not novel) hits among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula 1000*O/L, that is 1000 times the Tier 2 count in column O divided by the predicted-active count in column L.) 37.3Cache challenge normalized hit score (1 and Tier 2 hits combined among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula R+S, the sum of the two preceding columns.) 37.3
WF1717conventional82Compounds the workflow selected that were synthesised and experimentally testedCount (Experimentally confirmed hits) 0Count (Confirmed hits the Hit Evaluation Committee judged chemically novel,) 0Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit) 0Cache challenge activity score (Sum of the activity scores of all the workflow's confirmed Round 1 hits) 0
2 more valuesCache challenge novelty score 0Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit that was judged chemically novel) 0
Not reported
WF1700conventional73Compounds the workflow selected that were synthesised and experimentally testedCount (Experimentally confirmed hits) 1Count (Confirmed hits the Hit Evaluation Committee judged chemically novel,) 1Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit) 21.3Cache challenge activity score (Sum of the activity scores of all the workflow's confirmed Round 1 hits) 21.3
2 more valuesCache challenge novelty score 3Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit that was judged chemically novel) 21.3
595 (best in column)Compounds of the merged 1739-compound Round 1 library the workflow predicted to be activeCount (Compounds of the merged 1739-compound Round 1 library the workflow predicted to be weakly active) 0Count (Confirmed Tier 1 (chemically novel) hits among the workflow's predicted-active compounds on the merged library) 4Count (Confirmed Tier 2 (not novel) hits among the workflow's predicted-active compounds on the merged library) 16Count (Confirmed Tier 1 (chemically novel) hits among the workflow's predicted-weak compounds on the merged library) 0
4 more valuesCount (Confirmed Tier 2 (not novel) hits among the workflow's predicted-weak compounds on the merged library) 0Cache challenge normalized hit score (1 (chemically novel) hits among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula 1000*N/L, that is 1000 times the Tier 1 count in column N divided by the predicted-active count in column L.) 6.72Cache challenge normalized hit score (2 (not novel) hits among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula 1000*O/L, that is 1000 times the Tier 2 count in column O divided by the predicted-active count in column L.) 26.9Cache challenge normalized hit score (1 and Tier 2 hits combined among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula R+S, the sum of the two preceding columns.) 33.6
WF1712conventional73Compounds the workflow selected that were synthesised and experimentally testedCount (Experimentally confirmed hits) 0Count (Confirmed hits the Hit Evaluation Committee judged chemically novel,) 0Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit) 0Cache challenge activity score (Sum of the activity scores of all the workflow's confirmed Round 1 hits) 0
2 more valuesCache challenge novelty score 0Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit that was judged chemically novel) 0
121Compounds of the merged 1739-compound Round 1 library the workflow predicted to be activeCount (Compounds of the merged 1739-compound Round 1 library the workflow predicted to be weakly active) 0Count (Confirmed Tier 1 (chemically novel) hits among the workflow's predicted-active compounds on the merged library) 0Count (Confirmed Tier 2 (not novel) hits among the workflow's predicted-active compounds on the merged library) 5Count (Confirmed Tier 1 (chemically novel) hits among the workflow's predicted-weak compounds on the merged library) 0
4 more valuesCount (Confirmed Tier 2 (not novel) hits among the workflow's predicted-weak compounds on the merged library) 0Cache challenge normalized hit score (1 (chemically novel) hits among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula 1000*N/L, that is 1000 times the Tier 1 count in column N divided by the predicted-active count in column L.) 0Cache challenge normalized hit score (2 (not novel) hits among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula 1000*O/L, that is 1000 times the Tier 2 count in column O divided by the predicted-active count in column L.) 41.3Cache challenge normalized hit score (1 and Tier 2 hits combined among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula R+S, the sum of the two preceding columns.) 41.3
WF1691conventional71Compounds the workflow selected that were synthesised and experimentally testedCount (Experimentally confirmed hits) 0Count (Confirmed hits the Hit Evaluation Committee judged chemically novel,) 0Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit) 0Cache challenge activity score (Sum of the activity scores of all the workflow's confirmed Round 1 hits) 0
2 more valuesCache challenge novelty score 0Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit that was judged chemically novel) 0
141Compounds of the merged 1739-compound Round 1 library the workflow predicted to be activeCount (Compounds of the merged 1739-compound Round 1 library the workflow predicted to be weakly active) 57Count (Confirmed Tier 1 (chemically novel) hits among the workflow's predicted-active compounds on the merged library) 0Count (Confirmed Tier 2 (not novel) hits among the workflow's predicted-active compounds on the merged library) 6Count (Confirmed Tier 1 (chemically novel) hits among the workflow's predicted-weak compounds on the merged library) 0
4 more valuesCount (Confirmed Tier 2 (not novel) hits among the workflow's predicted-weak compounds on the merged library) 0Cache challenge normalized hit score (1 (chemically novel) hits among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula 1000*N/L, that is 1000 times the Tier 1 count in column N divided by the predicted-active count in column L.) 0Cache challenge normalized hit score (2 (not novel) hits among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula 1000*O/L, that is 1000 times the Tier 2 count in column O divided by the predicted-active count in column L.) 42.6Cache challenge normalized hit score (1 and Tier 2 hits combined among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula R+S, the sum of the two preceding columns.) 42.6
WF1697conventional66Compounds the workflow selected that were synthesised and experimentally testedCount (Experimentally confirmed hits) 0Count (Confirmed hits the Hit Evaluation Committee judged chemically novel,) 0Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit) 0Cache challenge activity score (Sum of the activity scores of all the workflow's confirmed Round 1 hits) 0
2 more valuesCache challenge novelty score 0Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit that was judged chemically novel) 0
229Compounds of the merged 1739-compound Round 1 library the workflow predicted to be activeCount (Compounds of the merged 1739-compound Round 1 library the workflow predicted to be weakly active) 215Count (Confirmed Tier 1 (chemically novel) hits among the workflow's predicted-active compounds on the merged library) 0Count (Confirmed Tier 2 (not novel) hits among the workflow's predicted-active compounds on the merged library) 7Count (Confirmed Tier 1 (chemically novel) hits among the workflow's predicted-weak compounds on the merged library) 0
4 more valuesCount (Confirmed Tier 2 (not novel) hits among the workflow's predicted-weak compounds on the merged library) 7Cache challenge normalized hit score (1 (chemically novel) hits among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula 1000*N/L, that is 1000 times the Tier 1 count in column N divided by the predicted-active count in column L.) 0Cache challenge normalized hit score (2 (not novel) hits among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula 1000*O/L, that is 1000 times the Tier 2 count in column O divided by the predicted-active count in column L.) 30.6Cache challenge normalized hit score (1 and Tier 2 hits combined among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula R+S, the sum of the two preceding columns.) 30.6
WF1705conventional66Compounds the workflow selected that were synthesised and experimentally testedCount (Experimentally confirmed hits) 1Count (Confirmed hits the Hit Evaluation Committee judged chemically novel,) 1Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit) 19.4Cache challenge activity score (Sum of the activity scores of all the workflow's confirmed Round 1 hits) 19.4
2 more valuesCache challenge novelty score 2Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit that was judged chemically novel) 19.4
321Compounds of the merged 1739-compound Round 1 library the workflow predicted to be activeCount (Compounds of the merged 1739-compound Round 1 library the workflow predicted to be weakly active) 0Count (Confirmed Tier 1 (chemically novel) hits among the workflow's predicted-active compounds on the merged library) 1Count (Confirmed Tier 2 (not novel) hits among the workflow's predicted-active compounds on the merged library) 11Count (Confirmed Tier 1 (chemically novel) hits among the workflow's predicted-weak compounds on the merged library) 0
4 more valuesCount (Confirmed Tier 2 (not novel) hits among the workflow's predicted-weak compounds on the merged library) 0Cache challenge normalized hit score (1 (chemically novel) hits among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula 1000*N/L, that is 1000 times the Tier 1 count in column N divided by the predicted-active count in column L.) 3.12Cache challenge normalized hit score (2 (not novel) hits among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula 1000*O/L, that is 1000 times the Tier 2 count in column O divided by the predicted-active count in column L.) 34.3Cache challenge normalized hit score (1 and Tier 2 hits combined among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula R+S, the sum of the two preceding columns.) 37.4
WF1696conventional64Compounds the workflow selected that were synthesised and experimentally testedCount (Experimentally confirmed hits) 4Count (Confirmed hits the Hit Evaluation Committee judged chemically novel,) 0Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit) 23.5Cache challenge activity score (Sum of the activity scores of all the workflow's confirmed Round 1 hits) 87.4
2 more valuesCache challenge novelty score 1Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit that was judged chemically novel) 0
99Compounds of the merged 1739-compound Round 1 library the workflow predicted to be activeCount (Compounds of the merged 1739-compound Round 1 library the workflow predicted to be weakly active) 0Count (Confirmed Tier 1 (chemically novel) hits among the workflow's predicted-active compounds on the merged library) 2Count (Confirmed Tier 2 (not novel) hits among the workflow's predicted-active compounds on the merged library) 9Count (Confirmed Tier 1 (chemically novel) hits among the workflow's predicted-weak compounds on the merged library) 0
4 more valuesCount (Confirmed Tier 2 (not novel) hits among the workflow's predicted-weak compounds on the merged library) 0Cache challenge normalized hit score (1 (chemically novel) hits among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula 1000*N/L, that is 1000 times the Tier 1 count in column N divided by the predicted-active count in column L.) 20.2Cache challenge normalized hit score (2 (not novel) hits among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula 1000*O/L, that is 1000 times the Tier 2 count in column O divided by the predicted-active count in column L.) 90.9Cache challenge normalized hit score (1 and Tier 2 hits combined among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula R+S, the sum of the two preceding columns.) 111
WF1687conventional61Compounds the workflow selected that were synthesised and experimentally testedCount (Experimentally confirmed hits) 0Count (Confirmed hits the Hit Evaluation Committee judged chemically novel,) 0Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit) 0Cache challenge activity score (Sum of the activity scores of all the workflow's confirmed Round 1 hits) 0
2 more valuesCache challenge novelty score 0Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit that was judged chemically novel) 0
275Compounds of the merged 1739-compound Round 1 library the workflow predicted to be activeCount (Compounds of the merged 1739-compound Round 1 library the workflow predicted to be weakly active) 0Count (Confirmed Tier 1 (chemically novel) hits among the workflow's predicted-active compounds on the merged library) 2Count (Confirmed Tier 2 (not novel) hits among the workflow's predicted-active compounds on the merged library) 16Count (Confirmed Tier 1 (chemically novel) hits among the workflow's predicted-weak compounds on the merged library) 0
4 more valuesCount (Confirmed Tier 2 (not novel) hits among the workflow's predicted-weak compounds on the merged library) 0Cache challenge normalized hit score (1 (chemically novel) hits among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula 1000*N/L, that is 1000 times the Tier 1 count in column N divided by the predicted-active count in column L.) 7.27Cache challenge normalized hit score (2 (not novel) hits among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula 1000*O/L, that is 1000 times the Tier 2 count in column O divided by the predicted-active count in column L.) 58.2Cache challenge normalized hit score (1 and Tier 2 hits combined among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula R+S, the sum of the two preceding columns.) 65.5
WF1709conventional59Compounds the workflow selected that were synthesised and experimentally testedCount (Experimentally confirmed hits) 1Count (Confirmed hits the Hit Evaluation Committee judged chemically novel,) 0Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit) 9.4Cache challenge activity score (Sum of the activity scores of all the workflow's confirmed Round 1 hits) 9.4
2 more valuesCache challenge novelty score 1Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit that was judged chemically novel) 0
182Compounds of the merged 1739-compound Round 1 library the workflow predicted to be activeCount (Compounds of the merged 1739-compound Round 1 library the workflow predicted to be weakly active) 308Count (Confirmed Tier 1 (chemically novel) hits among the workflow's predicted-active compounds on the merged library) 0Count (Confirmed Tier 2 (not novel) hits among the workflow's predicted-active compounds on the merged library) 5Count (Confirmed Tier 1 (chemically novel) hits among the workflow's predicted-weak compounds on the merged library) 1
4 more valuesCount (Confirmed Tier 2 (not novel) hits among the workflow's predicted-weak compounds on the merged library) 1Cache challenge normalized hit score (1 (chemically novel) hits among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula 1000*N/L, that is 1000 times the Tier 1 count in column N divided by the predicted-active count in column L.) 0Cache challenge normalized hit score (2 (not novel) hits among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula 1000*O/L, that is 1000 times the Tier 2 count in column O divided by the predicted-active count in column L.) 27.5Cache challenge normalized hit score (1 and Tier 2 hits combined among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula R+S, the sum of the two preceding columns.) 27.5
WF1716conventional51Compounds the workflow selected that were synthesised and experimentally testedCount (Experimentally confirmed hits) 1Count (Confirmed hits the Hit Evaluation Committee judged chemically novel,) 1Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit) 18.1Cache challenge activity score (Sum of the activity scores of all the workflow's confirmed Round 1 hits) 18.1
2 more valuesCache challenge novelty score 2Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit that was judged chemically novel) 18.1
Not reported
WF1879conventional45Compounds the workflow selected that were synthesised and experimentally testedCount (Experimentally confirmed hits) 0Count (Confirmed hits the Hit Evaluation Committee judged chemically novel,) 0Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit) 0Cache challenge activity score (Sum of the activity scores of all the workflow's confirmed Round 1 hits) 0
2 more valuesCache challenge novelty score 0Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit that was judged chemically novel) 0
192Compounds of the merged 1739-compound Round 1 library the workflow predicted to be activeCount (Compounds of the merged 1739-compound Round 1 library the workflow predicted to be weakly active) 282Count (Confirmed Tier 1 (chemically novel) hits among the workflow's predicted-active compounds on the merged library) 0Count (Confirmed Tier 2 (not novel) hits among the workflow's predicted-active compounds on the merged library) 5Count (Confirmed Tier 1 (chemically novel) hits among the workflow's predicted-weak compounds on the merged library) 2
4 more valuesCount (Confirmed Tier 2 (not novel) hits among the workflow's predicted-weak compounds on the merged library) 4Cache challenge normalized hit score (1 (chemically novel) hits among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula 1000*N/L, that is 1000 times the Tier 1 count in column N divided by the predicted-active count in column L.) 0Cache challenge normalized hit score (2 (not novel) hits among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula 1000*O/L, that is 1000 times the Tier 2 count in column O divided by the predicted-active count in column L.) 26.0Cache challenge normalized hit score (1 and Tier 2 hits combined among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula R+S, the sum of the two preceding columns.) 26.0
WF1714conventional41Compounds the workflow selected that were synthesised and experimentally testedCount (Experimentally confirmed hits) 1Count (Confirmed hits the Hit Evaluation Committee judged chemically novel,) 1Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit) 12.9Cache challenge activity score (Sum of the activity scores of all the workflow's confirmed Round 1 hits) 12.9
2 more valuesCache challenge novelty score 3Cache challenge activity score (Activity score of the workflow's best confirmed Round 1 hit that was judged chemically novel) 12.9
285Compounds of the merged 1739-compound Round 1 library the workflow predicted to be activeCount (Compounds of the merged 1739-compound Round 1 library the workflow predicted to be weakly active) 394Count (Confirmed Tier 1 (chemically novel) hits among the workflow's predicted-active compounds on the merged library) 0Count (Confirmed Tier 2 (not novel) hits among the workflow's predicted-active compounds on the merged library) 5Count (Confirmed Tier 1 (chemically novel) hits among the workflow's predicted-weak compounds on the merged library) 1
4 more valuesCount (Confirmed Tier 2 (not novel) hits among the workflow's predicted-weak compounds on the merged library) 1Cache challenge normalized hit score (1 (chemically novel) hits among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula 1000*N/L, that is 1000 times the Tier 1 count in column N divided by the predicted-active count in column L.) 0Cache challenge normalized hit score (2 (not novel) hits among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula 1000*O/L, that is 1000 times the Tier 2 count in column O divided by the predicted-active count in column L.) 17.5Cache challenge normalized hit score (1 and Tier 2 hits combined among the workflow's predicted actives on the merged 1739-compound library, per 1000 compounds predicted active. The cell is stored as the formula R+S, the sum of the two preceding columns.) 17.5
Show all 23 rowsShow the top 10 rows only
Caveats and method

What each column measures:

  • Round 1: each workflow's own selection, synthesised and assayed: Compounds selected and experimentally tested per workflow, confirmed hits and chemically novel hits among them, and the challenge's activity and novelty scores
  • Round 1: every workflow applied to the same merged 1,739-compound library: Compounds predicted active and predicted weak on the merged library per workflow, confirmed Tier 1 and Tier 2 hits among them, and the challenge's normalised values
  • Each workflow selected its own compounds, so differences between workflows mix the ranking method with the library and chemistry each team chose. The merged-library arm is the comparison on one library.
  • The source prints no per-workflow hit rate; this batch records the numerator and the denominator as separate printed counts and does not divide them.
  • The denominators are small and unequal, so a one-hit difference moves a workflow's apparent rate by several percentage points.
  • The activity and novelty scores are committee judgements, not measurements.
  • Transcribed from the source; no reproduction by Rewire and no human scientific review.
  • No ligand-similarity or pharmacophore baseline is scored on any protocol in this batch, although issue #177 asks for one as the pre-machine-learning comparator alongside docking.
  • The merged library is the union of what the workflows themselves selected, so it is not an independent library and each workflow's own picks are in it.
  • Four of the 23 workflows (1694, 1695, 1716, 1717) have no values printed in these columns; they are absent, not zero.
  • Only 29 confirmed hits scored above 15, four of them chemically novel, so the Tier 1 counts rest on four compounds in total.
  • The two normalised columns are labelled as hit counts but defined in the article's figure caption as an aggregated score divided by the number of compounds predicted active, and the final column has no printed header.
  • One target, one round and one organiser's library: nothing here shows how the ordering would hold on another target.

Protocols: CACHE #3 Round 1 own-selection outcome per workflow (Herasymenko et al. 2026 Table S8), CACHE #3 merged Round 1 library prediction per workflow (Herasymenko et al. 2026 Table S8)

Re-ranking compounds that were synthesised and assayed

Direct evidenceAuthor-reported

Area under the ROC curve for separating measured binders from high-ranking docking false positives, printed on a 0-100 scale

AUROC (higher is better), with the other metrics below each value. The best value in each column is highlighted.

Scroll sideways to see all 3 columns.

ToolSigma-2 receptor: 201 binders and 305 docking false positivesDopamine D4 receptor: 205 binders and 336 docking false positivesAmpC beta-lactamase: 247 inhibitors and 1,046 docking false positives
Boltz-2 pIC50foundation modelAUC = 83.8 (best in column)AUC ~ 71AUC = 68.1
DOCK3.7conventionalAUC = 78.8AUC ~ 71AUC = 76.5 (best in column)
AF3 L-pLDDTfoundation modelAUC = 56.1AUC = 46.4AUC = 60.5
Caveats and method
  • Only high-ranking docked molecules were synthesised, so the list is a biased sample of the 490-million library and no value from it estimates performance over a whole library.
  • The comparison is a retrospective re-ranking of a prospectively tested set, not a new prospective screen.
  • No training-overlap control is stated for this arm.
  • Transcribed from the source; no reproduction by Rewire and no human scientific review.
  • No ligand-similarity or pharmacophore baseline is scored on any protocol in this batch, although issue #177 asks for one as the pre-machine-learning comparator alongside docking.
  • The source prints a single approximate value, 'both with AUC ~ 71', for DOCK3.7 and Boltz-2 pIC50; no separate figure is given, so neither result carries a numeric value.
  • Only high-ranking docked molecules were synthesised, so the list is a biased sample of the 138-million library.
  • The 1,293 tested compounds were sampled from scoring bins within the top 1% of 1.7 billion docked molecules, so the list is a biased sample of the library.
  • The activity threshold for a true hit on this target is an apparent Ki below 400 uM, far weaker than the thresholds used for the two receptors.

Protocols: Re-ranking the Sigma-2 receptor docking hit list by co-folding and docking scores (Kim, Correy, Hall et al. 2026), Re-ranking the Dopamine D4 receptor docking hit list by co-folding and docking scores (Kim, Correy, Hall et al. 2026), Re-ranking the AmpC beta-lactamase docking hit list by co-folding and docking scores (Kim, Correy, Hall et al. 2026)

Retrospective enrichment on synthetic property-matched decoys

Proxy evidenceAuthor-reportedCompiled from papers

Enrichment factor (higher is better), with the other metrics below each value. Showing the top 10 of 45 rows. The best value in each column is highlighted.

Scroll sideways to see all 5 columns.

ToolDEKOIS 2.0, built-in co-folding scores against docking tools (24 arms)DEKOIS 2.0, rescoring of Protenix-predicted complexes (13 arms)DEKOIS 2.0, rescoring of AF3-predicted complexes (10 arms)GPCRrecent, 16 targets with post-2022 structures (16 arms)GPCRrecent, six targets after the Boltz-2 training cutoff (2 arms)
Boltz-2 (Probability)foundation model26.68 (best in column)0.5% of the ranked library, meanAUROC (AUROC, mean) 0.911AUROC (AUROC, median) 0.964Bedroc (80.5, mean) 0.820Bedroc (80.5, median) 0.925
5 more valuesEnrichment factor (0.5% of the ranked library, median) 31.00Enrichment factor (1% of the ranked library, mean) 25.84Enrichment factor (1% of the ranked library, median) 28.62Enrichment factor (5% of the ranked library, mean) 14.32Enrichment factor (5% of the ranked library, median) 16.00
Not reportedNot reportedNot reportedNot reported
Boltz-2 (Affinity)foundation model25.170.5% of the ranked library, meanAUROC (AUROC, mean) 0.854AUROC (AUROC, median) 0.918Bedroc (80.5, mean) 0.705Bedroc (80.5, median) 0.780
5 more valuesEnrichment factor (0.5% of the ranked library, median) 31.00Enrichment factor (1% of the ranked library, mean) 23.54Enrichment factor (1% of the ranked library, median) 28.59Enrichment factor (5% of the ranked library, mean) 11.66Enrichment factor (5% of the ranked library, median) 12.50
Not reportedNot reportedNot reportedNot reported
Boltz-2 (min-iPAE)foundation model23.320.5% of the ranked library, meanAUROC (AUROC, mean) 0.896AUROC (AUROC, median) 0.939Bedroc (80.5, mean) 0.709Bedroc (80.5, median) 0.780
5 more valuesEnrichment factor (0.5% of the ranked library, median) 26.57Enrichment factor (1% of the ranked library, mean) 22.73Enrichment factor (1% of the ranked library, median) 26.23Enrichment factor (5% of the ranked library, mean) 13.15Enrichment factor (5% of the ranked library, median) 14.00
Not reportedNot reported17.06 (best in column)0.5% of the ranked library, meanAUROC (AUROC, mean) 0.770AUROC (AUROC, median) 0.795Bedroc (80.5, mean) 0.277Bedroc (80.5, median) 0.213
5 more valuesEnrichment factor (0.5% of the ranked library, median) 12.91Enrichment factor (1% of the ranked library, mean) 13.96Enrichment factor (1% of the ranked library, median) 10.83Enrichment factor (5% of the ranked library, mean) 6.78Enrichment factor (5% of the ranked library, median) 5.93
19.03 (best in column)0.5% of the ranked library, meanAUROC (AUROC, mean) 0.764AUROC (AUROC, median) 0.740Bedroc (80.5, mean) 0.287Bedroc (80.5, median) 0.245
5 more valuesEnrichment factor (0.5% of the ranked library, median) 17.55Enrichment factor (1% of the ranked library, mean) 14.30Enrichment factor (1% of the ranked library, median) 12.50Enrichment factor (5% of the ranked library, mean) 6.83Enrichment factor (5% of the ranked library, median) 5.87
AF3 (min-iPAE)foundation model22.980.5% of the ranked library, meanAUROC (AUROC, mean) 0.913AUROC (AUROC, median) 0.952Bedroc (80.5, mean) 0.755Bedroc (80.5, median) 0.828
5 more valuesEnrichment factor (0.5% of the ranked library, median) 26.57Enrichment factor (1% of the ranked library, mean) 23.15Enrichment factor (1% of the ranked library, median) 26.23Enrichment factor (5% of the ranked library, mean) 14.50Enrichment factor (5% of the ranked library, median) 16.00
Not reported22.98 (best in column)0.5% of the ranked library, meanAUROC (AUROC, mean) 0.913AUROC (AUROC, median) 0.952Bedroc (80.5, mean) 0.755Bedroc (80.5, median) 0.828
5 more valuesEnrichment factor (0.5% of the ranked library, median) 26.57Enrichment factor (1% of the ranked library, mean) 23.15Enrichment factor (1% of the ranked library, median) 26.23Enrichment factor (5% of the ranked library, mean) 14.50Enrichment factor (5% of the ranked library, median) 16.00
Not reportedNot reported
SurfDockmachine learning21.000.5% of the ranked library, meanAUROC (AUROC, mean) 0.758AUROC (AUROC, median) 0.803Bedroc (80.5, mean) 0.488Bedroc (80.5, median) 0.482
5 more valuesEnrichment factor (0.5% of the ranked library, median) 25.73Enrichment factor (1% of the ranked library, mean) 18.17Enrichment factor (1% of the ranked library, median) 18.07Enrichment factor (5% of the ranked library, mean) 8.34Enrichment factor (5% of the ranked library, median) 8.12
Not reportedNot reportedNot reportedNot reported
AF3 (ranking score)foundation model20.570.5% of the ranked library, meanAUROC (AUROC, mean) 0.893AUROC (AUROC, median) 0.934Bedroc (80.5, mean) 0.628Bedroc (80.5, median) 0.655
5 more valuesEnrichment factor (0.5% of the ranked library, median) 22.14Enrichment factor (1% of the ranked library, mean) 19.23Enrichment factor (1% of the ranked library, median) 21.46Enrichment factor (5% of the ranked library, mean) 12.42Enrichment factor (5% of the ranked library, median) 13.50
Not reportedNot reportedNot reportedNot reported
AF3 (ipTM)foundation model20.460.5% of the ranked library, meanAUROC (AUROC, mean) 0.892AUROC (AUROC, median) 0.933Bedroc (80.5, mean) 0.635Bedroc (80.5, median) 0.659
5 more valuesEnrichment factor (0.5% of the ranked library, median) 22.14Enrichment factor (1% of the ranked library, mean) 19.32Enrichment factor (1% of the ranked library, median) 21.46Enrichment factor (5% of the ranked library, mean) 12.64Enrichment factor (5% of the ranked library, median) 13.50
Not reported20.460.5% of the ranked library, meanAUROC (AUROC, mean) 0.892AUROC (AUROC, median) 0.933Bedroc (80.5, mean) 0.635Bedroc (80.5, median) 0.659
5 more valuesEnrichment factor (0.5% of the ranked library, median) 22.14Enrichment factor (1% of the ranked library, mean) 19.32Enrichment factor (1% of the ranked library, median) 21.46Enrichment factor (5% of the ranked library, mean) 12.64Enrichment factor (5% of the ranked library, median) 13.50
Not reportedNot reported
CarsiDockmachine learning20.230.5% of the ranked library, meanAUROC (AUROC, mean) 0.797AUROC (AUROC, median) 0.838Bedroc (80.5, mean) 0.561Bedroc (80.5, median) 0.638
5 more valuesEnrichment factor (0.5% of the ranked library, median) 22.14Enrichment factor (1% of the ranked library, mean) 18.65Enrichment factor (1% of the ranked library, median) 23.85Enrichment factor (5% of the ranked library, mean) 9.29Enrichment factor (5% of the ranked library, median) 9.00
Not reportedNot reportedNot reportedNot reported
Boltz-2 (ipTM)foundation model19.170.5% of the ranked library, meanAUROC (AUROC, mean) 0.860AUROC (AUROC, median) 0.894Bedroc (80.5, mean) 0.560Bedroc (80.5, median) 0.618
5 more valuesEnrichment factor (0.5% of the ranked library, median) 22.14Enrichment factor (1% of the ranked library, mean) 17.96Enrichment factor (1% of the ranked library, median) 19.08Enrichment factor (5% of the ranked library, mean) 10.30Enrichment factor (5% of the ranked library, median) 11.00
Not reportedNot reported14.560.5% of the ranked library, meanAUROC (AUROC, mean) 0.738AUROC (AUROC, median) 0.730Bedroc (80.5, mean) 0.236Bedroc (80.5, median) 0.198
5 more valuesEnrichment factor (0.5% of the ranked library, median) 12.91Enrichment factor (1% of the ranked library, mean) 12.03Enrichment factor (1% of the ranked library, median) 9.30Enrichment factor (5% of the ranked library, mean) 5.70Enrichment factor (5% of the ranked library, median) 5.03
15.770.5% of the ranked library, meanAUROC (AUROC, mean) 0.717AUROC (AUROC, median) 0.699Bedroc (80.5, mean) 0.230Bedroc (80.5, median) 0.201
5 more valuesEnrichment factor (0.5% of the ranked library, median) 13.58Enrichment factor (1% of the ranked library, mean) 12.62Enrichment factor (1% of the ranked library, median) 10.91Enrichment factor (5% of the ranked library, mean) 5.17Enrichment factor (5% of the ranked library, median) 4.84
Protenix (ipTM)foundation model18.440.5% of the ranked library, meanAUROC (AUROC, mean) 0.795AUROC (AUROC, median) 0.837Bedroc (80.5, mean) 0.507Bedroc (80.5, median) 0.553
5 more valuesEnrichment factor (0.5% of the ranked library, median) 22.14Enrichment factor (1% of the ranked library, mean) 16.81Enrichment factor (1% of the ranked library, median) 16.69Enrichment factor (5% of the ranked library, mean) 8.84Enrichment factor (5% of the ranked library, median) 9.50
18.440.5% of the ranked library, meanAUROC (AUROC, mean) 0.795AUROC (AUROC, median) 0.837Bedroc (80.5, mean) 0.507Bedroc (80.5, median) 0.553
5 more valuesEnrichment factor (0.5% of the ranked library, median) 22.14Enrichment factor (1% of the ranked library, mean) 16.81Enrichment factor (1% of the ranked library, median) 16.69Enrichment factor (5% of the ranked library, mean) 8.84Enrichment factor (5% of the ranked library, median) 9.50
Not reported7.990.5% of the ranked library, meanAUROC (AUROC, mean) 0.623AUROC (AUROC, median) 0.632Bedroc (80.5, mean) 0.135Bedroc (80.5, median) 0.105
5 more valuesEnrichment factor (0.5% of the ranked library, median) 5.30Enrichment factor (1% of the ranked library, mean) 6.97Enrichment factor (1% of the ranked library, median) 5.67Enrichment factor (5% of the ranked library, mean) 3.59Enrichment factor (5% of the ranked library, median) 2.88
Not reported
KarmaDock (Aligned)machine learning16.550.5% of the ranked library, meanAUROC (AUROC, mean) 0.743AUROC (AUROC, median) 0.786Bedroc (80.5, mean) 0.458Bedroc (80.5, median) 0.453
5 more valuesEnrichment factor (0.5% of the ranked library, median) 17.45Enrichment factor (1% of the ranked library, mean) 15.16Enrichment factor (1% of the ranked library, median) 15.16Enrichment factor (5% of the ranked library, mean) 7.33Enrichment factor (5% of the ranked library, median) 7.01
Not reportedNot reportedNot reportedNot reported
Protenix (ranking score)foundation model16.420.5% of the ranked library, meanAUROC (AUROC, mean) 0.782AUROC (AUROC, median) 0.813Bedroc (80.5, mean) 0.456Bedroc (80.5, median) 0.477
5 more valuesEnrichment factor (0.5% of the ranked library, median) 17.71Enrichment factor (1% of the ranked library, mean) 14.97Enrichment factor (1% of the ranked library, median) 14.31Enrichment factor (5% of the ranked library, mean) 8.12Enrichment factor (5% of the ranked library, median) 8.50
Not reportedNot reportedNot reportedNot reported
Glide_SPon DEKOIS 2.0, values quoted by Shen et al. 2025conventional14.200.5% of the ranked library, meanAUROC (AUROC, mean) 0.745AUROC (AUROC, median) 0.752Bedroc (80.5, mean) 0.374Bedroc (80.5, median) 0.313
5 more valuesEnrichment factor (0.5% of the ranked library, median) 13.23Enrichment factor (1% of the ranked library, mean) 12.01Enrichment factor (1% of the ranked library, median) 9.53Enrichment factor (5% of the ranked library, mean) 6.18Enrichment factor (5% of the ranked library, median) 5.95
Not reportedNot reportedNot reportedNot reported
Gnina (CNNscore)docking baselinemachine learning13.730.5% of the ranked library, meanAUROC (AUROC, mean) 0.715AUROC (AUROC, median) 0.734Bedroc (80.5, mean) 0.354Bedroc (80.5, median) 0.342
5 more valuesEnrichment factor (0.5% of the ranked library, median) 13.29Enrichment factor (1% of the ranked library, mean) 11.92Enrichment factor (1% of the ranked library, median) 9.54Enrichment factor (5% of the ranked library, mean) 6.17Enrichment factor (5% of the ranked library, median) 6.00
Not reportedNot reported3.180.5% of the ranked library, meanAUROC (AUROC, mean) 0.564AUROC (AUROC, median) 0.554Bedroc (80.5, mean) 0.062Bedroc (80.5, median) 0.048
5 more valuesEnrichment factor (0.5% of the ranked library, median) 1.99Enrichment factor (1% of the ranked library, mean) 2.74Enrichment factor (1% of the ranked library, median) 1.97Enrichment factor (5% of the ranked library, mean) 2.06Enrichment factor (5% of the ranked library, median) 1.73
Not reported
AF3 (pTM)foundation model13.680.5% of the ranked library, meanAUROC (AUROC, mean) 0.832AUROC (AUROC, median) 0.874Bedroc (80.5, mean) 0.417Bedroc (80.5, median) 0.396
5 more valuesEnrichment factor (0.5% of the ranked library, median) 13.29Enrichment factor (1% of the ranked library, mean) 12.59Enrichment factor (1% of the ranked library, median) 11.92Enrichment factor (5% of the ranked library, mean) 9.34Enrichment factor (5% of the ranked library, median) 9.50
Not reportedNot reportedNot reportedNot reported
Boltz-2 (ranking score)foundation model12.890.5% of the ranked library, meanAUROC (AUROC, mean) 0.831AUROC (AUROC, median) 0.857Bedroc (80.5, mean) 0.385Bedroc (80.5, median) 0.347
5 more valuesEnrichment factor (0.5% of the ranked library, median) 13.29Enrichment factor (1% of the ranked library, mean) 11.77Enrichment factor (1% of the ranked library, median) 9.54Enrichment factor (5% of the ranked library, mean) 7.89Enrichment factor (5% of the ranked library, median) 7.50
Not reportedNot reportedNot reportedNot reported
Gnina (CNNaffinity)docking baselinemachine learning9.360.5% of the ranked library, meanAUROC (AUROC, mean) 0.710AUROC (AUROC, median) 0.739Bedroc (80.5, mean) 0.257Bedroc (80.5, median) 0.231
5 more valuesEnrichment factor (0.5% of the ranked library, median) 8.86Enrichment factor (1% of the ranked library, mean) 8.21Enrichment factor (1% of the ranked library, median) 7.15Enrichment factor (5% of the ranked library, mean) 4.87Enrichment factor (5% of the ranked library, median) 4.50
Not reportedNot reported0.860.5% of the ranked library, meanAUROC (AUROC, mean) 0.557AUROC (AUROC, median) 0.555Bedroc (80.5, mean) 0.024Bedroc (80.5, median) 0.018
5 more valuesEnrichment factor (0.5% of the ranked library, median) 0.66Enrichment factor (1% of the ranked library, mean) 0.94Enrichment factor (1% of the ranked library, median) 0.71Enrichment factor (5% of the ranked library, mean) 1.13Enrichment factor (5% of the ranked library, median) 1.13
Not reported
Surflex-Dockconventional8.300.5% of the ranked library, meanAUROC (AUROC, mean) 0.671AUROC (AUROC, median) 0.673Bedroc (80.5, mean) 0.219Bedroc (80.5, median) 0.180
5 more valuesEnrichment factor (0.5% of the ranked library, median) 4.43Enrichment factor (1% of the ranked library, mean) 7.27Enrichment factor (1% of the ranked library, median) 4.77Enrichment factor (5% of the ranked library, mean) 3.97Enrichment factor (5% of the ranked library, median) 3.50
Not reportedNot reportedNot reportedNot reported
LeDockconventional6.780.5% of the ranked library, meanAUROC (AUROC, mean) 0.656AUROC (AUROC, median) 0.680Bedroc (80.5, mean) 0.187Bedroc (80.5, median) 0.142
5 more valuesEnrichment factor (0.5% of the ranked library, median) 4.43Enrichment factor (1% of the ranked library, mean) 5.88Enrichment factor (1% of the ranked library, median) 4.77Enrichment factor (5% of the ranked library, mean) 3.65Enrichment factor (5% of the ranked library, median) 3.50
Not reportedNot reportedNot reportedNot reported
Boltz-2 (pTM)foundation model6.220.5% of the ranked library, meanAUROC (AUROC, mean) 0.720AUROC (AUROC, median) 0.735Bedroc (80.5, mean) 0.194Bedroc (80.5, median) 0.137
5 more valuesEnrichment factor (0.5% of the ranked library, median) 4.43Enrichment factor (1% of the ranked library, mean) 5.61Enrichment factor (1% of the ranked library, median) 4.76Enrichment factor (5% of the ranked library, mean) 4.32Enrichment factor (5% of the ranked library, median) 3.00
Not reportedNot reportedNot reportedNot reported
Gnina (Vina)docking baselineconventional6.170.5% of the ranked library, meanAUROC (AUROC, mean) 0.653AUROC (AUROC, median) 0.659Bedroc (80.5, mean) 0.164Bedroc (80.5, median) 0.105
5 more valuesEnrichment factor (0.5% of the ranked library, median) 4.43Enrichment factor (1% of the ranked library, mean) 5.16Enrichment factor (1% of the ranked library, median) 2.38Enrichment factor (5% of the ranked library, mean) 3.12Enrichment factor (5% of the ranked library, median) 2.50
Not reportedNot reported3.800.5% of the ranked library, meanAUROC (AUROC, mean) 0.635AUROC (AUROC, median) 0.612Bedroc (80.5, mean) 0.083Bedroc (80.5, median) 0.067
5 more valuesEnrichment factor (0.5% of the ranked library, median) 3.31Enrichment factor (1% of the ranked library, mean) 3.65Enrichment factor (1% of the ranked library, median) 3.33Enrichment factor (5% of the ranked library, mean) 2.73Enrichment factor (5% of the ranked library, median) 2.10
Not reported
GOLD_CHEMPLPconventional5.780.5% of the ranked library, meanAUROC (AUROC, mean) 0.647AUROC (AUROC, median) 0.631Bedroc (80.5, mean) 0.172Bedroc (80.5, median) 0.148
5 more valuesEnrichment factor (0.5% of the ranked library, median) 4.43Enrichment factor (1% of the ranked library, mean) 5.38Enrichment factor (1% of the ranked library, median) 4.75Enrichment factor (5% of the ranked library, mean) 3.36Enrichment factor (5% of the ranked library, median) 3.00
Not reportedNot reportedNot reportedNot reported
TankBindmachine learning2.900.5% of the ranked library, meanAUROC (AUROC, mean) 0.602AUROC (AUROC, median) 0.606Bedroc (80.5, mean) 0.109Bedroc (80.5, median) 0.053
5 more valuesEnrichment factor (0.5% of the ranked library, median) 0.00Enrichment factor (1% of the ranked library, mean) 2.94Enrichment factor (1% of the ranked library, median) 0.00Enrichment factor (5% of the ranked library, mean) 2.42Enrichment factor (5% of the ranked library, median) 1.51
Not reportedNot reportedNot reportedNot reported
Protenix (pTM)foundation model2.410.5% of the ranked library, meanAUROC (AUROC, mean) 0.597AUROC (AUROC, median) 0.602Bedroc (80.5, mean) 0.089Bedroc (80.5, median) 0.016
5 more valuesEnrichment factor (0.5% of the ranked library, median) 0.00Enrichment factor (1% of the ranked library, mean) 2.29Enrichment factor (1% of the ranked library, median) 0.00Enrichment factor (5% of the ranked library, mean) 2.20Enrichment factor (5% of the ranked library, median) 0.50
Not reportedNot reportedNot reportedNot reported
Glide_SPrescoring of Protenix top-ranked posesconventionalNot reported14.460.5% of the ranked library, meanAUROC (AUROC, mean) 0.785AUROC (AUROC, median) 0.811Bedroc (80.5, mean) 0.390Bedroc (80.5, median) 0.366
5 more valuesEnrichment factor (0.5% of the ranked library, median) 13.29Enrichment factor (1% of the ranked library, mean) 12.65Enrichment factor (1% of the ranked library, median) 11.92Enrichment factor (5% of the ranked library, mean) 7.23Enrichment factor (5% of the ranked library, median) 6.50
Not reported4.470.5% of the ranked library, meanAUROC (AUROC, mean) 0.636AUROC (AUROC, median) 0.634Bedroc (80.5, mean) 0.082Bedroc (80.5, median) 0.066
5 more valuesEnrichment factor (0.5% of the ranked library, median) 4.64Enrichment factor (1% of the ranked library, mean) 3.58Enrichment factor (1% of the ranked library, median) 2.83Enrichment factor (5% of the ranked library, mean) 2.59Enrichment factor (5% of the ranked library, median) 1.93
Not reported
Glide_SPrescoring of AF3 top-ranked posesconventionalNot reportedNot reported14.410.5% of the ranked library, meanAUROC (AUROC, mean) 0.798AUROC (AUROC, median) 0.816Bedroc (80.5, mean) 0.398Bedroc (80.5, median) 0.352
5 more valuesEnrichment factor (0.5% of the ranked library, median) 13.29Enrichment factor (1% of the ranked library, mean) 12.65Enrichment factor (1% of the ranked library, median) 11.92Enrichment factor (5% of the ranked library, mean) 7.32Enrichment factor (5% of the ranked library, median) 7.00
Not reportedNot reported
Glide_SPdocking baselineconventionalNot reportedNot reportedNot reported5.900.5% of the ranked library, meanAUROC (AUROC, mean) 0.653AUROC (AUROC, median) 0.668Bedroc (80.5, mean) 0.106Bedroc (80.5, median) 0.085
5 more valuesEnrichment factor (0.5% of the ranked library, median) 4.30Enrichment factor (1% of the ranked library, mean) 5.02Enrichment factor (1% of the ranked library, median) 3.83Enrichment factor (5% of the ranked library, mean) 3.22Enrichment factor (5% of the ranked library, median) 2.80
Not reported
Glide_XPrescoring of Protenix top-ranked posesconventionalNot reported14.740.5% of the ranked library, meanAUROC (AUROC, mean) 0.792AUROC (AUROC, median) 0.817Bedroc (80.5, mean) 0.394Bedroc (80.5, median) 0.371
5 more valuesEnrichment factor (0.5% of the ranked library, median) 13.29Enrichment factor (1% of the ranked library, mean) 12.68Enrichment factor (1% of the ranked library, median) 11.92Enrichment factor (5% of the ranked library, mean) 7.38Enrichment factor (5% of the ranked library, median) 7.00
Not reported4.790.5% of the ranked library, meanAUROC (AUROC, mean) 0.591AUROC (AUROC, median) 0.579Bedroc (80.5, mean) 0.081Bedroc (80.5, median) 0.050
5 more valuesEnrichment factor (0.5% of the ranked library, median) 2.64Enrichment factor (1% of the ranked library, mean) 3.89Enrichment factor (1% of the ranked library, median) 2.47Enrichment factor (5% of the ranked library, mean) 2.32Enrichment factor (5% of the ranked library, median) 1.67
Not reported
Glide_XPrescoring of AF3 top-ranked posesconventionalNot reportedNot reported13.730.5% of the ranked library, meanAUROC (AUROC, mean) 0.796AUROC (AUROC, median) 0.827Bedroc (80.5, mean) 0.391Bedroc (80.5, median) 0.394
5 more valuesEnrichment factor (0.5% of the ranked library, median) 17.71Enrichment factor (1% of the ranked library, mean) 12.53Enrichment factor (1% of the ranked library, median) 11.92Enrichment factor (5% of the ranked library, mean) 7.43Enrichment factor (5% of the ranked library, median) 7.00
Not reportedNot reported
Gnina (AD4)rescoring of Protenix top-ranked posesconventionalNot reported5.380.5% of the ranked library, meanAUROC (AUROC, mean) 0.624AUROC (AUROC, median) 0.607Bedroc (80.5, mean) 0.151Bedroc (80.5, median) 0.108
5 more valuesEnrichment factor (0.5% of the ranked library, median) 4.43Enrichment factor (1% of the ranked library, mean) 4.77Enrichment factor (1% of the ranked library, median) 2.38Enrichment factor (5% of the ranked library, mean) 3.08Enrichment factor (5% of the ranked library, median) 2.50
Not reported1.750.5% of the ranked library, meanAUROC (AUROC, mean) 0.601AUROC (AUROC, median) 0.594Bedroc (80.5, mean) 0.041Bedroc (80.5, median) 0.038
5 more valuesEnrichment factor (0.5% of the ranked library, median) 1.32Enrichment factor (1% of the ranked library, mean) 1.59Enrichment factor (1% of the ranked library, median) 1.41Enrichment factor (5% of the ranked library, mean) 1.72Enrichment factor (5% of the ranked library, median) 1.72
Not reported
Gnina (AD4)rescoring of AF3 top-ranked posesconventionalNot reportedNot reported5.100.5% of the ranked library, meanAUROC (AUROC, mean) 0.636AUROC (AUROC, median) 0.647Bedroc (80.5, mean) 0.157Bedroc (80.5, median) 0.103
5 more valuesEnrichment factor (0.5% of the ranked library, median) 4.43Enrichment factor (1% of the ranked library, mean) 4.92Enrichment factor (1% of the ranked library, median) 2.38Enrichment factor (5% of the ranked library, mean) 3.14Enrichment factor (5% of the ranked library, median) 2.50
Not reportedNot reported
Gnina (CNNaffinity)rescoring of Protenix top-ranked posesmachine learningNot reported11.440.5% of the ranked library, meanAUROC (AUROC, mean) 0.748AUROC (AUROC, median) 0.774Bedroc (80.5, mean) 0.310Bedroc (80.5, median) 0.303
5 more valuesEnrichment factor (0.5% of the ranked library, median) 8.86Enrichment factor (1% of the ranked library, mean) 10.26Enrichment factor (1% of the ranked library, median) 9.54Enrichment factor (5% of the ranked library, mean) 5.72Enrichment factor (5% of the ranked library, median) 5.50
Not reported1.110.5% of the ranked library, meanAUROC (AUROC, mean) 0.583AUROC (AUROC, median) 0.594Bedroc (80.5, mean) 0.031Bedroc (80.5, median) 0.032
5 more valuesEnrichment factor (0.5% of the ranked library, median) 1.32Enrichment factor (1% of the ranked library, mean) 1.26Enrichment factor (1% of the ranked library, median) 1.33Enrichment factor (5% of the ranked library, mean) 1.29Enrichment factor (5% of the ranked library, median) 1.40
Not reported
Gnina (CNNaffinity)rescoring of AF3 top-ranked posesmachine learningNot reportedNot reported11.940.5% of the ranked library, meanAUROC (AUROC, mean) 0.757AUROC (AUROC, median) 0.779Bedroc (80.5, mean) 0.323Bedroc (80.5, median) 0.269
5 more valuesEnrichment factor (0.5% of the ranked library, median) 8.86Enrichment factor (1% of the ranked library, mean) 10.50Enrichment factor (1% of the ranked library, median) 9.54Enrichment factor (5% of the ranked library, mean) 5.98Enrichment factor (5% of the ranked library, median) 5.50
Not reportedNot reported
Gnina (CNNscore)rescoring of Protenix top-ranked posesmachine learningNot reported18.110.5% of the ranked library, meanAUROC (AUROC, mean) 0.846AUROC (AUROC, median) 0.890Bedroc (80.5, mean) 0.515Bedroc (80.5, median) 0.597
5 more valuesEnrichment factor (0.5% of the ranked library, median) 22.14Enrichment factor (1% of the ranked library, mean) 16.69Enrichment factor (1% of the ranked library, median) 19.08Enrichment factor (5% of the ranked library, mean) 9.34Enrichment factor (5% of the ranked library, median) 10.00
Not reported7.370.5% of the ranked library, meanAUROC (AUROC, mean) 0.652AUROC (AUROC, median) 0.663Bedroc (80.5, mean) 0.118Bedroc (80.5, median) 0.099
5 more valuesEnrichment factor (0.5% of the ranked library, median) 6.62Enrichment factor (1% of the ranked library, mean) 5.80Enrichment factor (1% of the ranked library, median) 4.92Enrichment factor (5% of the ranked library, mean) 3.38Enrichment factor (5% of the ranked library, median) 2.86
Not reported
Gnina (CNNscore)rescoring of AF3 top-ranked posesmachine learningNot reportedNot reported18.110.5% of the ranked library, meanAUROC (AUROC, mean) 0.855AUROC (AUROC, median) 0.896Bedroc (80.5, mean) 0.509Bedroc (80.5, median) 0.549
5 more valuesEnrichment factor (0.5% of the ranked library, median) 22.14Enrichment factor (1% of the ranked library, mean) 16.51Enrichment factor (1% of the ranked library, median) 19.08Enrichment factor (5% of the ranked library, mean) 9.25Enrichment factor (5% of the ranked library, median) 10.00
Not reportedNot reported
Gnina (Vina)rescoring of Protenix top-ranked posesconventionalNot reported6.840.5% of the ranked library, meanAUROC (AUROC, mean) 0.682AUROC (AUROC, median) 0.678Bedroc (80.5, mean) 0.186Bedroc (80.5, median) 0.167
5 more valuesEnrichment factor (0.5% of the ranked library, median) 4.43Enrichment factor (1% of the ranked library, mean) 5.80Enrichment factor (1% of the ranked library, median) 4.77Enrichment factor (5% of the ranked library, mean) 3.58Enrichment factor (5% of the ranked library, median) 3.50
Not reported3.590.5% of the ranked library, meanAUROC (AUROC, mean) 0.653AUROC (AUROC, median) 0.644Bedroc (80.5, mean) 0.078Bedroc (80.5, median) 0.070
5 more valuesEnrichment factor (0.5% of the ranked library, median) 3.64Enrichment factor (1% of the ranked library, mean) 3.21Enrichment factor (1% of the ranked library, median) 3.33Enrichment factor (5% of the ranked library, mean) 2.88Enrichment factor (5% of the ranked library, median) 2.90
Not reported
Gnina (Vina)rescoring of AF3 top-ranked posesconventionalNot reportedNot reported7.060.5% of the ranked library, meanAUROC (AUROC, mean) 0.704AUROC (AUROC, median) 0.705Bedroc (80.5, mean) 0.194Bedroc (80.5, median) 0.160
5 more valuesEnrichment factor (0.5% of the ranked library, median) 4.43Enrichment factor (1% of the ranked library, mean) 5.92Enrichment factor (1% of the ranked library, median) 4.77Enrichment factor (5% of the ranked library, mean) 3.92Enrichment factor (5% of the ranked library, median) 3.50
Not reportedNot reported
Gnina (Vinardo)rescoring of Protenix top-ranked posesconventionalNot reported8.800.5% of the ranked library, meanAUROC (AUROC, mean) 0.751AUROC (AUROC, median) 0.767Bedroc (80.5, mean) 0.259Bedroc (80.5, median) 0.225
5 more valuesEnrichment factor (0.5% of the ranked library, median) 4.43Enrichment factor (1% of the ranked library, mean) 8.15Enrichment factor (1% of the ranked library, median) 7.15Enrichment factor (5% of the ranked library, mean) 5.08Enrichment factor (5% of the ranked library, median) 4.50
Not reportedNot reportedNot reported
Gnina (Vinardo)rescoring of AF3 top-ranked posesconventionalNot reportedNot reported9.190.5% of the ranked library, meanAUROC (AUROC, mean) 0.757AUROC (AUROC, median) 0.766Bedroc (80.5, mean) 0.270Bedroc (80.5, median) 0.239
5 more valuesEnrichment factor (0.5% of the ranked library, median) 8.86Enrichment factor (1% of the ranked library, mean) 8.45Enrichment factor (1% of the ranked library, median) 7.15Enrichment factor (5% of the ranked library, mean) 5.21Enrichment factor (5% of the ranked library, median) 4.50
Not reportedNot reported
IGModel (pkd)machine learningNot reported12.110.5% of the ranked library, meanAUROC (AUROC, mean) 0.786AUROC (AUROC, median) 0.815Bedroc (80.5, mean) 0.348Bedroc (80.5, median) 0.342
5 more valuesEnrichment factor (0.5% of the ranked library, median) 8.86Enrichment factor (1% of the ranked library, mean) 11.41Enrichment factor (1% of the ranked library, median) 9.54Enrichment factor (5% of the ranked library, mean) 6.68Enrichment factor (5% of the ranked library, median) 6.50
Not reportedNot reportedNot reported
IGModel (rmsd)machine learningNot reported8.300.5% of the ranked library, meanAUROC (AUROC, mean) 0.787AUROC (AUROC, median) 0.838Bedroc (80.5, mean) 0.287Bedroc (80.5, median) 0.279
5 more valuesEnrichment factor (0.5% of the ranked library, median) 4.43Enrichment factor (1% of the ranked library, mean) 8.54Enrichment factor (1% of the ranked library, median) 7.15Enrichment factor (5% of the ranked library, mean) 6.11Enrichment factor (5% of the ranked library, median) 6.00
Not reportedNot reportedNot reported
PIGNet2machine learningNot reported9.700.5% of the ranked library, meanAUROC (AUROC, mean) 0.731AUROC (AUROC, median) 0.763Bedroc (80.5, mean) 0.292Bedroc (80.5, median) 0.199
5 more valuesEnrichment factor (0.5% of the ranked library, median) 8.86Enrichment factor (1% of the ranked library, mean) 9.09Enrichment factor (1% of the ranked library, median) 7.15Enrichment factor (5% of the ranked library, mean) 5.68Enrichment factor (5% of the ranked library, median) 4.00
Not reportedNot reportedNot reported
PLANETmachine learningNot reported4.150.5% of the ranked library, meanAUROC (AUROC, mean) 0.703AUROC (AUROC, median) 0.742Bedroc (80.5, mean) 0.140Bedroc (80.5, median) 0.105
5 more valuesEnrichment factor (0.5% of the ranked library, median) 0.00Enrichment factor (1% of the ranked library, mean) 3.92Enrichment factor (1% of the ranked library, median) 2.38Enrichment factor (5% of the ranked library, mean) 3.27Enrichment factor (5% of the ranked library, median) 3.00
Not reportedNot reportedNot reported
RTMScorerescoring of Protenix top-ranked posesmachine learningNot reported21.02 (best in column)0.5% of the ranked library, meanAUROC (AUROC, mean) 0.852AUROC (AUROC, median) 0.909Bedroc (80.5, mean) 0.640Bedroc (80.5, median) 0.759
5 more valuesEnrichment factor (0.5% of the ranked library, median) 26.57Enrichment factor (1% of the ranked library, mean) 20.37Enrichment factor (1% of the ranked library, median) 23.85Enrichment factor (5% of the ranked library, mean) 11.62Enrichment factor (5% of the ranked library, median) 13.00
Not reported4.170.5% of the ranked library, meanAUROC (AUROC, mean) 0.644AUROC (AUROC, median) 0.654Bedroc (80.5, mean) 0.080Bedroc (80.5, median) 0.071
5 more valuesEnrichment factor (0.5% of the ranked library, median) 3.63Enrichment factor (1% of the ranked library, mean) 3.66Enrichment factor (1% of the ranked library, median) 3.20Enrichment factor (5% of the ranked library, mean) 2.69Enrichment factor (5% of the ranked library, median) 2.17
Not reported
RTMScorerescoring of AF3 top-ranked posesmachine learningNot reportedNot reported22.420.5% of the ranked library, meanAUROC (AUROC, mean) 0.865AUROC (AUROC, median) 0.906Bedroc (80.5, mean) 0.674Bedroc (80.5, median) 0.787
5 more valuesEnrichment factor (0.5% of the ranked library, median) 26.57Enrichment factor (1% of the ranked library, mean) 21.34Enrichment factor (1% of the ranked library, median) 26.23Enrichment factor (5% of the ranked library, mean) 12.34Enrichment factor (5% of the ranked library, median) 13.00
Not reportedNot reported
Show all 45 rowsShow the top 10 rows only
Caveats and method

What each column measures:

  • DEKOIS 2.0, built-in co-folding scores against docking tools (24 arms): AUROC, BEDROC (alpha = 80.5) and enrichment factors at 0.5%, 1% and 5%, mean and median over 79 DEKOIS 2.0 targets
  • DEKOIS 2.0, rescoring of Protenix-predicted complexes (13 arms): AUROC, BEDROC (alpha = 80.5) and enrichment factors at 0.5%, 1% and 5%, mean and median over 79 DEKOIS 2.0 targets
  • DEKOIS 2.0, rescoring of AF3-predicted complexes (10 arms): AUROC, BEDROC (alpha = 80.5) and enrichment factors at 0.5%, 1% and 5%, mean and median over 79 DEKOIS 2.0 targets
  • GPCRrecent, 16 targets with post-2022 structures (16 arms): AUROC, BEDROC (alpha = 80.5) and enrichment factors at 0.5%, 1% and 5%, mean and median over 16 GPCR targets
  • GPCRrecent, six targets after the Boltz-2 training cutoff (2 arms): AUROC, BEDROC (alpha = 80.5) and enrichment factors at 0.5%, 1% and 5%, mean and median over six GPCR targets
  • Eight of the 24 arms are values quoted from five other papers, so they were not produced under one common pipeline.
  • The two Boltz-2 affinity arms are flagged by the authors themselves as likely over-estimates from training-data overlap with the databases that source DEKOIS 2.0.
  • Transcribed from the source; no reproduction by Rewire and no human scientific review.
  • No ligand-similarity or pharmacophore baseline is scored on any protocol in this batch, although issue #177 asks for one as the pre-machine-learning comparator alongside docking.
  • Structures the Protein Preparation Wizard could not process were given an extremely low score rather than excluded.
  • The temporal control covers crystal structures only; the authors exclude Boltz-2's affinity module from this analysis because its binding-data training sources overlap the benchmark.
  • AF3 was not run on this set.
  • No docking or rescoring arm was run on these six targets, so there is no baseline to compare against within this protocol.

Protocols: DEKOIS 2.0 screening with co-folding confidence scores against docking tools (Shen et al. 2025 Table 1), DEKOIS 2.0 screening by rescoring Protenix-predicted complexes (Shen et al. 2025 Table 2, Protenix block), DEKOIS 2.0 screening by rescoring AF3-predicted complexes (Shen et al. 2025 Table 2, AF3 block), GPCRrecent screening (16 GPCR targets) (Shen et al. 2025 Table 3), GPCRrecent screening (the six targets whose first structures postdate the Boltz-2 training cutoff) (Shen et al. 2025 Table 3)

Compute cost per compound of co-folding

Proxy evidenceAuthor-reported

Average wall-clock seconds per compound to co-fold a protein-ligand pair, per target and averaged over five targets

Runtime (lower is better), with the other metrics below each value. The best value in each column is highlighted.

ToolFive DEKOIS 2.0 targets, one NVIDIA H100
Boltz-2 (without affinity module)foundation model10.83 s (best in column)DEKOIS 2.0 target a2aRuntime (DEKOIS 2.0 target ar) 6.14 sRuntime (averaged over the five targets) 7.79 sRuntime (DEKOIS 2.0 target cdk2) 7.11 sRuntime (DEKOIS 2.0 target ctsk) 6.05 sRuntime (DEKOIS 2.0 target hdac2) 8.79 s
AF31 sample, timed per compoundfoundation model19.14 sDEKOIS 2.0 target a2aRuntime (DEKOIS 2.0 target ar) 10.64 sRuntime (averaged over the five targets) 12.99 sRuntime (DEKOIS 2.0 target cdk2) 12.82 sRuntime (DEKOIS 2.0 target ctsk) 6.70 sRuntime (DEKOIS 2.0 target hdac2) 15.66 s
Protenix1 sample, timed per compoundfoundation model20.09 sDEKOIS 2.0 target a2aRuntime (DEKOIS 2.0 target ar) 9.46 sRuntime (averaged over the five targets) 12.38 sRuntime (DEKOIS 2.0 target cdk2) 10.47 sRuntime (DEKOIS 2.0 target ctsk) 8.49 sRuntime (DEKOIS 2.0 target hdac2) 13.41 s
Boltz-2foundation model21.48 sDEKOIS 2.0 target a2aRuntime (DEKOIS 2.0 target ar) 15.43 sRuntime (averaged over the five targets) 17.77 sRuntime (DEKOIS 2.0 target cdk2) 16.83 sRuntime (DEKOIS 2.0 target ctsk) 16.17 sRuntime (DEKOIS 2.0 target hdac2) 18.93 s
AF35 samples, timed per compoundfoundation model26.34 sDEKOIS 2.0 target a2aRuntime (DEKOIS 2.0 target ar) 15.36 sRuntime (averaged over the five targets) 18.42 sRuntime (DEKOIS 2.0 target cdk2) 17.48 sRuntime (DEKOIS 2.0 target ctsk) 10.28 sRuntime (DEKOIS 2.0 target hdac2) 22.63 s
Protenix5 samples, timed per compoundfoundation model45.83 sDEKOIS 2.0 target a2aRuntime (DEKOIS 2.0 target ar) 29.70 sRuntime (averaged over the five targets) 34.58 sRuntime (DEKOIS 2.0 target cdk2) 31.80 sRuntime (DEKOIS 2.0 target ctsk) 30.01 sRuntime (DEKOIS 2.0 target hdac2) 35.56 s
Caveats and method
  • MSA construction is excluded: pre-computed MSAs were fed as input, so these are inference times only.
  • No docking tool was timed, so the table does not compare co-folding cost with docking cost.
  • Single measurements on five targets with no repeats or uncertainty; the authors note that runtime varies substantially with token length and other factors.
  • Transcribed from the source; no reproduction by Rewire and no human scientific review.
  • No ligand-similarity or pharmacophore baseline is scored on any protocol in this batch, although issue #177 asks for one as the pre-machine-learning comparator alongside docking.

Protocol: Co-folding time per compound on five DEKOIS 2.0 targets (Shen et al. 2025 Table 5)

Held for review

Recorded but not shown as evidence until the reason below is resolved.

Retrospective enrichment where the inactives were measured

Withheld: a cited source is unchecked or has evidence concerns; a reviewed evaluation is no longer eligible (hitdisc-20261022-eval-litpcba5-boltz2-iptm, hitdisc-20261022-eval-litpcba5-boltz2-minipae, hitdisc-20261022-eval-litpcba5-dock-glide-sp, hitdisc-20261022-eval-litpcba5-dock-gnina-cnnaffinity, hitdisc-20261022-eval-litpcba5-dock-gnina-cnnscore); no evaluation on the protocol is eligible evidence.

Not covered yet

  • No protocol in this store scores a ligand-similarity or pharmacophore search as a pre-machine-learning baseline, although issue #177 asks for one alongside docking. Lam et al. 2024 print IFP and GRIM rows on LIT-PCBA but quote them from third parties.
  • No DUD-E evaluation is extracted. DUD-E is registered with its composition and the Chen et al. 2019 bias finding, but no result on it is recorded.
  • No MF-PCBA evaluation is extracted, so the Boltzina and Boltz-2 affinity-head fine-tuning results on measured PubChem dose-response data (arXiv:2508.17555 and arXiv:2609.24302) remain outside the store; only their abstracts were seen in the search pass.
  • The hit-rate curves, semi-logarithmic ROC curves and early-enrichment values for the three Kim et al. docking hit lists are published only as figures and were not read.
  • Kawano et al. 2026 report a measured 70% hit rate (28 of 40) at 10 uM for Boltz-2 on an Enamine diversity set, with no docking arm and after score and diversity filtering from a pre-curated library; the authors state it is not an unbiased estimate. It was not extracted in this pass.
  • DockM8 (Hamza et al. 2026) reports median relative enrichment across DEKOIS 2.0, DUD-E and LIT-PCBA with an AVE-split generalisation check, and Lam et al. 2024 report a sequence-only screening model with a homology-removed zero-shot arm. Neither was extracted; both carry docking baselines on the same data.
  • CACHE #1 and #2 are not open access and were not retrieved, so two of the three rounds of the best prospective benchmark are missing and nothing here shows whether the CACHE #3 ordering holds across targets.
  • The paper relating library size and number tested to hit rate (doi 10.1038/s41589-024-01797-w) is not open access and was not retrieved, so the second half of the question, how many compounds must be tested, rests only on the tested denominators recorded here.
  • No compute-per-compound figure is recorded for any docking tool, so the cost comparison between co-folding and docking is one-sided.
  • The DEKOIS 2.0, LIT-PCBA and TocoDecoy primary papers are closed access and were not retrieved; their composition is recorded as Shen et al. 2025 and the official LIT-PCBA page describe it.
  • Qualified human scientific review is outstanding; automated transcription does not establish replication.

Contribute evidence or propose a correction

Question, sources and review

Who this is for, setting and exclusions

Choose the method that will rank a compound library for one protein target, and decide how many top-ranked compounds to synthesise and test.

Who this is for
  • Computational chemists choosing a scoring method before committing a library screen to synthesis and assay
  • Project teams deciding how many top-ranked compounds to buy or make, and what hit rate to expect
  • Method developers who need to know which screening benchmarks can still distinguish methods
Biological setting
Early hit discovery for a single protein target with a known or predictable structure. The endpoint is the ranking of a library, not the accuracy of one complex: an enrichment factor at a stated fraction of the list, or a measured count of confirmed hits with its denominator. Retrospective benchmarks score a method against a curated set of actives and negatives; prospective campaigns measure what was found when compounds were actually synthesised and assayed. The two answer different questions and are kept apart.
Research setting
Research use only. Nothing here supports a clinical decision, and no compound named in the cited sources is a medicine.

Outside this use case

  • Pose accuracy and binding-mode reproduction, including the Mac1 co-folding pose benchmark and the CASF-2016 docking power protocols already in this store
  • Affinity prediction and scoring-power correlation, including CASF-2016 scoring and ranking power
  • Lead optimisation and hit-to-lead potency improvement, which is a separate use case
  • De novo molecule generation and library design
  • Target identification and target validation
  • Any recommendation for clinical or therapeutic use
Evidence collection plan

Evidence collection plan

Collection planned

Already on record: 4 comparisons shown · 1 held for review · 42 tools, in the evaluated evidence above. The status above describes only the specific comparison in this plan, which remains open; it does not mean no evidence has been collected. The plan defines a comparison to investigate; it does not establish model performance or suitability.

Comparison question

On one library whose negatives were all assayed, and on targets whose structures and ligands postdate every method's training data, does any machine-learning score rank true actives above the compounds a docking screen already ranked highly?

Baselines, outcomes and validation requirements

Baselines to include

  • AutoDock Vina and Glide SP on the same library and target
  • A ligand-similarity search (ECFP4 nearest neighbour to known actives) on the same library

Outcomes to measure

  • Enrichment factor at 0.5%, 1% and 5% with the actives-to-inactives ratio recorded
  • Confirmed hits among a fixed number of top-ranked compounds, with the denominator
  • Compute seconds per compound on named hardware

Validation requirements

  • Negatives that were assayed, not generated
  • Targets and ligands dated after every scored model's training cutoff
  • The same library, target and receptor preparation for every arm
  • A ligand-similarity baseline alongside docking

Next collection task

Extract the DockM8 relative-enrichment tables and the Lam et al. 2024 zero-shot rows, which already carry docking baselines on DEKOIS 2.0, DUD-E and LIT-PCBA, before considering a Rewire run.

Sources, review and downloads

Automated source review · 2026-10-22 · Claude review agent, independent of the extraction agent; no human review claimed

Record checked against the pinned source and the record contract. Transcription checked; not reproduced and not reviewed by a human scientist.

Release 2026-10-22-1b7cf027e4f6 · question use-case-hit-discovery-virtual-screening

Use-case input digest 99e60ea7a46185ebf28288166b0774bb6aa7fc512cb8be19b6f1ae684d18f771

Download questions and review metadata (JSON) (gzip) · Verify release checksums (gzip)