rewirebio.iobenchmarks
Source

Kim, Correy, Hall et al. 2026, eLife 15:RP110475 (Europe PMC full text)

PMC13657626 (eLife 2026;15:RP110475, version of record published 2026-10-12) · Peer-reviewed

DOI: 10.7554/eLife.110475Original source

What this source contributed

Records in this release that cite this source. A record can cite several sources.

Results

Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.

ValueMetricModel or configurationDatasetEvaluation
AUC = 60.5 unitlessAUROC (Discrimination of measured binders from high-ranking docking false positives in the tested AmpC beta-lactamase hit list)AF3 L-pLDDT (Kim, Correy, Hall et al. 2026 hit-list re-ranking)AmpC beta-lactamase docking hit list, 1293 tested compoundsAF3 L-pLDDT re-ranking the AmpC beta-lactamase docking hit list (Kim, Correy, Hall et al. 2026)
AUC = 46.4 unitlessAUROC (Discrimination of measured binders from high-ranking docking false positives in the tested dopamine D4 receptor hit list)AF3 L-pLDDT (Kim, Correy, Hall et al. 2026 hit-list re-ranking)Dopamine D4 receptor docking hit list, 541 tested compoundsAF3 L-pLDDT re-ranking the dopamine D4 receptor docking hit list (Kim, Correy, Hall et al. 2026)
AUC = 56.1 unitlessAUROC (Discrimination of measured binders from high-ranking docking false positives in the tested sigma-2 receptor hit list)AF3 L-pLDDT (Kim, Correy, Hall et al. 2026 hit-list re-ranking)Sigma-2 receptor docking hit list, 506 tested compoundsAF3 L-pLDDT re-ranking the sigma-2 receptor docking hit list (Kim, Correy, Hall et al. 2026)
AUC = 68.1 unitlessAUROC (Discrimination of measured binders from high-ranking docking false positives in the tested AmpC beta-lactamase hit list)Boltz-2 pIC50 (Kim, Correy, Hall et al. 2026 hit-list re-ranking)AmpC beta-lactamase docking hit list, 1293 tested compoundsBoltz-2 pIC50 re-ranking the AmpC beta-lactamase docking hit list (Kim, Correy, Hall et al. 2026)
AUC ~ 71 unitlessAUROC (Discrimination of measured binders from high-ranking docking false positives in the tested dopamine D4 receptor hit list)Boltz-2 pIC50 (Kim, Correy, Hall et al. 2026 hit-list re-ranking)Dopamine D4 receptor docking hit list, 541 tested compoundsBoltz-2 pIC50 re-ranking the dopamine D4 receptor docking hit list (Kim, Correy, Hall et al. 2026)
AUC = 83.8 unitlessAUROC (Discrimination of measured binders from high-ranking docking false positives in the tested sigma-2 receptor hit list)Boltz-2 pIC50 (Kim, Correy, Hall et al. 2026 hit-list re-ranking)Sigma-2 receptor docking hit list, 506 tested compoundsBoltz-2 pIC50 re-ranking the sigma-2 receptor docking hit list (Kim, Correy, Hall et al. 2026)
AUC = 76.5 unitlessAUROC (Discrimination of measured binders from high-ranking docking false positives in the tested AmpC beta-lactamase hit list)DOCK3.7 (Kim, Correy, Hall et al. 2026 hit-list re-ranking)AmpC beta-lactamase docking hit list, 1293 tested compoundsDOCK3.7 energy re-ranking the AmpC beta-lactamase docking hit list (Kim, Correy, Hall et al. 2026)
AUC ~ 71 unitlessAUROC (Discrimination of measured binders from high-ranking docking false positives in the tested dopamine D4 receptor hit list)DOCK3.7 (Kim, Correy, Hall et al. 2026 hit-list re-ranking)Dopamine D4 receptor docking hit list, 541 tested compoundsDOCK3.7 energy re-ranking the dopamine D4 receptor docking hit list (Kim, Correy, Hall et al. 2026)
AUC = 78.8 unitlessAUROC (Discrimination of measured binders from high-ranking docking false positives in the tested sigma-2 receptor hit list)DOCK3.7 (Kim, Correy, Hall et al. 2026 hit-list re-ranking)Sigma-2 receptor docking hit list, 506 tested compoundsDOCK3.7 energy re-ranking the sigma-2 receptor docking hit list (Kim, Correy, Hall et al. 2026)

Claims

Statements this source supports, each with where in the source it was checked.

  • Relevance of hitdisc-20261022-protocol-kim-ampc to use-case-hit-discovery-virtual-screening: Assessed by Re-ranking the AmpC beta-lactamase docking hit list by co-folding and docking scores (Kim, Correy, Hall et al. 2026) (hitdisc-20261022-protocol-kim-ampc: see its source_locator)
  • Relevance of hitdisc-20261022-protocol-kim-d4 to use-case-hit-discovery-virtual-screening: Assessed by Re-ranking the Dopamine D4 receptor docking hit list by co-folding and docking scores (Kim, Correy, Hall et al. 2026) (hitdisc-20261022-protocol-kim-d4: see its source_locator)
  • Relevance of hitdisc-20261022-protocol-kim-sigma2 to use-case-hit-discovery-virtual-screening: Assessed by Re-ranking the Sigma-2 receptor docking hit list by co-folding and docking scores (Kim, Correy, Hall et al. 2026) (hitdisc-20261022-protocol-kim-sigma2: see its source_locator)
  • Summary of the evidence for use-case-hit-discovery-virtual-screening: Summary Three sources in this store score machine-learning and co-folding methods against docking on the same screening data, and what the numbers say depends on how the negatives were built. On DEKOIS 2.0, whose 79 targets each pair 40 validated actives with 1,200 property-matched decoys selected from ZINC (1:30), the co-folding confidence scores enrich strongly and beat the docking arms. AF3 min-iPAE gives a mean EF1% of 23.15 and Boltz-2 min-iPAE 22.73, against 12.01 for the Glide SP row quoted from another paper, 5.16 for Gnina Vina and 2.94 for TankBind; the best rescoring of a co-folded pose, RTMScore on AF3 poses, reaches 21.34. The authors flag their own Boltz-2 affinity arms (mean EF1% 23.54 and 25.84) as likely over-estimates because Boltz-2 drew affinity data from the same public databases that source DEKOIS 2.0. On GPCRrecent, 16 targets whose first crystal structures were released after 2022 with decoys generated by a conditional recurrent neural network at 1:50, every value falls and the margin narrows: Boltz-2 min-iPAE gives a mean EF1% of 13.96 against 5.02 for Glide SP and 3.65 for Gnina Vina. On the five LIT-PCBA targets where the inactives were experimentally measured, the margin largely disappears: averaged over the five targets Boltz-2 min-iPAE gives EF1% 9.30 and NEF1% 0.100 against Glide SP's 6.79 and 0.079, and on TP53 both Boltz-2 scores give EF1% 0.00 while Protenix ipTM gives 5.00 and Glide SP 3.75. A separate audit of LIT-PCBA reports 323 active training-validation analogue pairs at ECFP4 Tanimoto at or above 0.6 in ALDH1 alone and 2,491 2D-identical inactives shared between training and validation across targets, and concludes that a parameter-free memorisation baseline matches or exceeds published deep-learning results there, so every LIT-PCBA value above carries that limit. Where the negatives are compounds a docking screen already ranked highly and every compound was synthesised and assayed, the ordering changes. On the AmpC list (247 inhibitors among 1,293 tested compounds from a 1.7-billion molecule screen) DOCK3.7 separates binders best, AUC 76.5, against 68.1 for Boltz-2 pIC50 and 60.5 for AF3 L-pLDDT. On the dopamine D4 list (205 binders among 541) docking and Boltz-2 are indistinguishable at the precision printed (both about 71) and AF3 L-pLDDT is worse than random at 46.4. Only on the sigma-2 list (201 binders among 506) does a co-folding score lead, Boltz-2 pIC50 at 83.8 against DOCK3.7's 78.8, with AF3 L-pLDDT at 56.1. In the one blinded prospective challenge, CACHE #3 on the SARS-CoV-2 Nsp3 macrodomain, 23 workflows selected 1,739 compounds that were synthesised and assayed; 28 advanced to hit expansion and 29 confirmed hits scored above 15, four of them judged chemically novel. Twelve of the 23 workflows returned no confirmed hit from their own selection of 41 to 99 compounds. When every workflow was applied to the same merged 1,739-compound library, WF1696, which the article describes as a purely physics-based method, captured 2 of the 4 Tier 1 and 9 of the 25 Tier 2 confirmed hits from 99 predicted actives, which the authors report as did better than any other method in retrieving hits from the collection of all molecules selected in Round 1. Cost bounds all of this: co-folding one protein-ligand pair takes 7.79 to 34.58 seconds per compound on one NVIDIA H100 with pre-computed MSAs, which is why the LIT-PCBA arm covers five targets rather than fifteen. No docking tool was timed on the same hardware, no ligand-similarity or pharmacophore baseline is scored anywhere in this batch, and no result here estimates the hit rate of an untested library. (Shen et al. 2025 Tables 1-5; Kim, Correy, Hall et al. 2026 Results; Herasymenko et al. 2026 Results and sheet S8; arXiv:2507.21404v2 Abstract)

Models, benchmarks and other records

Methods (1)

Configurations (3)

Protocols (3)

Datasets (3)

Evaluations (9)

Use cases (1)

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

27 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-10-22-1b7cf027e4f6
Property and statementOriginal source and locationReview and provenance
attributes.artifact_sha256
9be510b7b0cc152ff56a03c96877bf06b6a6bdeffdb4baecf8e999a6bf155aa6
Source metadata
Kim, Correy, Hall et al. 2026, eLife 15:RP110475 (Europe PMC full text)

Original source ↗

No field-specific location recorded

Version: PMC13657626 (eLife 2026;15:RP110475, version of record published 2026-10-12)
Retrieved: 2026-10-22T11:52:32Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_sha256

Source artifact SHA-256: 9be510b7b0cc152ff56a03c96877bf06b6a6bdeffdb4baecf8e999a6bf155aa6

Hash scope: Hash scope not separately documented; inspect source record

Doi
10.7554/eLife.110475
Source metadata
Kim, Correy, Hall et al. 2026, eLife 15:RP110475 (Europe PMC full text)

Original source ↗

No field-specific location recorded

Version: PMC13657626 (eLife 2026;15:RP110475, version of record published 2026-10-12)
Retrieved: 2026-10-22T11:52:32Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.doi

Source artifact SHA-256: 9be510b7b0cc152ff56a03c96877bf06b6a6bdeffdb4baecf8e999a6bf155aa6

Hash scope: Hash scope not separately documented; inspect source record

Licence
Creative Commons Attribution License (permissions statement in the retrieved XML)
Source metadata
Kim, Correy, Hall et al. 2026, eLife 15:RP110475 (Europe PMC full text)

Original source ↗

No field-specific location recorded

Version: PMC13657626 (eLife 2026;15:RP110475, version of record published 2026-10-12)
Retrieved: 2026-10-22T11:52:32Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.licence

Source artifact SHA-256: 9be510b7b0cc152ff56a03c96877bf06b6a6bdeffdb4baecf8e999a6bf155aa6

Hash scope: Hash scope not separately documented; inspect source record

Media type
application/xml
Source metadata
Kim, Correy, Hall et al. 2026, eLife 15:RP110475 (Europe PMC full text)

Original source ↗

No field-specific location recorded

Version: PMC13657626 (eLife 2026;15:RP110475, version of record published 2026-10-12)
Retrieved: 2026-10-22T11:52:32Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.media_type

Source artifact SHA-256: 9be510b7b0cc152ff56a03c96877bf06b6a6bdeffdb4baecf8e999a6bf155aa6

Hash scope: Hash scope not separately documented; inspect source record

Publication status
peer_reviewed
Source metadata
Kim, Correy, Hall et al. 2026, eLife 15:RP110475 (Europe PMC full text)

Original source ↗

No field-specific location recorded

Version: PMC13657626 (eLife 2026;15:RP110475, version of record published 2026-10-12)
Retrieved: 2026-10-22T11:52:32Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.publication_status

Source artifact SHA-256: 9be510b7b0cc152ff56a03c96877bf06b6a6bdeffdb4baecf8e999a6bf155aa6

Hash scope: Hash scope not separately documented; inspect source record

Retrieval method
HTTP GET with urllib, no authentication
Source metadata
Kim, Correy, Hall et al. 2026, eLife 15:RP110475 (Europe PMC full text)

Original source ↗

No field-specific location recorded

Version: PMC13657626 (eLife 2026;15:RP110475, version of record published 2026-10-12)
Retrieved: 2026-10-22T11:52:32Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.retrieval_method

Source artifact SHA-256: 9be510b7b0cc152ff56a03c96877bf06b6a6bdeffdb4baecf8e999a6bf155aa6

Hash scope: Hash scope not separately documented; inspect source record

Retrieved at
2026-10-22T11:52:32Z
Source metadata
Kim, Correy, Hall et al. 2026, eLife 15:RP110475 (Europe PMC full text)

Original source ↗

No field-specific location recorded

Version: PMC13657626 (eLife 2026;15:RP110475, version of record published 2026-10-12)
Retrieved: 2026-10-22T11:52:32Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.retrieved_at

Source artifact SHA-256: 9be510b7b0cc152ff56a03c96877bf06b6a6bdeffdb4baecf8e999a6bf155aa6

Hash scope: Hash scope not separately documented; inspect source record

attributes.review.artifact_sha256
9be510b7b0cc152ff56a03c96877bf06b6a6bdeffdb4baecf8e999a6bf155aa6
Source metadata
Kim, Correy, Hall et al. 2026, eLife 15:RP110475 (Europe PMC full text)

Original source ↗

No field-specific location recorded

Version: PMC13657626 (eLife 2026;15:RP110475, version of record published 2026-10-12)
Retrieved: 2026-10-22T11:52:32Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.review.artifact_sha256

Source artifact SHA-256: 9be510b7b0cc152ff56a03c96877bf06b6a6bdeffdb4baecf8e999a6bf155aa6

Hash scope: Hash scope not separately documented; inspect source record

Review: date
2026-10-22
Source metadata
Kim, Correy, Hall et al. 2026, eLife 15:RP110475 (Europe PMC full text)

Original source ↗

No field-specific location recorded

Version: PMC13657626 (eLife 2026;15:RP110475, version of record published 2026-10-12)
Retrieved: 2026-10-22T11:52:32Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.review.date

Source artifact SHA-256: 9be510b7b0cc152ff56a03c96877bf06b6a6bdeffdb4baecf8e999a6bf155aa6

Hash scope: Hash scope not separately documented; inspect source record

Review: method note
Re-downloaded the artifact and matched its SHA-256 against the source record.
Source metadata
Kim, Correy, Hall et al. 2026, eLife 15:RP110475 (Europe PMC full text)

Original source ↗

No field-specific location recorded

Version: PMC13657626 (eLife 2026;15:RP110475, version of record published 2026-10-12)
Retrieved: 2026-10-22T11:52:32Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.review.method_note

Source artifact SHA-256: 9be510b7b0cc152ff56a03c96877bf06b6a6bdeffdb4baecf8e999a6bf155aa6

Hash scope: Hash scope not separately documented; inspect source record

How to read the evidence

Sources and history

Release 2026-10-22-1b7cf027e4f6 · Record review: source checked

Primary source for the re-ranking of three tested ultra-large docking hit lists by AlphaFold3 and Boltz-2 against DOCK3.7 (rewire-benchmark-data #177).

Release history

No supporting source is linked yet.

Read original source

Download this release (gzip)
Technical metadata and extraction receipts

Stable ID: hitdisc-20261022-source-kim2026

areas
molecular-interactions
contexts
research
url
https://www.ebi.ac.uk/europepmc/webservices/rest/PMC13657626/fullTextXML
version
PMC13657626 (eLife 2026;15:RP110475, version of record published 2026-10-12)
retrieved at
2026-10-22T11:52:32Z
artifact sha256
9be510b7b0cc152ff56a03c96877bf06b6a6bdeffdb4baecf8e999a6bf155aa6
publication status
peer_reviewed
licence
Creative Commons Attribution License (permissions statement in the retrieved XML)
source locator
Results 'Co-folding struggles to reliably re-rank docking hit lists'; Methods 'Benchmarking co-folding on experimentally validated compounds', 'Molecular docking of Mac1 compounds', 'Co-folding', 'Hit rate curves for different scoring methods'
retrieval method
HTTP GET with urllib, no authentication
review
method: source-hash-verification; reviewer: claude; reviewer note: Claude review agent, independent of the extraction agent; no human review claimed; date: 2026-10-22; method note: Re-downloaded the artifact and matched its SHA-256 against the source record.; note: Artifact re-downloaded on 2026-10-22 and its SHA-256 matched the pinned value. Content not re-published.; artifact sha256: 9be510b7b0cc152ff56a03c96877bf06b6a6bdeffdb4baecf8e999a6bf155aa6; retrieval url: https://www.ebi.ac.uk/europepmc/webservices/rest/PMC13657626/fullTextXML; receipt: data/omics/use-case-coverage-hitdisc-20261022/review.json
doi
10.7554/eLife.110475
media type
application/xml
Related records

    Suggest a correction