rewirebio.iobenchmarks

Use caseProteins and complexesResearch only

Design a new binder to a chosen target

Which computational design workflow produces binders that work when they are made and tested?

You bring
  • A target structure or a structure prediction, and the epitope or hotspot residues to target
  • Whether the target has a known binder or a solved complex, which decides whether this is a cold start
  • The binder modality required: miniprotein, antibody variable domain, nanobody or peptide
  • A synthesis and assay budget, and the assay that will define a hit
  • Expression, solubility and format constraints on the designs that can be tested
You want
A design workflow choice and a testing plan, with the share of designs expected to bind at a stated assay threshold, the affinities reached, and the number of designs that must be made to get there.
Evidence in this release
0 comparisons shown · 14 held for review
Kept up to date
Evidence last checked 22 October 2026 · re-checked monthly, next due 22 November 2026

Comparisons

Each table is one study or protocol with its own truth set and scoring. Compare tools within a table, not across tables.

No model comparison has been collected for this question yet.

Relevant methods and studies may exist outside this collection.

Held for review

Recorded but not shown as evidence until the reason below is resolved.

Affinity of the best binder found per target

Withheld: a cited source is unchecked or has evidence concerns; a source the use case cites is unchecked or has evidence concerns; protocol evidence is disputed or unchecked; a reviewed evaluation is no longer eligible (uc-binder-20261022-eval-adaptyv-bindcraft-r1-affinity, uc-binder-20261022-eval-adaptyv-bindcraft-r2-affinity, uc-binder-20261022-eval-adaptyv-cradle-r2-affinity); no evaluation on the protocol is eligible evidence.

One target, one assay, many methods (EGFR)

Withheld: a cited source is unchecked or has evidence concerns; a source the use case cites is unchecked or has evidence concerns; protocol evidence is disputed or unchecked; a reviewed evaluation is no longer eligible (uc-binder-20261022-eval-adaptyv-bindcraft-gb1-binding, uc-binder-20261022-eval-adaptyv-both-binding, uc-binder-20261022-eval-adaptyv-r1-binding, uc-binder-20261022-eval-adaptyv-r2-binding); no evaluation on the protocol is eligible evidence.

Attrition between a screen hit and a confirmed binder

Withheld: a cited source is unchecked or has evidence concerns; a source the use case cites is unchecked or has evidence concerns; protocol evidence is disputed or unchecked; a reviewed evaluation is no longer eligible (uc-binder-20261022-eval-adaptyv-bindcraft-gb1-expression, uc-binder-20261022-eval-adaptyv-bindcraft-r1-expression, uc-binder-20261022-eval-adaptyv-bindcraft-r2-expression, uc-binder-20261022-eval-adaptyv-r1-expression, uc-binder-20261022-eval-adaptyv-r2-expression); no evaluation on the protocol is eligible evidence.

Attrition between a screen hit and a confirmed binder

Withheld: a cited source is unchecked or has evidence concerns; a source the use case cites is unchecked or has evidence concerns; protocol evidence is disputed or unchecked; a reviewed evaluation is no longer eligible (uc-binder-20261022-eval-alphaproteo-s3-observed-htrf-binding-bhrf1, uc-binder-20261022-eval-alphaproteo-s3-observed-htrf-binding-il17a, uc-binder-20261022-eval-alphaproteo-s3-observed-htrf-binding-il7ra, uc-binder-20261022-eval-alphaproteo-s3-observed-htrf-binding-pdl1, uc-binder-20261022-eval-alphaproteo-s3-observed-htrf-binding-sc2rbd); no evaluation on the protocol is eligible evidence.

Affinity of the best binder found per target

Withheld: a cited source is unchecked or has evidence concerns; a source the use case cites is unchecked or has evidence concerns; protocol evidence is disputed or unchecked; a reviewed evaluation is no longer eligible (uc-binder-20261022-eval-alphaproteo-s2-kd-rfdiffusion-published-designs-il7ra-main, uc-binder-20261022-eval-alphaproteo-s2-kd-rfdiffusion-published-designs-pdl1-main, uc-binder-20261022-eval-alphaproteo-s2-kd-rfdiffusion-published-designs-trka-main, uc-binder-20261022-eval-alphaproteo-s2-kd-v1-bhrf1-main, uc-binder-20261022-eval-alphaproteo-s2-kd-v1-il17a-main); no evaluation on the protocol is eligible evidence.

Miniprotein binder hit rates by target

Withheld: a cited source is unchecked or has evidence concerns; a source the use case cites is unchecked or has evidence concerns; protocol evidence is disputed or unchecked; a reviewed evaluation is no longer eligible (uc-binder-20261022-eval-alphaproteo-s2-rate-rfdiffusion-published-designs-il7ra-main, uc-binder-20261022-eval-alphaproteo-s2-rate-rfdiffusion-published-designs-pdl1-main, uc-binder-20261022-eval-alphaproteo-s2-rate-rfdiffusion-published-designs-trka-main, uc-binder-20261022-eval-alphaproteo-s2-rate-v1-bhrf1-main, uc-binder-20261022-eval-alphaproteo-s2-rate-v1-il7ra-main); no evaluation on the protocol is eligible evidence.

Miniprotein binder hit rates by target

Withheld: a cited source is unchecked or has evidence concerns; a source the use case cites is unchecked or has evidence concerns; protocol evidence is disputed or unchecked; a reviewed evaluation is no longer eligible (uc-binder-20261022-eval-alphaproteo-s2-rate-v1-il17a-main, uc-binder-20261022-eval-alphaproteo-table1-rate-il17a); no evaluation on the protocol is eligible evidence.

Computational filters used to choose which designs to test

Withheld: protocol evidence is disputed or unchecked; a reviewed evaluation is no longer eligible (uc-binder-20261022-eval-bennett-h1stem-spr-insilico-af3-af3, uc-binder-20261022-eval-bennett-h1stem-ysd-insilico-af3-af3, uc-binder-20261022-eval-bennett-il7r-spr-insilico-af3-af3, uc-binder-20261022-eval-bennett-rbd-ysd-insilico-af3-af3, uc-binder-20261022-eval-bennett-rsv3-ysd-insilico-af3-af3).

Computational filters used to choose which designs to test

Withheld: protocol evidence is disputed or unchecked; a reviewed evaluation is no longer eligible (uc-binder-20261022-eval-bennett-h1stem-spr-insilico-rf2-0-0, uc-binder-20261022-eval-bennett-h1stem-spr-insilico-rf2-0-1, uc-binder-20261022-eval-bennett-h1stem-spr-insilico-rf2-1, uc-binder-20261022-eval-bennett-h1stem-ysd-insilico-rf2-0-0, uc-binder-20261022-eval-bennett-h1stem-ysd-insilico-rf2-0-1).

Antibody variable-domain hit rates by target

Withheld: a cited source is unchecked or has evidence concerns; a source the use case cites is unchecked or has evidence concerns; protocol evidence is disputed or unchecked; a reviewed evaluation is no longer eligible (uc-binder-20261022-eval-bennett-h1stem-spr, uc-binder-20261022-eval-bennett-il7r-spr, uc-binder-20261022-eval-bennett-tcdb-spr); no evaluation on the protocol is eligible evidence.

Antibody variable-domain hit rates by target

Withheld: a cited source is unchecked or has evidence concerns; a source the use case cites is unchecked or has evidence concerns; protocol evidence is disputed or unchecked; a reviewed evaluation is no longer eligible (uc-binder-20261022-eval-bennett-h1stem-ysd, uc-binder-20261022-eval-bennett-rbd-ysd, uc-binder-20261022-eval-bennett-rsv3-ysd); no evaluation on the protocol is eligible evidence.

Affinity of the best binder found per target

Withheld: a cited source is unchecked or has evidence concerns; a source the use case cites is unchecked or has evidence concerns; protocol evidence is disputed or unchecked; a reviewed evaluation is no longer eligible (uc-binder-20261022-eval-bindcraft-affinity-bbf14, uc-binder-20261022-eval-bindcraft-affinity-betv1, uc-binder-20261022-eval-bindcraft-affinity-cbago, uc-binder-20261022-eval-bindcraft-affinity-cd45, uc-binder-20261022-eval-bindcraft-affinity-crsas6); no evaluation on the protocol is eligible evidence.

Miniprotein binder hit rates by target

Withheld: a cited source is unchecked or has evidence concerns; a source the use case cites is unchecked or has evidence concerns; protocol evidence is disputed or unchecked; a reviewed evaluation is no longer eligible (uc-binder-20261022-eval-bindcraft-screen-bbf14, uc-binder-20261022-eval-bindcraft-screen-betv1, uc-binder-20261022-eval-bindcraft-screen-cbago, uc-binder-20261022-eval-bindcraft-screen-cd45, uc-binder-20261022-eval-bindcraft-screen-cldn1); no evaluation on the protocol is eligible evidence.

Miniprotein binder hit rates by target

Withheld: a cited source is unchecked or has evidence concerns; a source the use case cites is unchecked or has evidence concerns; protocol evidence is disputed or unchecked; a reviewed evaluation is no longer eligible (uc-binder-20261022-eval-bindcraft-aggregate-12-targets); no evaluation on the protocol is eligible evidence.

Not covered yet

  • No conventional comparator exists in the retrieved evidence. Not one of the sources runs directed evolution, library display selection or grafting from a known complex on the same targets as a design method, with the same expression and assay pipeline and the same hit definition. This is the primary gap and it cannot be closed by extracting more of these papers; it needs a pass over the display and directed-evolution literature, or a measurement.
  • No source anywhere runs two design methods and a conventional comparator on the same targets with one assay and one hit definition, so the use case's own question cannot currently be answered.
  • BenchBB (benchbb.bio) was not retrieved. Its seven-target list, protocol, assay and whether any method has been run on it are unknown, and no results on BenchBB were found for any method.
  • ProtDBench (arXiv:2605.04118 v2) was not retrieved; only its abstract was read in the search pass. It is the only candidate standing benchmark for binder design found, and nothing is claimed about it here.
  • The single-target binder design literature was not retrieved. The search pass surfaced a large population of one-off papers, each reporting a hit rate for one target with its own assay (Francisella virulence factor, deltacoronavirus, Nipah, Langya and measles receptor-binding domains, GDF15-GFRAL, RH5, canine and human TNF-alpha, HSP90, CCL25, BRD3). Taken together they are the largest untapped pool of measured outcomes and the place where publication bias will be worst.
  • Adaptyv per-method and per-category hit rates were not extracted. The round 2 repository publishes one row per design with a binding flag and an affinity, but neither the repository nor the paper states an aggregation over those rows, the method labels are entrants' free text, and the three binding thresholds behind the Figure 8 counts are never defined.
  • The Adaptyv round 1 repository, raw kinetic curve package, neutralisation package and structure predictions were not retrieved, and the 60 measured affinities in Figure 10 were not read.
  • BindCraft's per-target numerators for CrSAS-6 and CbAgo were not obtained. They are printed only inside the Figure 1b graphic, which was not read, and Supplementary Data 1 does not let them be recomputed: the row filter that reconciles with the prose for nine targets fails for PD-L1, CrSAS-6 and CbAgo.
  • BoltzGen (bioRxiv 10.1101/2025.11.20.689494) Tables 2 and 3 were not extracted. It reports a cold-start against warm-start split (6 of 9 novel targets against 4 of 5 benchmark targets with known binders) that is exactly the protocol limit the use case needs, and some of its data are stated to be temporarily confidential.
  • Filius et al. 2025 (ACS Chem Biol 10.1021/acschembio.5c00774) Supporting Information Table S3 was not extracted. It is a third-party wet-lab test of BindCraft on four targets that reports the two targets which failed outright, which is the kind of independent evidence this use case is shortest of.
  • The Nature Communications minibinder paper (doi 10.1038/s41467-026-76760-5) was not extracted. It is the closest thing found to an independent replication: one group, one assay, three targets of differing difficulty with the same method.
  • PXDesign's own measured values (bioRxiv 10.1101/2025.08.15.670450, Tables 1 and 2) were not extracted. Its baseline column is deliberately excluded: those numbers are copied from publications and partly adjusted by the PXDesign authors using their own HTRF data, which is a third party's reanalysis.
  • The values in AlphaProteo's 'Other design methods' rows and its 'RFdiffusion (published)' row are recorded only as a transcription claim, not as results, for the same reason: they are copied from publications this pass did not retrieve, and Section S4.2 states that the asterisked values were re-measured by the AlphaProteo authors and that for PD-L1 they substituted a different design for the published best one. The primary sources behind those cells (Procko et al., Gainza et al., Cao et al., Berger et al., Yang et al., Watson et al.) were not retrieved.
  • Junker and Schoeder 2026 (PLOS ONE 10.1371/journal.pone.0355549) is the most careful cross-method comparison found and has no wet-lab arm, so it supplies no outcome. Nanda 2026 (doi 10.21203/rs.3.rs-11106209/v1) on amyloid fibrils is likewise in silico only. Amyloid fibrils and GPCR peptide targets are target classes for which no measured binder design outcome was found at all.
  • No source reports uncertainty for any hit rate or affinity. Every rate in this use case is a point value over a denominator between 6 and 9,000, with no interval.
  • No source connects a designed binder to a downstream outcome such as efficacy, developability or manufacturability.
  • Automated source review only. Independent human scientific review remains outstanding, and nothing here has been experimentally replicated.

Contribute evidence or propose a correction

Evidence collection plan

Collection planned

Evidence collection is planned for this question. The plan defines a comparison to investigate; it does not establish model performance or suitability.

Comparison question

On the same targets, with one expression and assay pipeline and one hit definition, how does the share of designs that bind differ between two design workflows and a conventional comparator at the same testing budget?

Baselines, outcomes and validation requirements

Baselines to include

  • Directed evolution or library display selection from a naive library on the same target
  • Grafting from a solved complex with a known binder, where one exists

Outcomes to measure

  • Share of designs that bind at a single stated threshold on one assay, with the denominator
  • Affinity distribution of the binders found, not only the best one
  • The full funnel: designs generated, ordered, expressed, assayed and confirmed
  • Designs that had to be made per binder obtained, at a fixed budget

Validation requirements

  • Fix the hit definition before the comparison and apply it to every arm.
  • Separate the design step from the selection step: report the rate over a random sample of generated designs as well as over the filter's top picks.
  • Match the targets across arms and state for each whether it has a known binder or a solved complex.
  • Report the denominator and an interval for every rate.
  • Keep modalities apart: miniprotein, antibody variable domain and peptide results are not interchangeable.

Next collection task

Retrieve BenchBB and ProtDBench to establish whether a standing binder design benchmark with a fixed hit definition exists, and run a separate literature pass for conventional display and directed-evolution arms on any target that a design paper also reports.

Question, sources and review

Who this is for, setting and exclusions

Choose a computational design workflow for a new target, and decide how many designs to synthesise and assay.

Who this is for
  • Protein engineers choosing a design workflow for a new target
  • Structural and molecular biologists who need a reagent-grade binder to a specific epitope
  • Groups deciding how many designs to synthesise and assay for a given budget
Biological setting
Research protein engineering for one target at a time. Miniprotein, antibody variable-domain and peptide binders require separate comparisons; a rate measured on one modality does not transfer to another.
Research setting
Research only. A measured binding outcome does not establish efficacy, developability, immunogenicity or clinical suitability, and nothing here supports any therapeutic use of a designed binder.

Outside this use case

  • Hit definitions are not commensurable across these sources. A yeast-display flow-cytometry signal above 0.2, a BLI KD below 1000 nM, an SPR response at half the positive control, and 'nanomolar with a human serum albumin counter-screen' are four different endpoints, and the hit rate moves by tens of percentage points depending on which is used.
  • Denominators are small and author-selected, and the designs tested are the top-ranked ones by each method's own filter, so the design step and the selection step are coupled. Changing only the filter moved AlphaProteo's PD-L1 rate from 9.6% over 94 designs to 16.1% over 31.
  • The spread within a single method across targets is wider than any plausible difference between methods: AlphaProteo 0% to 88%, BindCraft 10% to 100%, Bennett 0% to 2% for antibodies. A method ranking built from these numbers would mostly be measuring which targets each group chose.
  • No source includes a conventional comparator (directed evolution, library display selection or grafting from a known complex) on the same targets as a design method. Cetuximab's 9.94 nM in the Adaptyv assay is a positive control for assay validity, not a comparator arm: no candidate set was tested and there is no denominator behind it.
  • The evidence here does not support a workflow recommendation. It supports per-method, per-target statements about what happened when designs were made and tested.
  • An in silico score (interface predicted aligned error, ipTM, predicted local distance difference test, self-consistency RMSD) is a filter inside the pipeline, not an outcome. Filter pass rates are recorded as outside the use case's endpoint.
  • Almost all of the measured evidence is author-reported by the group that built the method. Only the Adaptyv competition measurements are independent of the design methods, and they are on one target with no hit definition printed.
  • Research only. None of this evidence establishes therapeutic efficacy, developability or clinical suitability for any designed binder.
  • A headline average in these papers cannot always be tied back to the per-target numbers the same paper prints. BindCraft reports an average experimental success rate of 46.3% over twelve targets, and that figure cannot be reproduced from its own printed per-target counts under either an unweighted mean over targets or a pooled rate over designs, for any integer numerators of the two targets whose numerators appear only inside a figure. The gap is about a tenth of a percentage point, so it is a minor inconsistency rather than a wrong headline, but it is a further reason not to compare one paper's average against another's: the basis of the average is not always stated and not always recoverable.
Sources, review and downloads

Automated source review · 2026-10-22 · Claude review agent, independent of the extraction agent; no human review claimed

Reviewed in docs/reviews/use-cases/binder-2026-10-22.md. Automated AI review of the source transcription only; it is not human scientific review and nothing here was reproduced experimentally.

Release 2026-10-22-1b7cf027e4f6 · question use-case-de-novo-binder-design

Use-case input digest 99e60ea7a46185ebf28288166b0774bb6aa7fc512cb8be19b6f1ae684d18f771

Download questions and review metadata (JSON) (gzip) · Verify release checksums (gzip)