rewirebio.iobenchmarks
Configuration

Adaptyv EGFR competition round 1 selected submissions

The 201 round-1 submissions Adaptyv selected for testing: the top 100 by interface predicted aligned error from AlphaFold2-Multimer plus 101 chosen by hand from 726 submissions.

2 evaluations · 4 results

Overview

An explanatory profile has not yet been reviewed for this record.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Evaluations and results

2 evaluations · 4 results. Different protocols are not a single leaderboard.

Dataset: Adaptyv EGFR competition round 1 tested designs

Sorted by Count (novel binders confirmed by BLI; two further binders were disqualified for similarity to an existing EGFR binder) (higher is better). The best value in each column is highlighted. Decimals are rounded for display; each value links to the printed value and its source.

Tested configurationProtocol and datasetCount (novel binders confirmed by BLI; two further binders were disqualified for similarity to an existing EGFR binder)Hit rate (designs confirmed as binders by BLI, out of designs selected for testing, as stated in Section 4.2; Section 2.4 prints 2.5% (5/201) for the same round)Hit rate (novel binders confirmed by BLI, out of designs selected for testing; excludes two binders later disqualified for similarity to an existing binder)Proportion (designs expressing above the 0.02 microgram per millilitre threshold, out of designs selected for testing)
Adaptyv EGFR competition round 1 selected submissionsEvaluationAdaptyv EGFR competition BLI binding screen5 novel binders (+2 disqualified binders which slipped through the similarity check to existing binders initially)3%2.5% (5/201)Not reported
Adaptyv EGFR competition round 1 selected submissionsEvaluationAdaptyv EGFR competition cell-free expression rateNot reportedNot reportedNot reported73%
All 4 result rows with coverage, uncertainty and sources
Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: Adaptyv EGFR competition round 1 selected submissionsProtocol: Adaptyv EGFR competition BLI binding screen
Dataset: Adaptyv EGFR competition round 1 tested designs
5 novel binders (+2 disqualified binders which slipped through the similarity check to existing binders initially) Count (novel binders confirmed by BLI; two further binders were disqualified for similarity to an existing EGFR binder)
count · higher

Uncertainty: Not applicable: An exact count.

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Adaptyv EGFR competition round 1 binding rate

uc-binder-20261022-protocol-adaptyv-bli-binding

Aggregation: Not reported

Crowdsourced Protein Design: Lessons From the Adaptyv EGFR Binder Competition (Cotet et al., bioRxiv 2025) · Section 2.4: 'Out of these designs, 146 expressed with 5 novel binders (+2 disqualified binders which slipped through the similarity check to existing binders initially).'
Configuration: Adaptyv EGFR competition round 1 selected submissionsProtocol: Adaptyv EGFR competition cell-free expression rate
Dataset: Adaptyv EGFR competition round 1 tested designs
73% Proportion (designs expressing above the 0.02 microgram per millilitre threshold, out of designs selected for testing)
percent · higher

Uncertainty: Not reported by the source: No interval is printed.

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Adaptyv EGFR competition round 1 expression rate

uc-binder-20261022-protocol-adaptyv-expression

Aggregation: Not reported

Crowdsourced Protein Design: Lessons From the Adaptyv EGFR Binder Competition (Cotet et al., bioRxiv 2025) · Section 2.4: 'The expression rate of 73% was about on par for the design methods commonly in the field'
Configuration: Adaptyv EGFR competition round 1 selected submissionsProtocol: Adaptyv EGFR competition BLI binding screen
Dataset: Adaptyv EGFR competition round 1 tested designs
2.5% (5/201) Hit rate (novel binders confirmed by BLI, out of designs selected for testing; excludes two binders later disqualified for similarity to an existing binder)
percent · higher

Uncertainty: Not reported by the source: No interval is printed.

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Adaptyv EGFR competition round 1 binding rate

uc-binder-20261022-protocol-adaptyv-bli-binding

Aggregation: Not reported

Crowdsourced Protein Design: Lessons From the Adaptyv EGFR Binder Competition (Cotet et al., bioRxiv 2025) · Section 2.4: 'previous work on de novo binders to EGFR achieved an 0.01% hit rate versus the 2.5% (5/201) we had observed in R1'
Configuration: Adaptyv EGFR competition round 1 selected submissionsProtocol: Adaptyv EGFR competition BLI binding screen
Dataset: Adaptyv EGFR competition round 1 tested designs
3% Hit rate (designs confirmed as binders by BLI, out of designs selected for testing, as stated in Section 4.2; Section 2.4 prints 2.5% (5/201) for the same round)
percent · higher

Uncertainty: Not reported by the source: No interval is printed.

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Adaptyv EGFR competition round 1 binding rate

uc-binder-20261022-protocol-adaptyv-bli-binding

Aggregation: Not reported

Crowdsourced Protein Design: Lessons From the Adaptyv EGFR Binder Competition (Cotet et al., bioRxiv 2025) · Section 4.1: 'from 3% in the first round to 13% (Figure 8)'

Source checking is not independent reproduction. Release 2026-10-22-1b7cf027e4f6.

Use this configuration

How it works, versions and access
Strengths, limitations and unresolved questions

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-10-22-1b7cf027e4f6
Property and statementOriginal source and locationReview and provenance

No evidence rows match these filters. Choose another scope or clear the search.

Sources and history

Release 2026-10-22-1b7cf027e4f6 · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: uc-binder-20261022-config-adaptyv-crowd-r1

areas
proteins-complexes; protein-structure
contexts
research
method types
specialist
access reuse
Entrant designs, tested by a third-party laboratory.
foundation model eligible
false
limitations
Half the tested set was hand-picked by the organisers to increase diversity across design methods, so it is not a sample of any method's output.
method role
pooled submissions
parameters
726 submissions from about 50 designers; sequences under 200 residues, at least 10 residues from a published binder, natural amino acids and single chain; ranked by interface predicted aligned error (iPAE) from AlphaFold2-Multimer
reported name
R1
review
artifact sha256: 17039d69ecc37f45f6c402511b8f4497ce631003689fa95ad1ab221f8f787a4f; method: source-hash-verification; independent-cell-check; ai-assisted-source-review; method note: Re-downloaded (HTTP 200, 493,217 bytes, the same byte count as the pinned retrieval) but the SHA-256 differs, as expected for a mutable bioRxiv page whose hash describes one retrieval. Every extracted value and every quoted sentence was then located verbatim in the new retrieval, so the difference is in page furniture and not in the evidence. One section attribution and one quotation were corrected.; note: Reviewed in docs/reviews/use-cases/binder-2026-10-22.md. Automated AI review of the source transcription only; it is not human scientific review and nothing here was reproduced experimentally.; retrieval url: https://www.biorxiv.org/content/10.1101/2025.04.17.648362v1.full; reviewed at: 2026-10-22T15:00:00Z; reviewer: claude; reviewer note: Claude review agent, independent of the extraction agent; no human review claimed
selection
Top 100 by iPAE plus 101 selected by hand, from 726 submissions.
source locator
Sections 2.1, 2.2 and 2.4
version
Adaptyv EGFR Binder Design Competition round 1
Related records

Suggest a correction