Relevance of uc-binder-20261022-protocol-bennett-insilico-af3-success to "Which computational design workflow produces binders that work when they are made and tested?"
- Use case
- Design a new binder to a chosen target
- Assessed by
- Bennett VHH computational success rate under an AlphaFold3 filter
- Relevance
- outside_scope
- Endpoint
- Share of designed antibody variable heavy chains that pass an AlphaFold3 filter at Ca RMSD below 5 A and ipTM above 0.5
Outside the use case's endpoint, and retrospective: AlphaFold3 was released after the design work. Kept because the paper uses it to argue that a better filter would raise the measured success rate, which is a claim about the selection step that the use case has to keep separate from the design step.
6 reviewed evaluations
- Fine-tuned RFdiffusion VHH computational success rate against H1 stem, AlphaFold3 filter
- Fine-tuned RFdiffusion VHH computational success rate against H1 stem, AlphaFold3 filter
- Fine-tuned RFdiffusion VHH computational success rate against IL7R, AlphaFold3 filter
- Fine-tuned RFdiffusion VHH computational success rate against SARS-CoV-2 RBD, AlphaFold3 filter
- Fine-tuned RFdiffusion VHH computational success rate against RSV site 3, AlphaFold3 filter
- Fine-tuned RFdiffusion VHH computational success rate against TcdB, AlphaFold3 filter
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
20 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
Citation locations1 values
| Bennett 2025 Supplementary Information, including Supplementary Methods Tables 5 and 6 uc-binder-20261022-source-bennett-si: Supplementary Methods Table 6, column 'Success rate (%) (AF3)' Version: Supplementary Information PDF 41586_2025_9721_MOESM1_ESM.pdf, 129 pages, InDesign 17.4, ModDate 2026-09-15 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: SHA-256 of the Supplementary Information PDF as extracted from one retrieval of the supplementary archive on 2026-10-22. The archive itself was truncated (103,690,987 bytes, SHA-256 6b1bd61ba4d69d5393f56e0e0d12bb4349b45ce12496a1d3e6a5a8467c39203a) and is not the pinned artifact. Archive member: 41586_2025_9721_MOESM1_ESM.pdf, extracted from the Europe PMC supplementaryFiles archive for PMC12727541 |
| Comparison group in-silico-filters Context-only references | Bennett 2025 Supplementary Information, including Supplementary Methods Tables 5 and 6 uc-binder-20261022-source-bennett-si: Supplementary Methods Table 6, column 'Success rate (%) (AF3)' Version: Supplementary Information PDF 41586_2025_9721_MOESM1_ESM.pdf, 129 pages, InDesign 17.4, ModDate 2026-09-15 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: SHA-256 of the Supplementary Information PDF as extracted from one retrieval of the supplementary archive on 2026-10-22. The archive itself was truncated (103,690,987 bytes, SHA-256 6b1bd61ba4d69d5393f56e0e0d12bb4349b45ce12496a1d3e6a5a8467c39203a) and is not the pinned artifact. Archive member: 41586_2025_9721_MOESM1_ESM.pdf, extracted from the Europe PMC supplementaryFiles archive for PMC12727541 |
| Comparison title Computational filters used to choose which designs to test Context-only references | Bennett 2025 Supplementary Information, including Supplementary Methods Tables 5 and 6 uc-binder-20261022-source-bennett-si: Supplementary Methods Table 6, column 'Success rate (%) (AF3)' Version: Supplementary Information PDF 41586_2025_9721_MOESM1_ESM.pdf, 129 pages, InDesign 17.4, ModDate 2026-09-15 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: SHA-256 of the Supplementary Information PDF as extracted from one retrieval of the supplementary archive on 2026-10-22. The archive itself was truncated (103,690,987 bytes, SHA-256 6b1bd61ba4d69d5393f56e0e0d12bb4349b45ce12496a1d3e6a5a8467c39203a) and is not the pinned artifact. Archive member: 41586_2025_9721_MOESM1_ESM.pdf, extracted from the Europe PMC supplementaryFiles archive for PMC12727541 |
Constraints3 values
| Bennett 2025 Supplementary Information, including Supplementary Methods Tables 5 and 6 uc-binder-20261022-source-bennett-si: Supplementary Methods Table 6, column 'Success rate (%) (AF3)' Version: Supplementary Information PDF 41586_2025_9721_MOESM1_ESM.pdf, 129 pages, InDesign 17.4, ModDate 2026-09-15 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: SHA-256 of the Supplementary Information PDF as extracted from one retrieval of the supplementary archive on 2026-10-22. The archive itself was truncated (103,690,987 bytes, SHA-256 6b1bd61ba4d69d5393f56e0e0d12bb4349b45ce12496a1d3e6a5a8467c39203a) and is not the pinned artifact. Archive member: 41586_2025_9721_MOESM1_ESM.pdf, extracted from the Europe PMC supplementaryFiles archive for PMC12727541 |
| Endpoint Share of designed antibody variable heavy chains that pass an AlphaFold3 filter at Ca RMSD below 5 A and ipTM above 0.5 Context-only references | Bennett 2025 Supplementary Information, including Supplementary Methods Tables 5 and 6 uc-binder-20261022-source-bennett-si: Supplementary Methods Table 6, column 'Success rate (%) (AF3)' Version: Supplementary Information PDF 41586_2025_9721_MOESM1_ESM.pdf, 129 pages, InDesign 17.4, ModDate 2026-09-15 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: SHA-256 of the Supplementary Information PDF as extracted from one retrieval of the supplementary archive on 2026-10-22. The archive itself was truncated (103,690,987 bytes, SHA-256 6b1bd61ba4d69d5393f56e0e0d12bb4349b45ce12496a1d3e6a5a8467c39203a) and is not the pinned artifact. Archive member: 41586_2025_9721_MOESM1_ESM.pdf, extracted from the Europe PMC supplementaryFiles archive for PMC12727541 |
| Claimed field links:assessed_by:uc-binder-20261022-protocol-bennett-insilico-af3-success Context-only references | Bennett 2025 Supplementary Information, including Supplementary Methods Tables 5 and 6 uc-binder-20261022-source-bennett-si: Supplementary Methods Table 6, column 'Success rate (%) (AF3)' Version: Supplementary Information PDF 41586_2025_9721_MOESM1_ESM.pdf, 129 pages, InDesign 17.4, ModDate 2026-09-15 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: SHA-256 of the Supplementary Information PDF as extracted from one retrieval of the supplementary archive on 2026-10-22. The archive itself was truncated (103,690,987 bytes, SHA-256 6b1bd61ba4d69d5393f56e0e0d12bb4349b45ce12496a1d3e6a5a8467c39203a) and is not the pinned artifact. Archive member: 41586_2025_9721_MOESM1_ESM.pdf, extracted from the Europe PMC supplementaryFiles archive for PMC12727541 |
| Headline metric success-rate Context-only references | Bennett 2025 Supplementary Information, including Supplementary Methods Tables 5 and 6 uc-binder-20261022-source-bennett-si: Supplementary Methods Table 6, column 'Success rate (%) (AF3)' Version: Supplementary Information PDF 41586_2025_9721_MOESM1_ESM.pdf, 129 pages, InDesign 17.4, ModDate 2026-09-15 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: SHA-256 of the Supplementary Information PDF as extracted from one retrieval of the supplementary archive on 2026-10-22. The archive itself was truncated (103,690,987 bytes, SHA-256 6b1bd61ba4d69d5393f56e0e0d12bb4349b45ce12496a1d3e6a5a8467c39203a) and is not the pinned artifact. Archive member: 41586_2025_9721_MOESM1_ESM.pdf, extracted from the Europe PMC supplementaryFiles archive for PMC12727541 |
Limitations5 values
| Bennett 2025 Supplementary Information, including Supplementary Methods Tables 5 and 6 uc-binder-20261022-source-bennett-si: Supplementary Methods Table 6, column 'Success rate (%) (AF3)' Version: Supplementary Information PDF 41586_2025_9721_MOESM1_ESM.pdf, 129 pages, InDesign 17.4, ModDate 2026-09-15 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: SHA-256 of the Supplementary Information PDF as extracted from one retrieval of the supplementary archive on 2026-10-22. The archive itself was truncated (103,690,987 bytes, SHA-256 6b1bd61ba4d69d5393f56e0e0d12bb4349b45ce12496a1d3e6a5a8467c39203a) and is not the pinned artifact. Archive member: 41586_2025_9721_MOESM1_ESM.pdf, extracted from the Europe PMC supplementaryFiles archive for PMC12727541 |
Pinned records16 values
| Bennett 2025 Supplementary Information, including Supplementary Methods Tables 5 and 6 uc-binder-20261022-source-bennett-si: Supplementary Methods Table 6, column 'Success rate (%) (AF3)' Version: Supplementary Information PDF 41586_2025_9721_MOESM1_ESM.pdf, 129 pages, InDesign 17.4, ModDate 2026-09-15 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: SHA-256 of the Supplementary Information PDF as extracted from one retrieval of the supplementary archive on 2026-10-22. The archive itself was truncated (103,690,987 bytes, SHA-256 6b1bd61ba4d69d5393f56e0e0d12bb4349b45ce12496a1d3e6a5a8467c39203a) and is not the pinned artifact. Archive member: 41586_2025_9721_MOESM1_ESM.pdf, extracted from the Europe PMC supplementaryFiles archive for PMC12727541 |
| Rationale Outside the use case's endpoint, and retrospective: AlphaFold3 was released after the design work. Kept because the paper uses it to argue that a better filter would raise the measured success rate, which is a claim about the selection step that the use case has to keep separate from the design step. Context-only references | Bennett 2025 Supplementary Information, including Supplementary Methods Tables 5 and 6 uc-binder-20261022-source-bennett-si: Supplementary Methods Table 6, column 'Success rate (%) (AF3)' Version: Supplementary Information PDF 41586_2025_9721_MOESM1_ESM.pdf, 129 pages, InDesign 17.4, ModDate 2026-09-15 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: SHA-256 of the Supplementary Information PDF as extracted from one retrieval of the supplementary archive on 2026-10-22. The archive itself was truncated (103,690,987 bytes, SHA-256 6b1bd61ba4d69d5393f56e0e0d12bb4349b45ce12496a1d3e6a5a8467c39203a) and is not the pinned artifact. Archive member: 41586_2025_9721_MOESM1_ESM.pdf, extracted from the Europe PMC supplementaryFiles archive for PMC12727541 |
Sources and history
Release 2026-10-22-1b7cf027e4f6 · Record review: source checked
1 source record and release history
- Bennett 2025 Supplementary Information, including Supplementary Methods Tables 5 and 6 · Original source · Supplementary Information PDF 41586_2025_9721_MOESM1_ESM.pdf, 129 pages, InDesign 17.4, ModDate 2026-09-15
Technical metadata and extraction receipts
Stable ID: use-case-mapping-binder-20261022-bennett-insilico-af3-success
- citation locators
- locator: Supplementary Methods Table 6, column 'Success rate (%) (AF3)'; source id: uc-binder-20261022-source-bennett-si
- comparison group
- in-silico-filters
- comparison title
- Computational filters used to choose which designs to test
- constraints
- Not an outcome, and retrospective.; The values are depressed by AlphaFold3 re-predicting the cropped design targets inaccurately, which the caption states explicitly.; Do not read a low AlphaFold3 pass rate as evidence about the designs.
- endpoint
- Share of designed antibody variable heavy chains that pass an AlphaFold3 filter at Ca RMSD below 5 A and ipTM above 0.5
- field
- links:assessed_by:uc-binder-20261022-protocol-bennett-insilico-af3-success
- headline metric
- success-rate
- limitations
- An in silico filter pass rate, not a measured outcome.; Retrospective: the filter was not available when the designs were made.; The caption states that cropped targets were not accurately re-predicted and that 'success rates would likely be higher with contiguous (non-cropped) targets'.; The RSV site 3 value carries an asterisk recording a 19 A target-epitope prediction error.; No uncertainty is printed.
- rationale
- Outside the use case's endpoint, and retrospective: AlphaFold3 was released after the design work. Kept because the paper uses it to argue that a better filter would raise the measured success rate, which is a claim about the selection step that the use case has to keep separate from the design step.
- reason
- Add measured de novo binder design outcomes from the 2026-10-22 use-case evidence pass (#176).
- relevance
- outside_scope
- review
- artifact sha256: f5d4fc4f3a65a2dc3ab696e165bb86bf150b2437cdc1a7046cfbecae8ccab05c; method: scope-review; independent-cell-check; ai-assisted-source-review; method note: The supplementary archive now returns 107,210,814 bytes and extracts cleanly with unzip, where the extraction pass received a truncated 103,690,987-byte archive it had to stream with bsdtar. The pinned member hash is what matters and it matched exactly: 41586_2025_9721_MOESM1_ESM.pdf is f5d4fc4f3a65a2dc3ab696e165bb86bf150b2437cdc1a7046cfbecae8ccab05c. Own text layer with pdftotext -layout (poppler 26.08.0), reproducing 3,582 lines; Supplementary Methods Tables 5 and 6 read cell by cell.; note: Reviewed in docs/reviews/use-cases/binder-2026-10-22.md. Automated AI review of the source transcription only; it is not human scientific review and nothing here was reproduced experimentally.; retrieval url: https://www.ebi.ac.uk/europepmc/webservices/rest/PMC12727541/supplementaryFiles; reviewed at: 2026-10-22T15:00:00Z; reviewer: claude; reviewer note: Claude review agent, independent of the extraction agent; no human review claimed; scope: Endpoint fit, relevance grade, constraints, limitations, comparison grouping and the evaluations listed in reviewed_evaluations.
- reviewed evaluations
- uc-binder-20261022-eval-bennett-h1stem-spr-insilico-af3-af3; uc-binder-20261022-eval-bennett-h1stem-ysd-insilico-af3-af3; uc-binder-20261022-eval-bennett-il7r-spr-insilico-af3-af3; uc-binder-20261022-eval-bennett-rbd-ysd-insilico-af3-af3; uc-binder-20261022-eval-bennett-rsv3-ysd-insilico-af3-af3; uc-binder-20261022-eval-bennett-tcdb-spr-insilico-af3-af3
- revision
- 1
- source locator
- uc-binder-20261022-source-bennett-si: Supplementary Methods Table 6, column 'Success rate (%) (AF3)'
- stratum label
- AlphaFold3 filter pass rates
- stratum order
- 2
- value
- uc-binder-20261022-protocol-bennett-insilico-af3-success
- pins
- record id: uc-binder-20261022-eval-bennett-h1stem-spr-insilico-af3-af3; fields: status; links; attributes.origin; attributes.comparison; sha256: 6562a533fde19c64e65432d8fecb470046b5b7f297e976bbf9bf669bf01318cd; record id: uc-binder-20261022-eval-bennett-h1stem-ysd-insilico-af3-af3; fields: status; links; attributes.origin; attributes.comparison; sha256: 6562a533fde19c64e65432d8fecb470046b5b7f297e976bbf9bf669bf01318cd; record id: uc-binder-20261022-eval-bennett-il7r-spr-insilico-af3-af3; fields: status; links; attributes.origin; attributes.comparison; sha256: 6efd6ee57c74e2c86160cea69d694ba3d794a08785dd2bb40974187d5f7f85a6; record id: uc-binder-20261022-eval-bennett-rbd-ysd-insilico-af3-af3; fields: status; links; attributes.origin; attributes.comparison; sha256: 038b901a4a2b88febdc59b8626c1fbe8c64ab68997da64412ec1a20b4716da59; record id: uc-binder-20261022-eval-bennett-rsv3-ysd-insilico-af3-af3; fields: status; links; attributes.origin; attributes.comparison; sha256: 84967e78b58add99ab744542f918f70e152afb6e35fea6237708367f08e31cc7; record id: uc-binder-20261022-eval-bennett-tcdb-spr-insilico-af3-af3; fields: status; links; attributes.origin; attributes.comparison; sha256: 7a234118c1aba4c1f3a2c0ae4b2edd21d08e9992be907b13fa08dde1e266ca26; record id: uc-binder-20261022-protocol-bennett-insilico-af3-success; fields: status; name; description; facets; source_ids; links; attributes; sha256: a9dea353ded7aac121deb04e82cc7b06aae694f38485ab49cfe2d17582f81823; record id: uc-binder-20261022-result-bennett-h1stem-spr-insilico-af3-af3; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: bf1351a7f9592dc1a01a77f55f23db200e50aeb9823c0a694125d08ba0584f70; record id: uc-binder-20261022-result-bennett-h1stem-ysd-insilico-af3-af3; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: bf1351a7f9592dc1a01a77f55f23db200e50aeb9823c0a694125d08ba0584f70; record id: uc-binder-20261022-result-bennett-il7r-spr-insilico-af3-af3; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: bf1351a7f9592dc1a01a77f55f23db200e50aeb9823c0a694125d08ba0584f70; record id: uc-binder-20261022-result-bennett-rbd-ysd-insilico-af3-af3; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 0d4511ed45c13a25e7ab7232e0d0cf1724923e407f988b5905cdcf3e3be3f201; record id: uc-binder-20261022-result-bennett-rsv3-ysd-insilico-af3-af3; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: fd62578d4637e560c8c7773445bdffe3f950307d2ead872f400699e860fdede9; record id: uc-binder-20261022-result-bennett-tcdb-spr-insilico-af3-af3; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 8978b8a619413bd20f850292e0226dc9b862b710a99e39f719f64638ebebd8b1; record id: uc-binder-20261022-source-bennett; fields: status; attributes.artifact_sha256; sha256: 67767c4e09155df3488e2ce80dcb47410db9ba4912be584cd0fab0d01bf6d077; record id: uc-binder-20261022-source-bennett-si; fields: status; attributes.artifact_sha256; sha256: ce65600570751c68a989080759fe025cbebbaa414d8f6416e6870bb7f23afbfd; record id: use-case-de-novo-binder-design; fields: status; name; description; facets; attributes.question; attributes.decision; attributes.inputs; attributes.output; attributes.exclusions; attributes.setting; attributes.clinical_scope; attributes.intended_users; sha256: b5a0012d1b0f02d6bd7466b7308123b26e676eda8ef54d706c865bb3f777e5b9