Every VHH paired with every antigen; the observed pairing is the positive and all other pairings are treated as non-binders.
These checks assess whether the evidence supports a reproducible investigation. A source-checked score alone does not meet these requirements.
Release 2026-10-10-6e93f504adfc · Evidence verified: Not verified
Exact outcomes, predictions, identifiers and evaluator are connected.
Missing or unresolved evidence
Verified: Not verified
Replay evidence includes annotations and an assessment of dependence. Unknown independence permits descriptive analysis only.
Missing or unresolved evidence
Verified: Not verified
A pinned recipe describes the inputs, environment and resource requirements.
Missing or unresolved evidence
Verified: Not verified
Separate data and exposure records support an independent test.
Missing or unresolved evidence
Verified: Not verified
Readiness describes the evidence in this release. Availability on your computer is checked separately when an investigation runs. Existing data exposure can prevent independent validation even when files are available.
No verified artifact manifest is connected to this record yet. The gaps above identify what is needed before analysis can begin.
3 evaluations · 3 results. Different protocols are not a single leaderboard.
Applied filters: All linked evaluations
Source checking is not independent reproduction. Release 2026-10-10-6e93f504adfc.
A dataset supplies biological observations. The evaluation protocol defines how those observations are split, used and scored.
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
7 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| attributes.label_semantics Positive: the cognate pairing of each VHH, observed in a deposited structure. Negative: a shuffled pairing of a VHH with a non-cognate antigen, which the source assumes does not bind; none was tested experimentally. Context-only references | Structural Plausibility Without Binding Specificity: Limits of AI-Based Antibody-Antigen Structure Prediction Confidence Scores Results P9 to P11; Methods P66 and P67 Version: bioRxiv version 1, posted 2026-03-03; Europe PMC preprint full text PPR1221387 (manuscript EMS215481); not peer reviewed | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: JATS XML parse (xml.etree), by extract/extract_structural.py |
| attributes.population All VHH-antigen pairings over 91 unique PDB entries; about 89 to 91 positives among about 8041 to 8281 scored pairs, depending on the tool Context-only references | Structural Plausibility Without Binding Specificity: Limits of AI-Based Antibody-Antigen Structure Prediction Confidence Scores Results P9 to P11; Methods P66 and P67 Version: bioRxiv version 1, posted 2026-03-03; Europe PMC preprint full text PPR1221387 (manuscript EMS215481); not peer reviewed | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: JATS XML parse (xml.etree), by extract/extract_structural.py |
| attributes.scope_note Curated from SAbDab-nano (downloaded March 2025; post-October 2021 depositions) and from AACDB, whose pre-cutoff structures were kept on purpose to probe memorisation. Resolution 3.0 Å or better, VHH 110 to 150 residues, antigen 100 to 400 residues. Per-tool training overlap printed by the source: AF3 30 train and 76 test systems, Chai-1 25 and 81, Boltz-2 64 and 42. The abstract gives 11,342 shuffled pairings; Results P8 gives 11,130 (106 squared minus 106). Neither figure is used in a stored value; the scored counts come from Results P11. Context-only references | Structural Plausibility Without Binding Specificity: Limits of AI-Based Antibody-Antigen Structure Prediction Confidence Scores Results P9 to P11; Methods P66 and P67 Version: bioRxiv version 1, posted 2026-03-03; Europe PMC preprint full text PPR1221387 (manuscript EMS215481); not peer reviewed | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: JATS XML parse (xml.etree), by extract/extract_structural.py |
| attributes.source_locator Results P9 to P11; Methods P66 and P67 Context-only references | Structural Plausibility Without Binding Specificity: Limits of AI-Based Antibody-Antigen Structure Prediction Confidence Scores Results P9 to P11; Methods P66 and P67 Version: bioRxiv version 1, posted 2026-03-03; Europe PMC preprint full text PPR1221387 (manuscript EMS215481); not peer reviewed | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: JATS XML parse (xml.etree), by extract/extract_structural.py |
| attributes.version bioRxiv v1 benchmark; Zenodo 10.5281/zenodo.18390239 Context-only references | Structural Plausibility Without Binding Specificity: Limits of AI-Based Antibody-Antigen Structure Prediction Confidence Scores Results P9 to P11; Methods P66 and P67 Version: bioRxiv version 1, posted 2026-03-03; Europe PMC preprint full text PPR1221387 (manuscript EMS215481); not peer reviewed | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: JATS XML parse (xml.etree), by extract/extract_structural.py |
| description Every VHH paired with every antigen; the observed pairing is the positive and all other pairings are treated as non-binders. Context-only references | Structural Plausibility Without Binding Specificity: Limits of AI-Based Antibody-Antigen Structure Prediction Confidence Scores Results P9 to P11; Methods P66 and P67 Version: bioRxiv version 1, posted 2026-03-03; Europe PMC preprint full text PPR1221387 (manuscript EMS215481); not peer reviewed | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: JATS XML parse (xml.etree), by extract/extract_structural.py |
| name Smorodina et al. 2026 all-against-all VHH-antigen pairing matrix (91 unique PDB entries) Context-only references | Structural Plausibility Without Binding Specificity: Limits of AI-Based Antibody-Antigen Structure Prediction Confidence Scores Results P9 to P11; Methods P66 and P67 Version: bioRxiv version 1, posted 2026-03-03; Europe PMC preprint full text PPR1221387 (manuscript EMS215481); not peer reviewed | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: JATS XML parse (xml.etree), by extract/extract_structural.py |
Release 2026-10-10-6e93f504adfc · Record review: source checked
Stable ID: structural-20261009-data-smorodina2026-vhh-antigen-91x91