Relevance of structural-20261009-protocol-fromm2026-abag-model-selection to "Which predicted interfaces or structures are reliable enough to guide my next experiment?"
- Use case
- Choose structural hypotheses to guide experiments
- Assessed by
- Picking the top AlphaFold3 model per antibody-antigen target with a confidence score
- Relevance
- Proxy evidence
- Endpoint
- Mean DockQ of the AlphaFold3 model picked by each of five scores a user can compute (ipTM, pTM, ranking confidence, pDockQ2 and ipSAE) among 200 models per target, and Spearman correlation with DockQ over all models and per target, on 110 antibody-antigen complexes released after the training cutoff
Answers whether the confidence a user sees can pick the right antibody-antigen model: every score based on predicted errors picks models with mean DockQ near 0.35 when the best available is 0.54, and the per-target correlation stays below 0.25. Proxy evidence: structural accuracy only, one tool, one complex class.
5 reviewed evaluations
- AlphaFold3 top model by ipSAE on 110 post-cutoff antibody-antigen complexes (Fromm et al. 2026)
- AlphaFold3 top model by ipTM on 110 post-cutoff antibody-antigen complexes (Fromm et al. 2026)
- AlphaFold3 top model by pDockQ2 on 110 post-cutoff antibody-antigen complexes (Fromm et al. 2026)
- AlphaFold3 top model by pTM on 110 post-cutoff antibody-antigen complexes (Fromm et al. 2026)
- AlphaFold3 top model by RankConf on 110 post-cutoff antibody-antigen complexes (Fromm et al. 2026)
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
21 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
Citation locations1 values
| Evaluating deep learning based structure prediction methods on antibody-antigen complexes structural-20261009-source-fromm2026: Section 2.1; sections 3.3 and 3.6; Table 1 Version: Bioinformatics 42(4):btag136, 2026; PMC13061134 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: JATS XML parse (xml.etree), by extract/extract_structural.py |
| Comparison group antibody-antigen-interfaces Context-only references | Evaluating deep learning based structure prediction methods on antibody-antigen complexes structural-20261009-source-fromm2026: Section 2.1; sections 3.3 and 3.6; Table 1 Version: Bioinformatics 42(4):btag136, 2026; PMC13061134 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: JATS XML parse (xml.etree), by extract/extract_structural.py |
| Comparison title Antibody-antigen interface predictions Context-only references | Evaluating deep learning based structure prediction methods on antibody-antigen complexes structural-20261009-source-fromm2026: Section 2.1; sections 3.3 and 3.6; Table 1 Version: Bioinformatics 42(4):btag136, 2026; PMC13061134 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: JATS XML parse (xml.etree), by extract/extract_structural.py |
Constraints4 values
| Evaluating deep learning based structure prediction methods on antibody-antigen complexes structural-20261009-source-fromm2026: Section 2.1; sections 3.3 and 3.6; Table 1 Version: Bioinformatics 42(4):btag136, 2026; PMC13061134 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: JATS XML parse (xml.etree), by extract/extract_structural.py |
| Endpoint Mean DockQ of the AlphaFold3 model picked by each of five scores a user can compute (ipTM, pTM, ranking confidence, pDockQ2 and ipSAE) among 200 models per target, and Spearman correlation with DockQ over all models and per target, on 110 antibody-antigen complexes released after the training cutoff Context-only references | Evaluating deep learning based structure prediction methods on antibody-antigen complexes structural-20261009-source-fromm2026: Section 2.1; sections 3.3 and 3.6; Table 1 Version: Bioinformatics 42(4):btag136, 2026; PMC13061134 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: JATS XML parse (xml.etree), by extract/extract_structural.py |
Excluded evaluations4 values
| Evaluating deep learning based structure prediction methods on antibody-antigen complexes structural-20261009-source-fromm2026: Section 2.1; sections 3.3 and 3.6; Table 1 Version: Bioinformatics 42(4):btag136, 2026; PMC13061134 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: JATS XML parse (xml.etree), by extract/extract_structural.py |
| Claimed field links:assessed_by:structural-20261009-protocol-fromm2026-abag-model-selection Context-only references | Evaluating deep learning based structure prediction methods on antibody-antigen complexes structural-20261009-source-fromm2026: Section 2.1; sections 3.3 and 3.6; Table 1 Version: Bioinformatics 42(4):btag136, 2026; PMC13061134 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: JATS XML parse (xml.etree), by extract/extract_structural.py |
| Headline metric dockq Context-only references | Evaluating deep learning based structure prediction methods on antibody-antigen complexes structural-20261009-source-fromm2026: Section 2.1; sections 3.3 and 3.6; Table 1 Version: Bioinformatics 42(4):btag136, 2026; PMC13061134 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: JATS XML parse (xml.etree), by extract/extract_structural.py |
Limitations9 values
| Evaluating deep learning based structure prediction methods on antibody-antigen complexes structural-20261009-source-fromm2026: Section 2.1; sections 3.3 and 3.6; Table 1 Version: Bioinformatics 42(4):btag136, 2026; PMC13061134 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: JATS XML parse (xml.etree), by extract/extract_structural.py |
Pinned records23 values
| Evaluating deep learning based structure prediction methods on antibody-antigen complexes structural-20261009-source-fromm2026: Section 2.1; sections 3.3 and 3.6; Table 1 Version: Bioinformatics 42(4):btag136, 2026; PMC13061134 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: JATS XML parse (xml.etree), by extract/extract_structural.py |
Sources and history
Release 2026-11-02-a7f03c9e55a5 · Record review: source checked
1 source record and release history
- Evaluating deep learning based structure prediction methods on antibody-antigen complexes · Original source · Bioinformatics 42(4):btag136, 2026; PMC13061134 full-text XML
Technical metadata and extraction receipts
Stable ID: use-case-mapping-structural-20261009-fromm2026-model-selection
- field
- links:assessed_by:structural-20261009-protocol-fromm2026-abag-model-selection
- value
- structural-20261009-protocol-fromm2026-abag-model-selection
- relevance
- proxy
- endpoint
- Mean DockQ of the AlphaFold3 model picked by each of five scores a user can compute (ipTM, pTM, ranking confidence, pDockQ2 and ipSAE) among 200 models per target, and Spearman correlation with DockQ over all models and per target, on 110 antibody-antigen complexes released after the training cutoff
- rationale
- Answers whether the confidence a user sees can pick the right antibody-antigen model: every score based on predicted errors picks models with mean DockQ near 0.35 when the best available is 0.54, and the per-target correlation stays below 0.25. Proxy evidence: structural accuracy only, one tool, one complex class.
- constraints
- Inspect every linked evaluation's source locator and preserved limitations before citing a result.; Do not combine this mapping's evaluations with any other protocol's results; complex sets, sampling and metrics differ.; Results for one complex class do not establish performance in another.; Structural accuracy and confidence are not evidence that an interaction exists, how strong it is or that an experiment will work.
- limitations
- Antibody-antigen complexes only; results do not transfer to other complex classes.; Structural accuracy against the deposited complex, not binding, affinity or the outcome of an experiment.; Only AlphaFold3 models are ranked in Table 1; the source does not print the same table for AlphaFold2.3, Boltz-1 or Chai-1.; Table 1 does not state the number of models ranked per target. Its DockQ row (0.544) matches the best-of-200 value given in the text (0.54), so the table is read as selection among all 200 models; this is an inference.; The DockQ, aeTM, aeiTM and aeRankConf rows use the experimental structure, so they are upper bounds, not usable selection rules.; Figure 6 and the text give a per-target ranking-confidence correlation of 0.28, while Table 1 prints 0.214 for RankConf under a Spearman caption; the figure's correlation type is not stated.; No uncertainty is printed.; The four oracle rows of Table 1 (DockQ, aeTM, aeiTM, aeRankConf) are excluded: each needs the experimental structure, so none is a rule a user could apply. The gap between the best achievable pick and the best computable score is kept as a descriptive claim.; Section 3.5 gives the mean per-target correlation for ranking confidence as 0.28 while Table 1 prints 0.214; the stored value is the table's and carries the conflict as a source warning.
- citation locators
- source id: structural-20261009-source-fromm2026; locator: Section 2.1; sections 3.3 and 3.6; Table 1
- source locator
- structural-20261009-source-fromm2026: Section 2.1; sections 3.3 and 3.6; Table 1
- revision
- 1
- reason
- Add comparisons of structure-prediction reliability by complex class from the structural hypotheses use-case pass 2026-10-09.
- comparison group
- antibody-antigen-interfaces
- comparison title
- Antibody-antigen interface predictions
- headline metric
- dockq
- stratum label
- Picking AlphaFold3 models by confidence (independent)
- stratum order
- 2
- excluded evaluations
- id: structural-20261009-eval-fromm2026-af3-dockq-oracle; reason: Oracle row: the model is picked with the experimental structure, so it is the best achievable pick, not a selection rule a user could apply. Excluded at independent review 2026-10-09 so it is never shown as a usable method; the gap it defines is kept in claim structural-20261009-claim-fromm2026-top-vs-best.; id: structural-20261009-eval-fromm2026-af3-aetm-oracle; reason: Oracle row: pTM recomputed from the true aligned errors of the experimental structure, so it cannot be computed before an experiment. Excluded at independent review 2026-10-09; see claim structural-20261009-claim-fromm2026-top-vs-best.; id: structural-20261009-eval-fromm2026-af3-aeitm-oracle; reason: Oracle row: ipTM recomputed from the true aligned errors of the experimental structure, so it cannot be computed before an experiment. Excluded at independent review 2026-10-09; see claim structural-20261009-claim-fromm2026-top-vs-best.; id: structural-20261009-eval-fromm2026-af3-aerankconf-oracle; reason: Oracle row: 0.2 aeTM + 0.8 aeiTM, both recomputed from the true aligned errors of the experimental structure, so it cannot be computed before an experiment. Excluded at independent review 2026-10-09; see claim structural-20261009-claim-fromm2026-top-vs-best.
- reviewed evaluations
- structural-20261009-eval-fromm2026-af3-ipsae; structural-20261009-eval-fromm2026-af3-iptm; structural-20261009-eval-fromm2026-af3-pdockq2; structural-20261009-eval-fromm2026-af3-ptm; structural-20261009-eval-fromm2026-af3-ranking-confidence
- review
- method: automated-source-review; reviewer: claude; reviewer note: Separate Claude review agent, independent of the extractor; no human review claimed; reviewed at: 2026-10-10T00:30:00Z; note: Independent review of endpoint fit, relevance grade, limitations, exclusions and grouping against the use case and the article; every value of the listed evaluations was checked against Table 1. No execution, reproduction, human scientific review or clinical validation.
- pins
- record id: structural-20261009-eval-fromm2026-af3-ipsae; fields: status; links; attributes.origin; attributes.comparison; sha256: de864decaf04f54b9c63c3169ffd97b0d5bca21c26d1674d2acae3238e596a34; record id: structural-20261009-eval-fromm2026-af3-iptm; fields: status; links; attributes.origin; attributes.comparison; sha256: 09e4161c12a3d8c7b838d55fdc684910fe89add0425a134106ad26f9712e1d17; record id: structural-20261009-eval-fromm2026-af3-pdockq2; fields: status; links; attributes.origin; attributes.comparison; sha256: 1e49277df715a2a04fcbe3ff2cfc478a6cbdee31b3d8d71d0f0825585f565bd3; record id: structural-20261009-eval-fromm2026-af3-ptm; fields: status; links; attributes.origin; attributes.comparison; sha256: fc32e2a130121f6dcc99ed6063bd5917c18dadac2852f0d5098352761b4fed95; record id: structural-20261009-eval-fromm2026-af3-ranking-confidence; fields: status; links; attributes.origin; attributes.comparison; sha256: e8106894ee07e229274210683f9eee53512c5d5e35a3cf4ab4576aaa13581882; record id: structural-20261009-protocol-fromm2026-abag-model-selection; fields: status; name; description; facets; source_ids; links; attributes; sha256: ed5f65e5fa47a5498744627503ab0b0562e4a90ac4c0e1dc92e591d0186b6e46; record id: structural-20261009-result-fromm2026-af3-ipsae-mean-dockq; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 1c0efb8cd54ccf7476e6e74038f615d6f2a30ae05c7bdd7acba4b1936540fab8; record id: structural-20261009-result-fromm2026-af3-ipsae-spearman-all; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: defb1e54ad01b925c36d0c141372c8e5ce6cf50e47744c4a476e47ebd770b5b2; record id: structural-20261009-result-fromm2026-af3-ipsae-spearman-per-target; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 52b612a69c79428f1e07e6e33739d70d6ab0a1a011d1963a0bf41eec161e3a63; record id: structural-20261009-result-fromm2026-af3-iptm-mean-dockq; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: a469730398483b056d4124f0b22423d7fb9bada9ffe4a1593d3296a6ff70b277; record id: structural-20261009-result-fromm2026-af3-iptm-spearman-all; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: ff5c3171f204539639c093af4399e8a3de45d332132e8e296bd482dd1af8b370; record id: structural-20261009-result-fromm2026-af3-iptm-spearman-per-target; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 0a5b345adf9d55f1e541054055d454f6621026df003d2b634eff876d57b1237d; record id: structural-20261009-result-fromm2026-af3-pdockq2-mean-dockq; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 8c2fd6c581aad1e404b63dd777753f1c5f88f5d0849f4cf40c0e4849155bac8d; record id: structural-20261009-result-fromm2026-af3-pdockq2-spearman-all; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 91d2599eca5b8e4d5925006ad2e676b0350ca2b4b3932a2775997f526b26de85; record id: structural-20261009-result-fromm2026-af3-pdockq2-spearman-per-target; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: db4b5b35498968e40f121193be9e39c468fb1dde69ee2ed2415f4ef859994d53; record id: structural-20261009-result-fromm2026-af3-ptm-mean-dockq; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: c8a714cd3b3daa2b8e576d7903f1ef1e03f28c751d8624606ddb691885f55a4a; record id: structural-20261009-result-fromm2026-af3-ptm-spearman-all; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: aa128e9cc9fe16028ffd0a31eb632d18b6bbd51b51c0249bf0f96bbab1218cda; record id: structural-20261009-result-fromm2026-af3-ptm-spearman-per-target; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 65414e30b446d2b8c50b070b7f2a9ebc605cfb8b4a897b2f6ac49442f10ba4ba; record id: structural-20261009-result-fromm2026-af3-ranking-confidence-mean-dockq; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 4fd0a9f6702491123b52d02452e7c149c41873ab82c5258aefc55141ae5cc7e3; record id: structural-20261009-result-fromm2026-af3-ranking-confidence-spearman-all; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 2dbbe74bd6f0ba00deb44b8bb117acaa7c17375961cb18a15c192acd33cfacca; record id: structural-20261009-result-fromm2026-af3-ranking-confidence-spearman-per-target; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: db63449a78ec2766569ad5c07d992b90d9f8ac2ea28db3e478288f0ee837b75b; record id: structural-20261009-source-fromm2026; fields: status; attributes.artifact_sha256; sha256: fc5e1cd7bc0e52f5e571a570ab34dd372cf60df04f3c288f0fd04a89eb993a55; record id: use-case-structural-hypotheses-experiments; fields: status; name; description; facets; attributes.question; attributes.decision; attributes.inputs; attributes.output; attributes.exclusions; attributes.setting; attributes.clinical_scope; attributes.intended_users; sha256: 323c287cae7885e983feb5d58f24115afe49ecfbb868a0238c75b1247ffcf228