Relevance of LiPP test set (RMSD below 2 Angstrom and PoseBusters valid) to "Choose structural hypotheses to guide experiments"
- Use case
- Choose structural hypotheses to guide experiments
- Assessed by
- LiPP Table 3: RMSD below 2 Angstrom and PoseBusters valid, LiPP test set
- Relevance
- Proxy evidence
- Endpoint
- Share of 36 post-cutoff lipid-protein complexes whose predicted lipid pose counts as a success (RMSD below 2 Angstrom and PoseBusters valid)
Lipid-protein pose accuracy on complexes released after every tool's training cutoff, as evidence for trusting a predicted ligand complex.
5 reviewed evaluations
- AlphaFold 3 on LiPP test set (RMSD below 2 Angstrom and PoseBusters valid)
- AutoDock Vina on LiPP test set (RMSD below 2 Angstrom and PoseBusters valid)
- Chai-1 on LiPP test set (RMSD below 2 Angstrom and PoseBusters valid)
- DiffDock-L on LiPP test set (RMSD below 2 Angstrom and PoseBusters valid)
- RoseTTAFold AA on LiPP test set (RMSD below 2 Angstrom and PoseBusters valid)
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
19 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
Citation locations1 values
| The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods Table 3, column 'LiPP test set (N = 36) % Success Rate' Version: PMC13292216.1 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| Comparison group lipid-protein-poses Context-only references | The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods Table 3, column 'LiPP test set (N = 36) % Success Rate' Version: PMC13292216.1 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| Comparison title Lipid-protein pose predictions Context-only references | The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods Table 3, column 'LiPP test set (N = 36) % Success Rate' Version: PMC13292216.1 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
Constraints4 values
| The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods Table 3, column 'LiPP test set (N = 36) % Success Rate' Version: PMC13292216.1 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| Endpoint Share of 36 post-cutoff lipid-protein complexes whose predicted lipid pose counts as a success (RMSD below 2 Angstrom and PoseBusters valid) Context-only references | The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods Table 3, column 'LiPP test set (N = 36) % Success Rate' Version: PMC13292216.1 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| Claimed field links:assessed_by:lit-structure-20261011-lipp-protocol-pb-valid-lipp-test-36 Context-only references | The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods Table 3, column 'LiPP test set (N = 36) % Success Rate' Version: PMC13292216.1 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| Headline metric success-rate Context-only references | The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods Table 3, column 'LiPP test set (N = 36) % Success Rate' Version: PMC13292216.1 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
Limitations5 values
| The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods Table 3, column 'LiPP test set (N = 36) % Success Rate' Version: PMC13292216.1 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
Pinned records13 values
| The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods Table 3, column 'LiPP test set (N = 36) % Success Rate' Version: PMC13292216.1 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| Rationale Proxy, not direct: the use case asks whether a predicted interface or complex is reliable enough to guide an experiment, and this protocol answers it for lipid ligands on complexes no tool could have memorised. It does not cover protein-protein interfaces, protein-peptide complexes or drug-like small molecules, and a correct pose does not establish that the interaction matters in the experiment being planned. Context-only references | The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods Table 3, column 'LiPP test set (N = 36) % Success Rate' Version: PMC13292216.1 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
Sources and history
Release 2026-11-21-c8bea25e5abb · Record review: source checked
1 source record and release history
- The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods · Original source · PMC13292216.1
Technical metadata and extraction receipts
Stable ID: use-case-mapping-lit-structure-20261011-lipp-pb-valid-lipp-test-36
- field
- links:assessed_by:lit-structure-20261011-lipp-protocol-pb-valid-lipp-test-36
- value
- lit-structure-20261011-lipp-protocol-pb-valid-lipp-test-36
- relevance
- proxy
- endpoint
- Share of 36 post-cutoff lipid-protein complexes whose predicted lipid pose counts as a success (RMSD below 2 Angstrom and PoseBusters valid)
- rationale
- Proxy, not direct: the use case asks whether a predicted interface or complex is reliable enough to guide an experiment, and this protocol answers it for lipid ligands on complexes no tool could have memorised. It does not cover protein-protein interfaces, protein-peptide complexes or drug-like small molecules, and a correct pose does not establish that the interaction matters in the experiment being planned.
- constraints
- Lipid ligands only; the LiPP authors note that drug-likeness filters exclude most lipids from PDBbind-derived sets.; Compare only within the same criterion and the same dataset column: the full LiPP set includes complexes inside some tools' training windows.; The 36-complex test set is small, so the printed 95% confidence intervals are wide.; Inspect every linked evaluation's source locator before citing a result.
- limitations
- Author-run predictions, not an independent reproduction by Rewire.; The PoseBusters columns in the same tables are literature values compiled by the LiPP authors and are recorded as paper_compilation.; Pose accuracy only; the paper's confidence-score analysis is in figures and was not extracted.; Several printed test-set percentages are truncated rather than rounded (for example 11 of 36 printed as 30.5); the values are kept as printed.; The full LiPP set and the PoseBusters columns are not linked to the use case: the full set includes complexes inside some tools' training windows, and the PoseBusters values are literature compilations on drug-like ligands.
- citation locators
- source id: evidence-expansion-p2-lipp-2026-6ff34f2f709a; locator: Table 3, column 'LiPP test set (N = 36) % Success Rate'
- source locator
- Table 3, column 'LiPP test set (N = 36) % Success Rate'
- headline metric
- success-rate
- comparison group
- lipid-protein-poses
- comparison title
- Lipid-protein pose predictions
- stratum label
- Lipid poses on 36 post-cutoff complexes (LiPP)
- stratum order
- 2
- reviewed evaluations
- lit-structure-20261011-lipp-eval-pb-valid-lipp-test-36-alphafold-3; lit-structure-20261011-lipp-eval-pb-valid-lipp-test-36-autodock-vina; lit-structure-20261011-lipp-eval-pb-valid-lipp-test-36-chai-1; lit-structure-20261011-lipp-eval-pb-valid-lipp-test-36-diffdock-l; lit-structure-20261011-lipp-eval-pb-valid-lipp-test-36-rosettafold-aa
- review
- method: ai-assisted-source-review; scope-review; method note: Reviewer checked the endpoint against the use case's inputs, output and exclusions, the relevance rating and the limitations; every evaluation on the protocol had its values checked in the batch review. Corrections listed in review.md were applied by the extractor.; reviewer: claude; reviewer note: Claude review agent reviewer-ps-2, independent of the extractor lit-protein-structure; no human review claimed; reviewed at: 2026-10-11T23:30:00Z; note: Automated review; not human scientific review.
- pins
- record id: evidence-expansion-p2-lipp-2026-6ff34f2f709a; fields: status; attributes.artifact_sha256; sha256: 5594b4fa8a6fa41ce10364e7ef3f97dd2b5e7acdb231a09fc2895e2ec7401fe7; record id: lit-structure-20261011-lipp-eval-pb-valid-lipp-test-36-alphafold-3; fields: status; links; attributes.origin; attributes.comparison; sha256: 1237b83dcdfd65ff7f20f50fafe50fa4a98a13a816f27cfcb131ebbad145c433; record id: lit-structure-20261011-lipp-eval-pb-valid-lipp-test-36-autodock-vina; fields: status; links; attributes.origin; attributes.comparison; sha256: 38cd7efaf6883864b24295f58400bf905308ff4c32cb682f6e180e80e24dcdb4; record id: lit-structure-20261011-lipp-eval-pb-valid-lipp-test-36-chai-1; fields: status; links; attributes.origin; attributes.comparison; sha256: 3af231fc6d9f19630a950f4631cbb786dd33c2e49484b210d15047597fa9b19c; record id: lit-structure-20261011-lipp-eval-pb-valid-lipp-test-36-diffdock-l; fields: status; links; attributes.origin; attributes.comparison; sha256: bd4157174ce52f14ca49100efcb95e5d7959c669a8cfb7efc28ced68d8caf07b; record id: lit-structure-20261011-lipp-eval-pb-valid-lipp-test-36-rosettafold-aa; fields: status; links; attributes.origin; attributes.comparison; sha256: 2dfdc567ed76161dad9f8824db86018c26a76cf930ec45d63fc1f4fc05ac74a2; record id: lit-structure-20261011-lipp-protocol-pb-valid-lipp-test-36; fields: status; name; description; facets; source_ids; links; attributes; sha256: 67d33c66c88f9a37b17a2ca92882accdb96998534331b746eef756b068b7545d; record id: lit-structure-20261011-lipp-result-pb-valid-lipp-test-36-alphafold-3; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: e65fe1bfe68b7bca11b83118b5b0660191f68f802b88ffa3ae706bc649385321; record id: lit-structure-20261011-lipp-result-pb-valid-lipp-test-36-autodock-vina; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: a35d573049860a87db26f2752db6a621daca9cbe6bc80dd67d4c4961e69576b9; record id: lit-structure-20261011-lipp-result-pb-valid-lipp-test-36-chai-1; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: f81417ba0b8d6133cf26725d9926fce477fbfbcbdfade0c05b620680d4f75260; record id: lit-structure-20261011-lipp-result-pb-valid-lipp-test-36-diffdock-l; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 69ff34c290de5cd7a34ca2205ab05cbcf982fe01b64f03fb3e1f7314ccdbef57; record id: lit-structure-20261011-lipp-result-pb-valid-lipp-test-36-rosettafold-aa; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 68b54f452036d312b457ba5ffda9bdd87ffdb693e712b0ff3231bae9a27dd670; record id: use-case-structural-hypotheses-experiments; fields: status; name; description; facets; attributes.question; attributes.decision; attributes.inputs; attributes.output; attributes.exclusions; attributes.setting; attributes.clinical_scope; attributes.intended_users; sha256: 323c287cae7885e983feb5d58f24115afe49ecfbb868a0238c75b1247ffcf228
- reason
- Add a relevance judgement for a protocol from the 2026-10-11 protein-fitness and structure-design literature pass, reviewed in docs/reviews/2026-10-11-protein-structure-suites.md.