rewirebio.iobenchmarks
Evidence claim

Relevance of LiPP test set (RMSD below 2 Angstrom and PoseBusters valid) to "Choose structural hypotheses to guide experiments"

Use case
Choose structural hypotheses to guide experiments
Assessed by
LiPP Table 3: RMSD below 2 Angstrom and PoseBusters valid, LiPP test set
Relevance
Proxy evidence
Endpoint
Share of 36 post-cutoff lipid-protein complexes whose predicted lipid pose counts as a success (RMSD below 2 Angstrom and PoseBusters valid)

Lipid-protein pose accuracy on complexes released after every tool's training cutoff, as evidence for trusting a predicted ligand complex.

5 reviewed evaluations

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

19 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Citation locations
1 values
  • source id
    evidence-expansion-p2-lipp-2026-6ff34f2f709a
    locator
    Table 3, column 'LiPP test set (N = 36) % Success Rate'
Context-only references
The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods

Original source ↗

Table 3, column 'LiPP test set (N = 36) % Success Rate'

Version: PMC13292216.1
Retrieved: 2026-09-17T07:56:27.507412+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.citation_locators

Source artifact SHA-256: 6ff34f2f709a14858a3753abf9f8f6efa1e7e3c351f15c70cf64264193a9414e

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Comparison group
lipid-protein-poses
Context-only references
The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods

Original source ↗

Table 3, column 'LiPP test set (N = 36) % Success Rate'

Version: PMC13292216.1
Retrieved: 2026-09-17T07:56:27.507412+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.comparison_group

Source artifact SHA-256: 6ff34f2f709a14858a3753abf9f8f6efa1e7e3c351f15c70cf64264193a9414e

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Comparison title
Lipid-protein pose predictions
Context-only references
The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods

Original source ↗

Table 3, column 'LiPP test set (N = 36) % Success Rate'

Version: PMC13292216.1
Retrieved: 2026-09-17T07:56:27.507412+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.comparison_title

Source artifact SHA-256: 6ff34f2f709a14858a3753abf9f8f6efa1e7e3c351f15c70cf64264193a9414e

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Constraints
4 values
  • Lipid ligands only; the LiPP authors note that drug-likeness filters exclude most lipids from PDBbind-derived sets.
  • Compare only within the same criterion and the same dataset column: the full LiPP set includes complexes inside some tools' training windows.
  • The 36-complex test set is small, so the printed 95% confidence intervals are wide.
  • Inspect every linked evaluation's source locator before citing a result.
Context-only references
The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods

Original source ↗

Table 3, column 'LiPP test set (N = 36) % Success Rate'

Version: PMC13292216.1
Retrieved: 2026-09-17T07:56:27.507412+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.constraints

Source artifact SHA-256: 6ff34f2f709a14858a3753abf9f8f6efa1e7e3c351f15c70cf64264193a9414e

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Endpoint
Share of 36 post-cutoff lipid-protein complexes whose predicted lipid pose counts as a success (RMSD below 2 Angstrom and PoseBusters valid)
Context-only references
The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods

Original source ↗

Table 3, column 'LiPP test set (N = 36) % Success Rate'

Version: PMC13292216.1
Retrieved: 2026-09-17T07:56:27.507412+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.endpoint

Source artifact SHA-256: 6ff34f2f709a14858a3753abf9f8f6efa1e7e3c351f15c70cf64264193a9414e

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Claimed field
links:assessed_by:lit-structure-20261011-lipp-protocol-pb-valid-lipp-test-36
Context-only references
The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods

Original source ↗

Table 3, column 'LiPP test set (N = 36) % Success Rate'

Version: PMC13292216.1
Retrieved: 2026-09-17T07:56:27.507412+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.field

Source artifact SHA-256: 6ff34f2f709a14858a3753abf9f8f6efa1e7e3c351f15c70cf64264193a9414e

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Headline metric
success-rate
Context-only references
The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods

Original source ↗

Table 3, column 'LiPP test set (N = 36) % Success Rate'

Version: PMC13292216.1
Retrieved: 2026-09-17T07:56:27.507412+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.headline_metric

Source artifact SHA-256: 6ff34f2f709a14858a3753abf9f8f6efa1e7e3c351f15c70cf64264193a9414e

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Limitations
5 values
  • Author-run predictions, not an independent reproduction by Rewire.
  • The PoseBusters columns in the same tables are literature values compiled by the LiPP authors and are recorded as paper_compilation.
  • Pose accuracy only; the paper's confidence-score analysis is in figures and was not extracted.
  • Several printed test-set percentages are truncated rather than rounded (for example 11 of 36 printed as 30.5); the values are kept as printed.
  • The full LiPP set and the PoseBusters columns are not linked to the use case: the full set includes complexes inside some tools' training windows, and the PoseBusters values are literature compilations on drug-like ligands.
Context-only references
The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods

Original source ↗

Table 3, column 'LiPP test set (N = 36) % Success Rate'

Version: PMC13292216.1
Retrieved: 2026-09-17T07:56:27.507412+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.limitations

Source artifact SHA-256: 6ff34f2f709a14858a3753abf9f8f6efa1e7e3c351f15c70cf64264193a9414e

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Pinned records
13 values
  • record id
    evidence-expansion-p2-lipp-2026-6ff34f2f709a
    fields
    • status
    • attributes.artifact_sha256
    sha256
    5594b4fa8a6fa41ce10364e7ef3f97dd2b5e7acdb231a09fc2895e2ec7401fe7
  • record id
    lit-structure-20261011-lipp-eval-pb-valid-lipp-test-36-alphafold-3
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    1237b83dcdfd65ff7f20f50fafe50fa4a98a13a816f27cfcb131ebbad145c433
  • record id
    lit-structure-20261011-lipp-eval-pb-valid-lipp-test-36-autodock-vina
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    38cd7efaf6883864b24295f58400bf905308ff4c32cb682f6e180e80e24dcdb4
  • record id
    lit-structure-20261011-lipp-eval-pb-valid-lipp-test-36-chai-1
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    3af231fc6d9f19630a950f4631cbb786dd33c2e49484b210d15047597fa9b19c
  • record id
    lit-structure-20261011-lipp-eval-pb-valid-lipp-test-36-diffdock-l
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    bd4157174ce52f14ca49100efcb95e5d7959c669a8cfb7efc28ced68d8caf07b
  • record id
    lit-structure-20261011-lipp-eval-pb-valid-lipp-test-36-rosettafold-aa
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    2dfdc567ed76161dad9f8824db86018c26a76cf930ec45d63fc1f4fc05ac74a2
  • record id
    lit-structure-20261011-lipp-protocol-pb-valid-lipp-test-36
    fields
    • status
    • name
    • description
    • facets
    • source_ids
    • links
    • attributes
    sha256
    67d33c66c88f9a37b17a2ca92882accdb96998534331b746eef756b068b7545d
  • record id
    lit-structure-20261011-lipp-result-pb-valid-lipp-test-36-alphafold-3
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    e65fe1bfe68b7bca11b83118b5b0660191f68f802b88ffa3ae706bc649385321
  • record id
    lit-structure-20261011-lipp-result-pb-valid-lipp-test-36-autodock-vina
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    a35d573049860a87db26f2752db6a621daca9cbe6bc80dd67d4c4961e69576b9
  • record id
    lit-structure-20261011-lipp-result-pb-valid-lipp-test-36-chai-1
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    f81417ba0b8d6133cf26725d9926fce477fbfbcbdfade0c05b620680d4f75260
  • record id
    lit-structure-20261011-lipp-result-pb-valid-lipp-test-36-diffdock-l
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    69ff34c290de5cd7a34ca2205ab05cbcf982fe01b64f03fb3e1f7314ccdbef57
  • record id
    lit-structure-20261011-lipp-result-pb-valid-lipp-test-36-rosettafold-aa
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    68b54f452036d312b457ba5ffda9bdd87ffdb693e712b0ff3231bae9a27dd670
  • record id
    use-case-structural-hypotheses-experiments
    fields
    • status
    • name
    • description
    • facets
    • attributes.question
    • attributes.decision
    • attributes.inputs
    • attributes.output
    • attributes.exclusions
    • attributes.setting
    • attributes.clinical_scope
    • attributes.intended_users
    sha256
    323c287cae7885e983feb5d58f24115afe49ecfbb868a0238c75b1247ffcf228
Context-only references
The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods

Original source ↗

Table 3, column 'LiPP test set (N = 36) % Success Rate'

Version: PMC13292216.1
Retrieved: 2026-09-17T07:56:27.507412+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.pins

Source artifact SHA-256: 6ff34f2f709a14858a3753abf9f8f6efa1e7e3c351f15c70cf64264193a9414e

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Rationale
Proxy, not direct: the use case asks whether a predicted interface or complex is reliable enough to guide an experiment, and this protocol answers it for lipid ligands on complexes no tool could have memorised. It does not cover protein-protein interfaces, protein-peptide complexes or drug-like small molecules, and a correct pose does not establish that the interaction matters in the experiment being planned.
Context-only references
The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods

Original source ↗

Table 3, column 'LiPP test set (N = 36) % Success Rate'

Version: PMC13292216.1
Retrieved: 2026-09-17T07:56:27.507412+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.rationale

Source artifact SHA-256: 6ff34f2f709a14858a3753abf9f8f6efa1e7e3c351f15c70cf64264193a9414e

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: use-case-mapping-lit-structure-20261011-lipp-pb-valid-lipp-test-36

field
links:assessed_by:lit-structure-20261011-lipp-protocol-pb-valid-lipp-test-36
value
lit-structure-20261011-lipp-protocol-pb-valid-lipp-test-36
relevance
proxy
endpoint
Share of 36 post-cutoff lipid-protein complexes whose predicted lipid pose counts as a success (RMSD below 2 Angstrom and PoseBusters valid)
rationale
Proxy, not direct: the use case asks whether a predicted interface or complex is reliable enough to guide an experiment, and this protocol answers it for lipid ligands on complexes no tool could have memorised. It does not cover protein-protein interfaces, protein-peptide complexes or drug-like small molecules, and a correct pose does not establish that the interaction matters in the experiment being planned.
constraints
Lipid ligands only; the LiPP authors note that drug-likeness filters exclude most lipids from PDBbind-derived sets.; Compare only within the same criterion and the same dataset column: the full LiPP set includes complexes inside some tools' training windows.; The 36-complex test set is small, so the printed 95% confidence intervals are wide.; Inspect every linked evaluation's source locator before citing a result.
limitations
Author-run predictions, not an independent reproduction by Rewire.; The PoseBusters columns in the same tables are literature values compiled by the LiPP authors and are recorded as paper_compilation.; Pose accuracy only; the paper's confidence-score analysis is in figures and was not extracted.; Several printed test-set percentages are truncated rather than rounded (for example 11 of 36 printed as 30.5); the values are kept as printed.; The full LiPP set and the PoseBusters columns are not linked to the use case: the full set includes complexes inside some tools' training windows, and the PoseBusters values are literature compilations on drug-like ligands.
citation locators
source id: evidence-expansion-p2-lipp-2026-6ff34f2f709a; locator: Table 3, column 'LiPP test set (N = 36) % Success Rate'
source locator
Table 3, column 'LiPP test set (N = 36) % Success Rate'
headline metric
success-rate
comparison group
lipid-protein-poses
comparison title
Lipid-protein pose predictions
stratum label
Lipid poses on 36 post-cutoff complexes (LiPP)
stratum order
2
reviewed evaluations
lit-structure-20261011-lipp-eval-pb-valid-lipp-test-36-alphafold-3; lit-structure-20261011-lipp-eval-pb-valid-lipp-test-36-autodock-vina; lit-structure-20261011-lipp-eval-pb-valid-lipp-test-36-chai-1; lit-structure-20261011-lipp-eval-pb-valid-lipp-test-36-diffdock-l; lit-structure-20261011-lipp-eval-pb-valid-lipp-test-36-rosettafold-aa
review
method: ai-assisted-source-review; scope-review; method note: Reviewer checked the endpoint against the use case's inputs, output and exclusions, the relevance rating and the limitations; every evaluation on the protocol had its values checked in the batch review. Corrections listed in review.md were applied by the extractor.; reviewer: claude; reviewer note: Claude review agent reviewer-ps-2, independent of the extractor lit-protein-structure; no human review claimed; reviewed at: 2026-10-11T23:30:00Z; note: Automated review; not human scientific review.
pins
record id: evidence-expansion-p2-lipp-2026-6ff34f2f709a; fields: status; attributes.artifact_sha256; sha256: 5594b4fa8a6fa41ce10364e7ef3f97dd2b5e7acdb231a09fc2895e2ec7401fe7; record id: lit-structure-20261011-lipp-eval-pb-valid-lipp-test-36-alphafold-3; fields: status; links; attributes.origin; attributes.comparison; sha256: 1237b83dcdfd65ff7f20f50fafe50fa4a98a13a816f27cfcb131ebbad145c433; record id: lit-structure-20261011-lipp-eval-pb-valid-lipp-test-36-autodock-vina; fields: status; links; attributes.origin; attributes.comparison; sha256: 38cd7efaf6883864b24295f58400bf905308ff4c32cb682f6e180e80e24dcdb4; record id: lit-structure-20261011-lipp-eval-pb-valid-lipp-test-36-chai-1; fields: status; links; attributes.origin; attributes.comparison; sha256: 3af231fc6d9f19630a950f4631cbb786dd33c2e49484b210d15047597fa9b19c; record id: lit-structure-20261011-lipp-eval-pb-valid-lipp-test-36-diffdock-l; fields: status; links; attributes.origin; attributes.comparison; sha256: bd4157174ce52f14ca49100efcb95e5d7959c669a8cfb7efc28ced68d8caf07b; record id: lit-structure-20261011-lipp-eval-pb-valid-lipp-test-36-rosettafold-aa; fields: status; links; attributes.origin; attributes.comparison; sha256: 2dfdc567ed76161dad9f8824db86018c26a76cf930ec45d63fc1f4fc05ac74a2; record id: lit-structure-20261011-lipp-protocol-pb-valid-lipp-test-36; fields: status; name; description; facets; source_ids; links; attributes; sha256: 67d33c66c88f9a37b17a2ca92882accdb96998534331b746eef756b068b7545d; record id: lit-structure-20261011-lipp-result-pb-valid-lipp-test-36-alphafold-3; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: e65fe1bfe68b7bca11b83118b5b0660191f68f802b88ffa3ae706bc649385321; record id: lit-structure-20261011-lipp-result-pb-valid-lipp-test-36-autodock-vina; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: a35d573049860a87db26f2752db6a621daca9cbe6bc80dd67d4c4961e69576b9; record id: lit-structure-20261011-lipp-result-pb-valid-lipp-test-36-chai-1; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: f81417ba0b8d6133cf26725d9926fce477fbfbcbdfade0c05b620680d4f75260; record id: lit-structure-20261011-lipp-result-pb-valid-lipp-test-36-diffdock-l; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 69ff34c290de5cd7a34ca2205ab05cbcf982fe01b64f03fb3e1f7314ccdbef57; record id: lit-structure-20261011-lipp-result-pb-valid-lipp-test-36-rosettafold-aa; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 68b54f452036d312b457ba5ffda9bdd87ffdb693e712b0ff3231bae9a27dd670; record id: use-case-structural-hypotheses-experiments; fields: status; name; description; facets; attributes.question; attributes.decision; attributes.inputs; attributes.output; attributes.exclusions; attributes.setting; attributes.clinical_scope; attributes.intended_users; sha256: 323c287cae7885e983feb5d58f24115afe49ecfbb868a0238c75b1247ffcf228
reason
Add a relevance judgement for a protocol from the 2026-10-11 protein-fitness and structure-design literature pass, reviewed in docs/reviews/2026-10-11-protein-structure-suites.md.
Related records

Suggest a correction