rewirebio.iobenchmarks
Evidence claim

Relevance of LiPP test set (lipid pose all-atom RMSD below 2 Angstrom) to "Choose structural hypotheses to guide experiments"

Use case
Choose structural hypotheses to guide experiments
Assessed by
LiPP Table 2: lipid pose all-atom RMSD below 2 Angstrom, LiPP test set
Relevance
Proxy evidence
Endpoint
Share of 36 post-cutoff lipid-protein complexes whose predicted lipid pose counts as a success (lipid pose all-atom RMSD below 2 Angstrom)

Lipid-protein pose accuracy on complexes released after every tool's training cutoff, as evidence for trusting a predicted ligand complex.

5 reviewed evaluations

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

19 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Citation locations
1 values
  • source id
    evidence-expansion-p2-lipp-2026-6ff34f2f709a
    locator
    Table 2, column 'LiPP test set (N = 36) % Success Rate'
Context-only references
The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods

Original source ↗

Table 2, column 'LiPP test set (N = 36) % Success Rate'

Version: PMC13292216.1
Retrieved: 2026-09-17T07:56:27.507412+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.citation_locators

Source artifact SHA-256: 6ff34f2f709a14858a3753abf9f8f6efa1e7e3c351f15c70cf64264193a9414e

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Comparison group
lipid-protein-poses
Context-only references
The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods

Original source ↗

Table 2, column 'LiPP test set (N = 36) % Success Rate'

Version: PMC13292216.1
Retrieved: 2026-09-17T07:56:27.507412+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.comparison_group

Source artifact SHA-256: 6ff34f2f709a14858a3753abf9f8f6efa1e7e3c351f15c70cf64264193a9414e

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Comparison title
Lipid-protein pose predictions
Context-only references
The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods

Original source ↗

Table 2, column 'LiPP test set (N = 36) % Success Rate'

Version: PMC13292216.1
Retrieved: 2026-09-17T07:56:27.507412+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.comparison_title

Source artifact SHA-256: 6ff34f2f709a14858a3753abf9f8f6efa1e7e3c351f15c70cf64264193a9414e

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Constraints
4 values
  • Lipid ligands only; the LiPP authors note that drug-likeness filters exclude most lipids from PDBbind-derived sets.
  • Compare only within the same criterion and the same dataset column: the full LiPP set includes complexes inside some tools' training windows.
  • The 36-complex test set is small, so the printed 95% confidence intervals are wide.
  • Inspect every linked evaluation's source locator before citing a result.
Context-only references
The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods

Original source ↗

Table 2, column 'LiPP test set (N = 36) % Success Rate'

Version: PMC13292216.1
Retrieved: 2026-09-17T07:56:27.507412+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.constraints

Source artifact SHA-256: 6ff34f2f709a14858a3753abf9f8f6efa1e7e3c351f15c70cf64264193a9414e

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Endpoint
Share of 36 post-cutoff lipid-protein complexes whose predicted lipid pose counts as a success (lipid pose all-atom RMSD below 2 Angstrom)
Context-only references
The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods

Original source ↗

Table 2, column 'LiPP test set (N = 36) % Success Rate'

Version: PMC13292216.1
Retrieved: 2026-09-17T07:56:27.507412+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.endpoint

Source artifact SHA-256: 6ff34f2f709a14858a3753abf9f8f6efa1e7e3c351f15c70cf64264193a9414e

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Claimed field
links:assessed_by:lit-structure-20261011-lipp-protocol-rmsd-lipp-test-36
Context-only references
The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods

Original source ↗

Table 2, column 'LiPP test set (N = 36) % Success Rate'

Version: PMC13292216.1
Retrieved: 2026-09-17T07:56:27.507412+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.field

Source artifact SHA-256: 6ff34f2f709a14858a3753abf9f8f6efa1e7e3c351f15c70cf64264193a9414e

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Headline metric
ligand-rmsd-under-2a-rate
Context-only references
The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods

Original source ↗

Table 2, column 'LiPP test set (N = 36) % Success Rate'

Version: PMC13292216.1
Retrieved: 2026-09-17T07:56:27.507412+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.headline_metric

Source artifact SHA-256: 6ff34f2f709a14858a3753abf9f8f6efa1e7e3c351f15c70cf64264193a9414e

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Limitations
5 values
  • Author-run predictions, not an independent reproduction by Rewire.
  • The PoseBusters columns in the same tables are literature values compiled by the LiPP authors and are recorded as paper_compilation.
  • Pose accuracy only; the paper's confidence-score analysis is in figures and was not extracted.
  • Several printed test-set percentages are truncated rather than rounded (for example 11 of 36 printed as 30.5); the values are kept as printed.
  • The full LiPP set and the PoseBusters columns are not linked to the use case: the full set includes complexes inside some tools' training windows, and the PoseBusters values are literature compilations on drug-like ligands.
Context-only references
The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods

Original source ↗

Table 2, column 'LiPP test set (N = 36) % Success Rate'

Version: PMC13292216.1
Retrieved: 2026-09-17T07:56:27.507412+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.limitations

Source artifact SHA-256: 6ff34f2f709a14858a3753abf9f8f6efa1e7e3c351f15c70cf64264193a9414e

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Pinned records
13 values
  • record id
    evidence-expansion-p2-lipp-2026-6ff34f2f709a
    fields
    • status
    • attributes.artifact_sha256
    sha256
    5594b4fa8a6fa41ce10364e7ef3f97dd2b5e7acdb231a09fc2895e2ec7401fe7
  • record id
    lit-structure-20261011-lipp-eval-rmsd-lipp-test-36-alphafold-3
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    2fabfd08e96b0864ee8adb633a11b1b6858b6834a48eef40424c617872ad48c4
  • record id
    lit-structure-20261011-lipp-eval-rmsd-lipp-test-36-autodock-vina
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    36f120cefc6ecef4214a434ae595796dee8d89c0a0a097c49f7098b03e85d3c3
  • record id
    lit-structure-20261011-lipp-eval-rmsd-lipp-test-36-chai-1
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    679d6bde065cf1caa3faf24a367e27501329f608aa7e0965a056debd18a6b6e9
  • record id
    lit-structure-20261011-lipp-eval-rmsd-lipp-test-36-diffdock-l
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    4fe18f4aae419d5a3606c0269d27dabebb5d1914f45678bdec62623a6df38689
  • record id
    lit-structure-20261011-lipp-eval-rmsd-lipp-test-36-rosettafold-aa
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    ac0cb58d5df016282453ba4ee08cbb8e4b400b9d2da72c37305dddad4d0294f2
  • record id
    lit-structure-20261011-lipp-protocol-rmsd-lipp-test-36
    fields
    • status
    • name
    • description
    • facets
    • source_ids
    • links
    • attributes
    sha256
    f5e802fba553e46019c5bd27c22d527799d6dca2147b0791ff9fdd2fd110964e
  • record id
    lit-structure-20261011-lipp-result-rmsd-lipp-test-36-alphafold-3
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    1a6b4c1e391cf04c8e7ea386a6ac215b0ddb1a90fa704d7aaedcc2d3d4552299
  • record id
    lit-structure-20261011-lipp-result-rmsd-lipp-test-36-autodock-vina
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    562e54f4f7d4e50d024f0f2d312efd6c0db8b253ade35bfbb30abfb75b4c9e28
  • record id
    lit-structure-20261011-lipp-result-rmsd-lipp-test-36-chai-1
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    17ad3d76aa3744c62ba7cd9fe58a721ff3e14e2bdb5448d371c9851b24b842de
  • record id
    lit-structure-20261011-lipp-result-rmsd-lipp-test-36-diffdock-l
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    562e54f4f7d4e50d024f0f2d312efd6c0db8b253ade35bfbb30abfb75b4c9e28
  • record id
    lit-structure-20261011-lipp-result-rmsd-lipp-test-36-rosettafold-aa
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    cecb043d5b547aff6d319d92f2974b2486c0e60b1085adcec02fac23bbbb3a16
  • record id
    use-case-structural-hypotheses-experiments
    fields
    • status
    • name
    • description
    • facets
    • attributes.question
    • attributes.decision
    • attributes.inputs
    • attributes.output
    • attributes.exclusions
    • attributes.setting
    • attributes.clinical_scope
    • attributes.intended_users
    sha256
    323c287cae7885e983feb5d58f24115afe49ecfbb868a0238c75b1247ffcf228
Context-only references
The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods

Original source ↗

Table 2, column 'LiPP test set (N = 36) % Success Rate'

Version: PMC13292216.1
Retrieved: 2026-09-17T07:56:27.507412+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.pins

Source artifact SHA-256: 6ff34f2f709a14858a3753abf9f8f6efa1e7e3c351f15c70cf64264193a9414e

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Rationale
Proxy, not direct: the use case asks whether a predicted interface or complex is reliable enough to guide an experiment, and this protocol answers it for lipid ligands on complexes no tool could have memorised. It does not cover protein-protein interfaces, protein-peptide complexes or drug-like small molecules, and a correct pose does not establish that the interaction matters in the experiment being planned.
Context-only references
The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods

Original source ↗

Table 2, column 'LiPP test set (N = 36) % Success Rate'

Version: PMC13292216.1
Retrieved: 2026-09-17T07:56:27.507412+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.rationale

Source artifact SHA-256: 6ff34f2f709a14858a3753abf9f8f6efa1e7e3c351f15c70cf64264193a9414e

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: use-case-mapping-lit-structure-20261011-lipp-rmsd-lipp-test-36

field
links:assessed_by:lit-structure-20261011-lipp-protocol-rmsd-lipp-test-36
value
lit-structure-20261011-lipp-protocol-rmsd-lipp-test-36
relevance
proxy
endpoint
Share of 36 post-cutoff lipid-protein complexes whose predicted lipid pose counts as a success (lipid pose all-atom RMSD below 2 Angstrom)
rationale
Proxy, not direct: the use case asks whether a predicted interface or complex is reliable enough to guide an experiment, and this protocol answers it for lipid ligands on complexes no tool could have memorised. It does not cover protein-protein interfaces, protein-peptide complexes or drug-like small molecules, and a correct pose does not establish that the interaction matters in the experiment being planned.
constraints
Lipid ligands only; the LiPP authors note that drug-likeness filters exclude most lipids from PDBbind-derived sets.; Compare only within the same criterion and the same dataset column: the full LiPP set includes complexes inside some tools' training windows.; The 36-complex test set is small, so the printed 95% confidence intervals are wide.; Inspect every linked evaluation's source locator before citing a result.
limitations
Author-run predictions, not an independent reproduction by Rewire.; The PoseBusters columns in the same tables are literature values compiled by the LiPP authors and are recorded as paper_compilation.; Pose accuracy only; the paper's confidence-score analysis is in figures and was not extracted.; Several printed test-set percentages are truncated rather than rounded (for example 11 of 36 printed as 30.5); the values are kept as printed.; The full LiPP set and the PoseBusters columns are not linked to the use case: the full set includes complexes inside some tools' training windows, and the PoseBusters values are literature compilations on drug-like ligands.
citation locators
source id: evidence-expansion-p2-lipp-2026-6ff34f2f709a; locator: Table 2, column 'LiPP test set (N = 36) % Success Rate'
source locator
Table 2, column 'LiPP test set (N = 36) % Success Rate'
headline metric
ligand-rmsd-under-2a-rate
comparison group
lipid-protein-poses
comparison title
Lipid-protein pose predictions
stratum label
Lipid poses on 36 post-cutoff complexes (LiPP)
stratum order
1
reviewed evaluations
lit-structure-20261011-lipp-eval-rmsd-lipp-test-36-alphafold-3; lit-structure-20261011-lipp-eval-rmsd-lipp-test-36-autodock-vina; lit-structure-20261011-lipp-eval-rmsd-lipp-test-36-chai-1; lit-structure-20261011-lipp-eval-rmsd-lipp-test-36-diffdock-l; lit-structure-20261011-lipp-eval-rmsd-lipp-test-36-rosettafold-aa
review
method: ai-assisted-source-review; scope-review; method note: Reviewer checked the endpoint against the use case's inputs, output and exclusions, the relevance rating and the limitations; every evaluation on the protocol had its values checked in the batch review. Corrections listed in review.md were applied by the extractor.; reviewer: claude; reviewer note: Claude review agent reviewer-ps-2, independent of the extractor lit-protein-structure; no human review claimed; reviewed at: 2026-10-11T23:30:00Z; note: Automated review; not human scientific review.
pins
record id: evidence-expansion-p2-lipp-2026-6ff34f2f709a; fields: status; attributes.artifact_sha256; sha256: 5594b4fa8a6fa41ce10364e7ef3f97dd2b5e7acdb231a09fc2895e2ec7401fe7; record id: lit-structure-20261011-lipp-eval-rmsd-lipp-test-36-alphafold-3; fields: status; links; attributes.origin; attributes.comparison; sha256: 2fabfd08e96b0864ee8adb633a11b1b6858b6834a48eef40424c617872ad48c4; record id: lit-structure-20261011-lipp-eval-rmsd-lipp-test-36-autodock-vina; fields: status; links; attributes.origin; attributes.comparison; sha256: 36f120cefc6ecef4214a434ae595796dee8d89c0a0a097c49f7098b03e85d3c3; record id: lit-structure-20261011-lipp-eval-rmsd-lipp-test-36-chai-1; fields: status; links; attributes.origin; attributes.comparison; sha256: 679d6bde065cf1caa3faf24a367e27501329f608aa7e0965a056debd18a6b6e9; record id: lit-structure-20261011-lipp-eval-rmsd-lipp-test-36-diffdock-l; fields: status; links; attributes.origin; attributes.comparison; sha256: 4fe18f4aae419d5a3606c0269d27dabebb5d1914f45678bdec62623a6df38689; record id: lit-structure-20261011-lipp-eval-rmsd-lipp-test-36-rosettafold-aa; fields: status; links; attributes.origin; attributes.comparison; sha256: ac0cb58d5df016282453ba4ee08cbb8e4b400b9d2da72c37305dddad4d0294f2; record id: lit-structure-20261011-lipp-protocol-rmsd-lipp-test-36; fields: status; name; description; facets; source_ids; links; attributes; sha256: f5e802fba553e46019c5bd27c22d527799d6dca2147b0791ff9fdd2fd110964e; record id: lit-structure-20261011-lipp-result-rmsd-lipp-test-36-alphafold-3; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 1a6b4c1e391cf04c8e7ea386a6ac215b0ddb1a90fa704d7aaedcc2d3d4552299; record id: lit-structure-20261011-lipp-result-rmsd-lipp-test-36-autodock-vina; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 562e54f4f7d4e50d024f0f2d312efd6c0db8b253ade35bfbb30abfb75b4c9e28; record id: lit-structure-20261011-lipp-result-rmsd-lipp-test-36-chai-1; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 17ad3d76aa3744c62ba7cd9fe58a721ff3e14e2bdb5448d371c9851b24b842de; record id: lit-structure-20261011-lipp-result-rmsd-lipp-test-36-diffdock-l; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 562e54f4f7d4e50d024f0f2d312efd6c0db8b253ade35bfbb30abfb75b4c9e28; record id: lit-structure-20261011-lipp-result-rmsd-lipp-test-36-rosettafold-aa; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: cecb043d5b547aff6d319d92f2974b2486c0e60b1085adcec02fac23bbbb3a16; record id: use-case-structural-hypotheses-experiments; fields: status; name; description; facets; attributes.question; attributes.decision; attributes.inputs; attributes.output; attributes.exclusions; attributes.setting; attributes.clinical_scope; attributes.intended_users; sha256: 323c287cae7885e983feb5d58f24115afe49ecfbb868a0238c75b1247ffcf228
reason
Add a relevance judgement for a protocol from the 2026-10-11 protein-fitness and structure-design literature pass, reviewed in docs/reviews/2026-10-11-protein-structure-suites.md.
Related records

Suggest a correction