rewirebio.iobenchmarks
Source

The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods

PMC13292216.1

DOI: 10.1021/acs.jcim.6c01457Original source

What this source contributed

Records in this release that cite this source. A record can cite several sources.

Results

Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.

Model or configurationMetricValueDatasetEvaluation
AlphaFold 3 (LiPP evaluation)Ligand RMSD under 2a rate (lipid pose all-atom RMSD below 2 Angstrom; Full LiPP set)76.1 {71.1–80.6} percentLiPP benchmark set (331 lipid-protein complexes)AlphaFold 3 on Full LiPP set (lipid pose all-atom RMSD below 2 Angstrom)
AlphaFold 3 (LiPP evaluation)Success rate (RMSD below 2 Angstrom and PoseBusters valid; Full LiPP set)64.3 {58.9–69.5} percentLiPP benchmark set (331 lipid-protein complexes)AlphaFold 3 on Full LiPP set (RMSD below 2 Angstrom and PoseBusters valid)
AlphaFold 3 (LiPP evaluation)Ligand RMSD under 2a rate (lipid pose all-atom RMSD below 2 Angstrom; LiPP test set)47.2 {30.4–64.5} percentLiPP test set (36 complexes released after every tool's cutoff)AlphaFold 3 on LiPP test set (lipid pose all-atom RMSD below 2 Angstrom)
AlphaFold 3 (LiPP evaluation)Success rate (RMSD below 2 Angstrom and PoseBusters valid; LiPP test set)25.0 {12.1–42.2} percentLiPP test set (36 complexes released after every tool's cutoff)AlphaFold 3 on LiPP test set (RMSD below 2 Angstrom and PoseBusters valid)
AlphaFold 3 (LiPP evaluation)Ligand RMSD under 2a rate (ligand pose RMSD below 2 Angstrom, as reported in the cited literature; PoseBusters v1)†76.4 {72.1–80.3} percentPoseBusters v1 (428 protein-small molecule complexes)AlphaFold 3 on PoseBusters v1 (lipid pose all-atom RMSD below 2 Angstrom)
AlphaFold 3 (LiPP evaluation)Ligand RMSD under 2a rate (ligand pose RMSD below 2 Angstrom, as reported in the cited literature; PoseBusters v2)†80.5 {75.6–84.8} percentPoseBusters v2 (308 protein-small molecule complexes)AlphaFold 3 on PoseBusters v2 (lipid pose all-atom RMSD below 2 Angstrom)
AutoDock Vina (LiPP evaluation)Ligand RMSD under 2a rate (lipid pose all-atom RMSD below 2 Angstrom; Full LiPP set)47.7 {42.2–53.2} percentLiPP benchmark set (331 lipid-protein complexes)AutoDock Vina on Full LiPP set (lipid pose all-atom RMSD below 2 Angstrom)
AutoDock Vina (LiPP evaluation)Success rate (RMSD below 2 Angstrom and PoseBusters valid; Full LiPP set)45.9 {40.4–51.4} percentLiPP benchmark set (331 lipid-protein complexes)AutoDock Vina on Full LiPP set (RMSD below 2 Angstrom and PoseBusters valid)
AutoDock Vina (LiPP evaluation)Ligand RMSD under 2a rate (lipid pose all-atom RMSD below 2 Angstrom; LiPP test set)30.5 {16.3–48.1} percentLiPP test set (36 complexes released after every tool's cutoff)AutoDock Vina on LiPP test set (lipid pose all-atom RMSD below 2 Angstrom)
AutoDock Vina (LiPP evaluation)Success rate (RMSD below 2 Angstrom and PoseBusters valid; LiPP test set)30.5 {16.3–48.1} percentLiPP test set (36 complexes released after every tool's cutoff)AutoDock Vina on LiPP test set (RMSD below 2 Angstrom and PoseBusters valid)
AutoDock Vina (LiPP evaluation)Ligand RMSD under 2a rate (ligand pose RMSD below 2 Angstrom, as reported in the cited literature; PoseBusters v2)60 percentPoseBusters v2 (308 protein-small molecule complexes)AutoDock Vina on PoseBusters v2 (lipid pose all-atom RMSD below 2 Angstrom)
AutoDock Vina (LiPP evaluation)Success rate (RMSD below 2 Angstrom and PoseBusters valid; PoseBusters v2)58 percentPoseBusters v2 (308 protein-small molecule complexes)AutoDock Vina on PoseBusters v2 (RMSD below 2 Angstrom and PoseBusters valid)
Chai-1 (LiPP evaluation)Ligand RMSD under 2a rate (lipid pose all-atom RMSD below 2 Angstrom; Full LiPP set)60.7 {55.2–66.0} percentLiPP benchmark set (331 lipid-protein complexes)Chai-1 on Full LiPP set (lipid pose all-atom RMSD below 2 Angstrom)
Chai-1 (LiPP evaluation)Success rate (RMSD below 2 Angstrom and PoseBusters valid; Full LiPP set)39.5 {34.2–45.0} percentLiPP benchmark set (331 lipid-protein complexes)Chai-1 on Full LiPP set (RMSD below 2 Angstrom and PoseBusters valid)
Chai-1 (LiPP evaluation)Ligand RMSD under 2a rate (lipid pose all-atom RMSD below 2 Angstrom; LiPP test set)36.1 {20.8–53.7} percentLiPP test set (36 complexes released after every tool's cutoff)Chai-1 on LiPP test set (lipid pose all-atom RMSD below 2 Angstrom)
Chai-1 (LiPP evaluation)Success rate (RMSD below 2 Angstrom and PoseBusters valid; LiPP test set)16.6 {6.3–32.8} percentLiPP test set (36 complexes released after every tool's cutoff)Chai-1 on LiPP test set (RMSD below 2 Angstrom and PoseBusters valid)
Chai-1 (LiPP evaluation)Ligand RMSD under 2a rate (ligand pose RMSD below 2 Angstrom, as reported in the cited literature; PoseBusters v1)77 percentPoseBusters v1 (428 protein-small molecule complexes)Chai-1 on PoseBusters v1 (lipid pose all-atom RMSD below 2 Angstrom)
DiffDock-L (LiPP evaluation)Ligand RMSD under 2a rate (lipid pose all-atom RMSD below 2 Angstrom; Full LiPP set)46.8 {41.3–52.3} percentLiPP benchmark set (331 lipid-protein complexes)DiffDock-L on Full LiPP set (lipid pose all-atom RMSD below 2 Angstrom)
DiffDock-L (LiPP evaluation)Success rate (RMSD below 2 Angstrom and PoseBusters valid; Full LiPP set)24.1 {19.6–29.1} percentLiPP benchmark set (331 lipid-protein complexes)DiffDock-L on Full LiPP set (RMSD below 2 Angstrom and PoseBusters valid)
DiffDock-L (LiPP evaluation)Ligand RMSD under 2a rate (lipid pose all-atom RMSD below 2 Angstrom; LiPP test set)30.5 {16.3–48.1} percentLiPP test set (36 complexes released after every tool's cutoff)DiffDock-L on LiPP test set (lipid pose all-atom RMSD below 2 Angstrom)
DiffDock-L (LiPP evaluation)Success rate (RMSD below 2 Angstrom and PoseBusters valid; LiPP test set)8.3 {1.7–22.4} percentLiPP test set (36 complexes released after every tool's cutoff)DiffDock-L on LiPP test set (RMSD below 2 Angstrom and PoseBusters valid)
DiffDock-L (LiPP evaluation)Ligand RMSD under 2a rate (ligand pose RMSD below 2 Angstrom, as reported in the cited literature; PoseBusters v2)50 percentPoseBusters v2 (308 protein-small molecule complexes)DiffDock-L on PoseBusters v2 (lipid pose all-atom RMSD below 2 Angstrom)
RoseTTAFold AA (LiPP evaluation)Ligand RMSD under 2a rate (lipid pose all-atom RMSD below 2 Angstrom; Full LiPP set)37.1 {31.9–42.6} percentLiPP benchmark set (331 lipid-protein complexes)RoseTTAFold AA on Full LiPP set (lipid pose all-atom RMSD below 2 Angstrom)
RoseTTAFold AA (LiPP evaluation)Success rate (RMSD below 2 Angstrom and PoseBusters valid; Full LiPP set)15.4 {11.6–19.7} percentLiPP benchmark set (331 lipid-protein complexes)RoseTTAFold AA on Full LiPP set (RMSD below 2 Angstrom and PoseBusters valid)
RoseTTAFold AA (LiPP evaluation)Ligand RMSD under 2a rate (lipid pose all-atom RMSD below 2 Angstrom; LiPP test set)11.1 {3.1–26.0} percentLiPP test set (36 complexes released after every tool's cutoff)RoseTTAFold AA on LiPP test set (lipid pose all-atom RMSD below 2 Angstrom)
RoseTTAFold AA (LiPP evaluation)Success rate (RMSD below 2 Angstrom and PoseBusters valid; LiPP test set)2.7 {0.07–14.5} percentLiPP test set (36 complexes released after every tool's cutoff)RoseTTAFold AA on LiPP test set (RMSD below 2 Angstrom and PoseBusters valid)
RoseTTAFold AA (LiPP evaluation)Ligand RMSD under 2a rate (ligand pose RMSD below 2 Angstrom, as reported in the cited literature; PoseBusters v1)42 percentPoseBusters v1 (428 protein-small molecule complexes)RoseTTAFold AA on PoseBusters v1 (lipid pose all-atom RMSD below 2 Angstrom)

Claims

Statements this source supports, each with where in the source it was checked.

Models, benchmarks and other records

Models (1)

Configurations (5)

Benchmarks (1)

Tasks (1)

Protocols (7)

Datasets (4)

Evaluations (27)

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

16 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Artifact SHA-256
6ff34f2f709a14858a3753abf9f8f6efa1e7e3c351f15c70cf64264193a9414e
Source metadata
The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods

Original source ↗

No field-specific location recorded

Version: PMC13292216.1
Retrieved: 2026-09-17T07:56:27.507412+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_sha256

Source artifact SHA-256: 6ff34f2f709a14858a3753abf9f8f6efa1e7e3c351f15c70cf64264193a9414e

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Artifact url
https://www.ebi.ac.uk/europepmc/webservices/rest/PMC13292216/fullTextXML
Source metadata
The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods

Original source ↗

No field-specific location recorded

Version: PMC13292216.1
Retrieved: 2026-09-17T07:56:27.507412+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_url

Source artifact SHA-256: 6ff34f2f709a14858a3753abf9f8f6efa1e7e3c351f15c70cf64264193a9414e

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Doi
10.1021/acs.jcim.6c01457
Source metadata
The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods

Original source ↗

No field-specific location recorded

Version: PMC13292216.1
Retrieved: 2026-09-17T07:56:27.507412+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.doi

Source artifact SHA-256: 6ff34f2f709a14858a3753abf9f8f6efa1e7e3c351f15c70cf64264193a9414e

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Hash scope
Exact retrieved primary paper artifact bytes.
Source metadata
The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods

Original source ↗

No field-specific location recorded

Version: PMC13292216.1
Retrieved: 2026-09-17T07:56:27.507412+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.hash_scope

Source artifact SHA-256: 6ff34f2f709a14858a3753abf9f8f6efa1e7e3c351f15c70cf64264193a9414e

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Retrieved at
2026-09-17T07:56:27.507412+00:00
Source metadata
The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods

Original source ↗

No field-specific location recorded

Version: PMC13292216.1
Retrieved: 2026-09-17T07:56:27.507412+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.retrieved_at

Source artifact SHA-256: 6ff34f2f709a14858a3753abf9f8f6efa1e7e3c351f15c70cf64264193a9414e

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Review method
1 values
  • automated-source-review
Source metadata
The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods

Original source ↗

No field-specific location recorded

Version: PMC13292216.1
Retrieved: 2026-09-17T07:56:27.507412+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.review.method

Source artifact SHA-256: 6ff34f2f709a14858a3753abf9f8f6efa1e7e3c351f15c70cf64264193a9414e

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Review: scope
Source identification and table transcription; no independent experimental reproduction.
Source metadata
The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods

Original source ↗

No field-specific location recorded

Version: PMC13292216.1
Retrieved: 2026-09-17T07:56:27.507412+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.review.scope

Source artifact SHA-256: 6ff34f2f709a14858a3753abf9f8f6efa1e7e3c351f15c70cf64264193a9414e

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Url
https://www.ebi.ac.uk/europepmc/webservices/rest/PMC13292216/fullTextXML
Source metadata
The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods

Original source ↗

No field-specific location recorded

Version: PMC13292216.1
Retrieved: 2026-09-17T07:56:27.507412+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.url

Source artifact SHA-256: 6ff34f2f709a14858a3753abf9f8f6efa1e7e3c351f15c70cf64264193a9414e

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Version
PMC13292216.1
Source metadata
The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods

Original source ↗

No field-specific location recorded

Version: PMC13292216.1
Retrieved: 2026-09-17T07:56:27.507412+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.version

Source artifact SHA-256: 6ff34f2f709a14858a3753abf9f8f6efa1e7e3c351f15c70cf64264193a9414e

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Description
Primary reference; inspect retrieval status and review scope.
Source metadata
The LiPP Benchmark Set for Modeling Lipid–Protein Complexes: Comparison of Co-Folding and Docking Methods

Original source ↗

No field-specific location recorded

Version: PMC13292216.1
Retrieved: 2026-09-17T07:56:27.507412+00:00

catalogued

No individual claim review recorded

Audit details

Field: description

Source artifact SHA-256: 6ff34f2f709a14858a3753abf9f8f6efa1e7e3c351f15c70cf64264193a9414e

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

Primary reference; inspect retrieval status and review scope.

Release history

No supporting source is linked yet.

Read original source

Download this release (gzip)
Technical metadata and extraction receipts

Stable ID: evidence-expansion-p2-lipp-2026-6ff34f2f709a

url
https://www.ebi.ac.uk/europepmc/webservices/rest/PMC13292216/fullTextXML
doi
10.1021/acs.jcim.6c01457
version
PMC13292216.1
retrieved at
2026-09-17T07:56:27.507412+00:00
artifact sha256
6ff34f2f709a14858a3753abf9f8f6efa1e7e3c351f15c70cf64264193a9414e
artifact url
https://www.ebi.ac.uk/europepmc/webservices/rest/PMC13292216/fullTextXML
hash scope
Exact retrieved primary paper artifact bytes.
review
scope: Source identification and table transcription; no independent experimental reproduction.; method: automated-source-review
limitations
Tables 2 and 3 only. The confidence-score analyses, the per-lipid-class breakdowns and the PoseBusters validity checks in the figures were not extracted.; The PoseBusters v1 and v2 columns are values the authors took from other publications, not runs of their own; they are recorded as paper_compilation.; Cells printed as '-' (not yet evaluated on that set) are left out: 4 cells in Table 2 and 9 in Table 3.
Related records

Suggest a correction