Relevance of Lipase EstA dataset stability ranking (Chu et al. 2024) to "Assess methods for protein stability experiments"
- Use case
- Assess methods for protein stability experiments
- Assessed by
- Lipase EstA dataset stability ranking, Spearman correlation (Chu et al. 2024 Table 1)
- Relevance
- Proxy evidence
- Endpoint
- Spearman correlation for Rosetta, MUPro, RaSP, ELASPIC-2, ESM therm and two ESM-2 checkpoints on Lipase EstA dataset
Measures ranking against melting temperature (T50) in a single larger protein, which is a proxy for folding stability and shows how methods transfer beyond small domains.
7 reviewed evaluations
- ELASPIC-2 on Lipase EstA dataset (Chu et al. 2024)
- ESM-2 (35M) on Lipase EstA dataset (Chu et al. 2024)
- ESM-2 (3B) on Lipase EstA dataset (Chu et al. 2024)
- ESM therm on Lipase EstA dataset (Chu et al. 2024)
- MUPro on Lipase EstA dataset (Chu et al. 2024)
- RaSP on Lipase EstA dataset (Chu et al. 2024)
- Rosetta on Lipase EstA dataset (Chu et al. 2024)
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
20 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
Citation locations1 values
| Protein stability prediction by fine-tuning a protein language model on a mega-scale dataset protein-stability-20261009-source-chu2024: Table 1 row 'Lipase EstA dataset'; Table 2; Results Version: PLOS Computational Biology 20(7):e1012248, published 2024-07-22; PMC11293664 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Comparison group chu2024-transfer Context-only references | Protein stability prediction by fine-tuning a protein language model on a mega-scale dataset protein-stability-20261009-source-chu2024: Table 1 row 'Lipase EstA dataset'; Table 2; Results Version: PLOS Computational Biology 20(7):e1012248, published 2024-07-22; PMC11293664 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Comparison title Transfer from mega-scale domains to larger proteins (Chu et al. 2024) Context-only references | Protein stability prediction by fine-tuning a protein language model on a mega-scale dataset protein-stability-20261009-source-chu2024: Table 1 row 'Lipase EstA dataset'; Table 2; Results Version: PLOS Computational Biology 20(7):e1012248, published 2024-07-22; PMC11293664 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Constraints2 values
| Protein stability prediction by fine-tuning a protein language model on a mega-scale dataset protein-stability-20261009-source-chu2024: Table 1 row 'Lipase EstA dataset'; Table 2; Results Version: PLOS Computational Biology 20(7):e1012248, published 2024-07-22; PMC11293664 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Endpoint Spearman correlation for Rosetta, MUPro, RaSP, ELASPIC-2, ESM therm and two ESM-2 checkpoints on Lipase EstA dataset Context-only references | Protein stability prediction by fine-tuning a protein language model on a mega-scale dataset protein-stability-20261009-source-chu2024: Table 1 row 'Lipase EstA dataset'; Table 2; Results Version: PLOS Computational Biology 20(7):e1012248, published 2024-07-22; PMC11293664 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Claimed field links:assessed_by:protein-stability-20261009-protocol-chu2024-lipase-esta Context-only references | Protein stability prediction by fine-tuning a protein language model on a mega-scale dataset protein-stability-20261009-source-chu2024: Table 1 row 'Lipase EstA dataset'; Table 2; Results Version: PLOS Computational Biology 20(7):e1012248, published 2024-07-22; PMC11293664 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Headline metric spearman-correlation Context-only references | Protein stability prediction by fine-tuning a protein language model on a mega-scale dataset protein-stability-20261009-source-chu2024: Table 1 row 'Lipase EstA dataset'; Table 2; Results Version: PLOS Computational Biology 20(7):e1012248, published 2024-07-22; PMC11293664 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Limitations6 values
| Protein stability prediction by fine-tuning a protein language model on a mega-scale dataset protein-stability-20261009-source-chu2024: Table 1 row 'Lipase EstA dataset'; Table 2; Results Version: PLOS Computational Biology 20(7):e1012248, published 2024-07-22; PMC11293664 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Pinned records17 values
| Protein stability prediction by fine-tuning a protein language model on a mega-scale dataset protein-stability-20261009-source-chu2024: Table 1 row 'Lipase EstA dataset'; Table 2; Results Version: PLOS Computational Biology 20(7):e1012248, published 2024-07-22; PMC11293664 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Rationale Measures ranking against melting temperature (T50) in a single larger protein, which is a proxy for folding stability and shows how methods transfer beyond small domains. Context-only references | Protein stability prediction by fine-tuning a protein language model on a mega-scale dataset protein-stability-20261009-source-chu2024: Table 1 row 'Lipase EstA dataset'; Table 2; Results Version: PLOS Computational Biology 20(7):e1012248, published 2024-07-22; PMC11293664 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Sources and history
Release 2026-11-21-adc15377fab2 · Record review: source checked
1 source record and release history
- Protein stability prediction by fine-tuning a protein language model on a mega-scale dataset · Original source · PLOS Computational Biology 20(7):e1012248, published 2024-07-22; PMC11293664 full-text XML
Technical metadata and extraction receipts
Stable ID: use-case-mapping-protein-stability-20261009-chu2024-lipase-esta
- field
- links:assessed_by:protein-stability-20261009-protocol-chu2024-lipase-esta
- value
- protein-stability-20261009-protocol-chu2024-lipase-esta
- relevance
- proxy
- endpoint
- Spearman correlation for Rosetta, MUPro, RaSP, ELASPIC-2, ESM therm and two ESM-2 checkpoints on Lipase EstA dataset
- rationale
- Measures ranking against melting temperature (T50) in a single larger protein, which is a proxy for folding stability and shows how methods transfer beyond small domains.
- constraints
- Inspect every linked evaluation's source locator before citing a result.; Do not combine this mapping's evaluations with any other protocol's results; datasets, splits, structures and predictor versions differ between sources.
- limitations
- ESM therm was fine-tuned by the authors of this paper; the other methods were run by them as comparators.; Only Spearman correlation is printed; no RMSE, calibration or uncertainty.; The larger-protein benchmark was limited to six ProteinGym datasets and BglB because of Rosetta's compute cost (Methods P25).; Single protein (Lipase EstA, 212 residues); the measured quantity is melting temperature (T50), not ddG of folding.; ESM therm was fine-tuned on domains of at most 72 residues, so this is an out-of-range test for it.; The Results text gives ranges that do not match Table 1 (ELASPIC-2 0.42 to 0.58, Rosetta 0.33 to 0.48); Table 1 values are used.
- revision
- 1
- reason
- Add primary-source stability predictor comparison evidence from the protein stability use-case pass (2026-10-09).
- citation locators
- source id: protein-stability-20261009-source-chu2024; locator: Table 1 row 'Lipase EstA dataset'; Table 2; Results
- source locator
- protein-stability-20261009-source-chu2024: Table 1 row 'Lipase EstA dataset'; Table 2; Results
- comparison group
- chu2024-transfer
- comparison title
- Transfer from mega-scale domains to larger proteins (Chu et al. 2024)
- headline metric
- spearman-correlation
- stratum label
- Lipase EstA (melting temperature (T50))
- stratum order
- 5
- reviewed evaluations
- protein-stability-20261009-eval-chu2024-elaspic-2-lipase-esta; protein-stability-20261009-eval-chu2024-esm-2-35m-lipase-esta; protein-stability-20261009-eval-chu2024-esm-2-3b-lipase-esta; protein-stability-20261009-eval-chu2024-esm-therm-lipase-esta; protein-stability-20261009-eval-chu2024-mupro-lipase-esta; protein-stability-20261009-eval-chu2024-rasp-lipase-esta; protein-stability-20261009-eval-chu2024-rosetta-lipase-esta
- review
- method: automated-source-review; reviewer: claude; reviewer note: Separate Claude review agent, independent of the extractor; no human review claimed; reviewed at: 2026-10-09T23:59:00Z; note: Independent review of endpoint fit, relevance grade, limitations, exclusions and grouping against the use case and the source; every value of the listed evaluations was checked against the source table. No execution, reproduction, human scientific review or clinical validation.
- pins
- record id: protein-stability-20261009-eval-chu2024-elaspic-2-lipase-esta; fields: status; links; attributes.origin; attributes.comparison; sha256: 53adfaa42ea49037884daf9a2d1f7dc36e4ecbb63eba7538c56591b1679f5107; record id: protein-stability-20261009-eval-chu2024-esm-2-35m-lipase-esta; fields: status; links; attributes.origin; attributes.comparison; sha256: 3fcacaef5abaac3c3ce26192b2018967668e4ad0550e72c89a75cbe6a8000bcf; record id: protein-stability-20261009-eval-chu2024-esm-2-3b-lipase-esta; fields: status; links; attributes.origin; attributes.comparison; sha256: d5db941f688f1e8b1e472f62f0563e5f5d5bcadbe466aabb4ece6397e5b813bc; record id: protein-stability-20261009-eval-chu2024-esm-therm-lipase-esta; fields: status; links; attributes.origin; attributes.comparison; sha256: 8bbcc4b175bfd1b616c0365fec33a92901fb802c57df31733c81d3ebf7e3c1fa; record id: protein-stability-20261009-eval-chu2024-mupro-lipase-esta; fields: status; links; attributes.origin; attributes.comparison; sha256: 42d92420f8abb57fe8cf6f2be64eb11566ec424ed727adde6e8ddebb6982e18c; record id: protein-stability-20261009-eval-chu2024-rasp-lipase-esta; fields: status; links; attributes.origin; attributes.comparison; sha256: 9dbb95a370cdf4f7f0a099691f2386703705038d35b4d03ae693fc0cf2c182fe; record id: protein-stability-20261009-eval-chu2024-rosetta-lipase-esta; fields: status; links; attributes.origin; attributes.comparison; sha256: 98737fda046b72c95cfce5df453526d8a6401865201038978dece7faabf95a8c; record id: protein-stability-20261009-protocol-chu2024-lipase-esta; fields: status; name; description; facets; source_ids; links; attributes; sha256: ad8f1751f93a3f5f10de16dddb595e55250db996921409d1b38694b82998ffa8; record id: protein-stability-20261009-result-chu2024-elaspic-2-lipase-esta-spearman-correlation; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: c20358885f366ae05cb05a8ac980551d039bd40f32b689ba5331d8ecb933321a; record id: protein-stability-20261009-result-chu2024-esm-2-35m-lipase-esta-spearman-correlation; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 6c431920de76c4e782558d0f9a6995c5639c417831a7e764b0c35afe8ed0415d; record id: protein-stability-20261009-result-chu2024-esm-2-3b-lipase-esta-spearman-correlation; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 686e6066a96c923ea2a976bf753faa0d821c2c07d92d15189009a9f15ea2e17a; record id: protein-stability-20261009-result-chu2024-esm-therm-lipase-esta-spearman-correlation; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 13de272f11568e2cf639b4007499d30a5f32ce7260f364d2ce1171b9c053d205; record id: protein-stability-20261009-result-chu2024-mupro-lipase-esta-spearman-correlation; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: c957bb851110832ca31f02790e299ec97275907c9642782a7643ae361ab0b5d4; record id: protein-stability-20261009-result-chu2024-rasp-lipase-esta-spearman-correlation; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 0f8bc37c4affb3257a6f4ba3cb1c4564de0ef238c8a7561c90db6912b5ad35f7; record id: protein-stability-20261009-result-chu2024-rosetta-lipase-esta-spearman-correlation; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: f46b26194b50d103522453ee6cd6e07ec0cf5ae66ea2f1c8f788dd2a7f75199a; record id: protein-stability-20261009-source-chu2024; fields: status; attributes.artifact_sha256; sha256: e959594a702e1cfb9147c235f9a31116ada6106293e06b6e23185a14a95803b0; record id: use-case-protein-stability; fields: status; name; description; facets; attributes.question; attributes.decision; attributes.inputs; attributes.output; attributes.exclusions; attributes.setting; attributes.clinical_scope; attributes.intended_users; sha256: 2dd1d0e139a17e51ae72cc5945196ffbb366fe4daa4c20c4efd950346a30a54f