Relevance of BglB dataset stability ranking (Chu et al. 2024) to "Assess methods for protein stability experiments"
- Use case
- Assess methods for protein stability experiments
- Assessed by
- BglB dataset stability ranking, Spearman correlation (Chu et al. 2024 Table 1)
- Relevance
- Proxy evidence
- Endpoint
- Spearman correlation for Rosetta, MUPro, RaSP, ELASPIC-2, ESM therm and two ESM-2 checkpoints on BglB dataset
Measures ranking against melting temperature (Tm) in a single larger protein, which is a proxy for folding stability and shows how methods transfer beyond small domains.
7 reviewed evaluations
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
20 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
Citation locations1 values
| Protein stability prediction by fine-tuning a protein language model on a mega-scale dataset protein-stability-20261009-source-chu2024: Table 1 row 'BglB dataset'; Table 2; Results Version: PLOS Computational Biology 20(7):e1012248, published 2024-07-22; PMC11293664 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Comparison group chu2024-transfer Context-only references | Protein stability prediction by fine-tuning a protein language model on a mega-scale dataset protein-stability-20261009-source-chu2024: Table 1 row 'BglB dataset'; Table 2; Results Version: PLOS Computational Biology 20(7):e1012248, published 2024-07-22; PMC11293664 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Comparison title Transfer from mega-scale domains to larger proteins (Chu et al. 2024) Context-only references | Protein stability prediction by fine-tuning a protein language model on a mega-scale dataset protein-stability-20261009-source-chu2024: Table 1 row 'BglB dataset'; Table 2; Results Version: PLOS Computational Biology 20(7):e1012248, published 2024-07-22; PMC11293664 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Constraints2 values
| Protein stability prediction by fine-tuning a protein language model on a mega-scale dataset protein-stability-20261009-source-chu2024: Table 1 row 'BglB dataset'; Table 2; Results Version: PLOS Computational Biology 20(7):e1012248, published 2024-07-22; PMC11293664 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Endpoint Spearman correlation for Rosetta, MUPro, RaSP, ELASPIC-2, ESM therm and two ESM-2 checkpoints on BglB dataset Context-only references | Protein stability prediction by fine-tuning a protein language model on a mega-scale dataset protein-stability-20261009-source-chu2024: Table 1 row 'BglB dataset'; Table 2; Results Version: PLOS Computational Biology 20(7):e1012248, published 2024-07-22; PMC11293664 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Claimed field links:assessed_by:protein-stability-20261009-protocol-chu2024-bglb Context-only references | Protein stability prediction by fine-tuning a protein language model on a mega-scale dataset protein-stability-20261009-source-chu2024: Table 1 row 'BglB dataset'; Table 2; Results Version: PLOS Computational Biology 20(7):e1012248, published 2024-07-22; PMC11293664 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Headline metric spearman-correlation Context-only references | Protein stability prediction by fine-tuning a protein language model on a mega-scale dataset protein-stability-20261009-source-chu2024: Table 1 row 'BglB dataset'; Table 2; Results Version: PLOS Computational Biology 20(7):e1012248, published 2024-07-22; PMC11293664 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Limitations6 values
| Protein stability prediction by fine-tuning a protein language model on a mega-scale dataset protein-stability-20261009-source-chu2024: Table 1 row 'BglB dataset'; Table 2; Results Version: PLOS Computational Biology 20(7):e1012248, published 2024-07-22; PMC11293664 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Pinned records17 values
| Protein stability prediction by fine-tuning a protein language model on a mega-scale dataset protein-stability-20261009-source-chu2024: Table 1 row 'BglB dataset'; Table 2; Results Version: PLOS Computational Biology 20(7):e1012248, published 2024-07-22; PMC11293664 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Rationale Measures ranking against melting temperature (Tm) in a single larger protein, which is a proxy for folding stability and shows how methods transfer beyond small domains. Context-only references | Protein stability prediction by fine-tuning a protein language model on a mega-scale dataset protein-stability-20261009-source-chu2024: Table 1 row 'BglB dataset'; Table 2; Results Version: PLOS Computational Biology 20(7):e1012248, published 2024-07-22; PMC11293664 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Sources and history
Release 2026-11-21-adc15377fab2 · Record review: source checked
1 source record and release history
- Protein stability prediction by fine-tuning a protein language model on a mega-scale dataset · Original source · PLOS Computational Biology 20(7):e1012248, published 2024-07-22; PMC11293664 full-text XML
Technical metadata and extraction receipts
Stable ID: use-case-mapping-protein-stability-20261009-chu2024-bglb
- field
- links:assessed_by:protein-stability-20261009-protocol-chu2024-bglb
- value
- protein-stability-20261009-protocol-chu2024-bglb
- relevance
- proxy
- endpoint
- Spearman correlation for Rosetta, MUPro, RaSP, ELASPIC-2, ESM therm and two ESM-2 checkpoints on BglB dataset
- rationale
- Measures ranking against melting temperature (Tm) in a single larger protein, which is a proxy for folding stability and shows how methods transfer beyond small domains.
- constraints
- Inspect every linked evaluation's source locator before citing a result.; Do not combine this mapping's evaluations with any other protocol's results; datasets, splits, structures and predictor versions differ between sources.
- limitations
- ESM therm was fine-tuned by the authors of this paper; the other methods were run by them as comparators.; Only Spearman correlation is printed; no RMSE, calibration or uncertainty.; The larger-protein benchmark was limited to six ProteinGym datasets and BglB because of Rosetta's compute cost (Methods P25).; Single protein (Beta-glucosidase (BglB), 445 residues); the measured quantity is melting temperature (Tm), not ddG of folding.; ESM therm was fine-tuned on domains of at most 72 residues, so this is an out-of-range test for it.; The Results text gives ranges that do not match Table 1 (ELASPIC-2 0.42 to 0.58, Rosetta 0.33 to 0.48); Table 1 values are used.
- revision
- 1
- reason
- Add primary-source stability predictor comparison evidence from the protein stability use-case pass (2026-10-09).
- citation locators
- source id: protein-stability-20261009-source-chu2024; locator: Table 1 row 'BglB dataset'; Table 2; Results
- source locator
- protein-stability-20261009-source-chu2024: Table 1 row 'BglB dataset'; Table 2; Results
- comparison group
- chu2024-transfer
- comparison title
- Transfer from mega-scale domains to larger proteins (Chu et al. 2024)
- headline metric
- spearman-correlation
- stratum label
- Beta-glucosidase (BglB) (melting temperature (Tm))
- stratum order
- 2
- reviewed evaluations
- protein-stability-20261009-eval-chu2024-elaspic-2-bglb; protein-stability-20261009-eval-chu2024-esm-2-35m-bglb; protein-stability-20261009-eval-chu2024-esm-2-3b-bglb; protein-stability-20261009-eval-chu2024-esm-therm-bglb; protein-stability-20261009-eval-chu2024-mupro-bglb; protein-stability-20261009-eval-chu2024-rasp-bglb; protein-stability-20261009-eval-chu2024-rosetta-bglb
- review
- method: automated-source-review; reviewer: claude; reviewer note: Separate Claude review agent, independent of the extractor; no human review claimed; reviewed at: 2026-10-09T23:59:00Z; note: Independent review of endpoint fit, relevance grade, limitations, exclusions and grouping against the use case and the source; every value of the listed evaluations was checked against the source table. No execution, reproduction, human scientific review or clinical validation.
- pins
- record id: protein-stability-20261009-eval-chu2024-elaspic-2-bglb; fields: status; links; attributes.origin; attributes.comparison; sha256: 431228506606f2529d5b85b6c7fb8406e64163ce35313d458d1817128991b8d6; record id: protein-stability-20261009-eval-chu2024-esm-2-35m-bglb; fields: status; links; attributes.origin; attributes.comparison; sha256: 5352e9468ca6fc5f1242bb7bb4f01d32ae4a734a117269673903f849923dc657; record id: protein-stability-20261009-eval-chu2024-esm-2-3b-bglb; fields: status; links; attributes.origin; attributes.comparison; sha256: 1587f8e4045298597d5824036edac882a10dc19785157ea7774f9684a3f0f6d9; record id: protein-stability-20261009-eval-chu2024-esm-therm-bglb; fields: status; links; attributes.origin; attributes.comparison; sha256: 6374882f13e4e1c333785c6e990d6e31e189d874685bed1010c619f3eea5595b; record id: protein-stability-20261009-eval-chu2024-mupro-bglb; fields: status; links; attributes.origin; attributes.comparison; sha256: 08d87ec17c99d5521f23e06e6ea2ea4b799ca170f49c971028960c1c60cab620; record id: protein-stability-20261009-eval-chu2024-rasp-bglb; fields: status; links; attributes.origin; attributes.comparison; sha256: 06c35c41cc987dac9f777abf6079cf5f7d76d27636ac1c076e50c2fb016de18c; record id: protein-stability-20261009-eval-chu2024-rosetta-bglb; fields: status; links; attributes.origin; attributes.comparison; sha256: 27c239c1e2f3ca311bbf9ff323e369e29c57bb7390f8460b913f63af671d1634; record id: protein-stability-20261009-protocol-chu2024-bglb; fields: status; name; description; facets; source_ids; links; attributes; sha256: 923884eede2952446da3b57f4c3a2eb1fddf08fd744ec70f82428238dcb97245; record id: protein-stability-20261009-result-chu2024-elaspic-2-bglb-spearman-correlation; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 733896d84d6b755c434a17932aacc6eca081016cd6826a5023021ae6d4430aeb; record id: protein-stability-20261009-result-chu2024-esm-2-35m-bglb-spearman-correlation; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 6873bca06fe978c633d3c85972aeca90a00cf7f18d57e63d839286eec812a582; record id: protein-stability-20261009-result-chu2024-esm-2-3b-bglb-spearman-correlation; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 6873bca06fe978c633d3c85972aeca90a00cf7f18d57e63d839286eec812a582; record id: protein-stability-20261009-result-chu2024-esm-therm-bglb-spearman-correlation; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 733896d84d6b755c434a17932aacc6eca081016cd6826a5023021ae6d4430aeb; record id: protein-stability-20261009-result-chu2024-mupro-bglb-spearman-correlation; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: e8c118e23778e47767c545c53a6f2be7ff69880d812da52e690da14d29b2cba4; record id: protein-stability-20261009-result-chu2024-rasp-bglb-spearman-correlation; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 21a635f0ff8a64482e66ca0fc4e596c8fa45aa64abc22b017d724c2fdab49d15; record id: protein-stability-20261009-result-chu2024-rosetta-bglb-spearman-correlation; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 33f219558f54b68fd5eb9cec2afa3f7ec1187edfe7c0f76c9b23bb8f5d3ff620; record id: protein-stability-20261009-source-chu2024; fields: status; attributes.artifact_sha256; sha256: e959594a702e1cfb9147c235f9a31116ada6106293e06b6e23185a14a95803b0; record id: use-case-protein-stability; fields: status; name; description; facets; attributes.question; attributes.decision; attributes.inputs; attributes.output; attributes.exclusions; attributes.setting; attributes.clinical_scope; attributes.intended_users; sha256: 2dd1d0e139a17e51ae72cc5945196ffbb366fe4daa4c20c4efd950346a30a54f