Relevance of S669 direct ddG prediction (Dieckhaus et al. 2024) to "Assess methods for protein stability experiments"
- Use case
- Assess methods for protein stability experiments
- Assessed by
- S669 direct ddG prediction (Dieckhaus et al. 2024 Table 3)
- Relevance
- Proxy evidence
- Endpoint
- RMSE and correlation of predicted ddG on the S669 direct for the ThermoMPNN comparison set
Mostly values compiled from earlier papers, useful as context but not a fresh matched comparison; S669 duplicates Pancotti et al. 2022.
12 reviewed evaluations
- ACDC-NN on S669 direct (Dieckhaus et al. 2024)
- FoldX on S669 direct (Dieckhaus et al. 2024)
- MAESTRO on S669 direct (Dieckhaus et al. 2024)
- mCSM on S669 direct (Dieckhaus et al. 2024)
- MUPRO on S669 direct (Dieckhaus et al. 2024)
- PROSTATA on S669 direct (Dieckhaus et al. 2024)
- ProteinMPNN on S669 direct (Dieckhaus et al. 2024)
- RaSP on S669 direct (Dieckhaus et al. 2024)
- Rosetta on S669 direct (Dieckhaus et al. 2024)
- Stability Oracle on S669 direct (Dieckhaus et al. 2024)
- ThermoMPNN on S669 direct (Dieckhaus et al. 2024)
- ThermoNet on S669 direct (Dieckhaus et al. 2024)
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
21 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
Citation locations1 values
| Transfer learning to leverage larger datasets for improved prediction of protein stability changes protein-stability-20261009-source-dieckhaus2024: Table 3 and footnotes; Methods 'Datasets' Version: PNAS 121(6):e2314853121, published 2024-01-29; PMC10861915 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Comparison group dieckhaus2024-thermompnn Context-only references | Transfer learning to leverage larger datasets for improved prediction of protein stability changes protein-stability-20261009-source-dieckhaus2024: Table 3 and footnotes; Methods 'Datasets' Version: PNAS 121(6):e2314853121, published 2024-01-29; PMC10861915 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Comparison title ThermoMPNN comparison sets (Dieckhaus et al. 2024) Context-only references | Transfer learning to leverage larger datasets for improved prediction of protein stability changes protein-stability-20261009-source-dieckhaus2024: Table 3 and footnotes; Methods 'Datasets' Version: PNAS 121(6):e2314853121, published 2024-01-29; PMC10861915 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Constraints2 values
| Transfer learning to leverage larger datasets for improved prediction of protein stability changes protein-stability-20261009-source-dieckhaus2024: Table 3 and footnotes; Methods 'Datasets' Version: PNAS 121(6):e2314853121, published 2024-01-29; PMC10861915 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Endpoint RMSE and correlation of predicted ddG on the S669 direct for the ThermoMPNN comparison set Context-only references | Transfer learning to leverage larger datasets for improved prediction of protein stability changes protein-stability-20261009-source-dieckhaus2024: Table 3 and footnotes; Methods 'Datasets' Version: PNAS 121(6):e2314853121, published 2024-01-29; PMC10861915 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Excluded evaluations1 values
| Transfer learning to leverage larger datasets for improved prediction of protein stability changes protein-stability-20261009-source-dieckhaus2024: Table 3 and footnotes; Methods 'Datasets' Version: PNAS 121(6):e2314853121, published 2024-01-29; PMC10861915 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Claimed field links:assessed_by:protein-stability-20261009-protocol-dieckhaus2024-s669 Context-only references | Transfer learning to leverage larger datasets for improved prediction of protein stability changes protein-stability-20261009-source-dieckhaus2024: Table 3 and footnotes; Methods 'Datasets' Version: PNAS 121(6):e2314853121, published 2024-01-29; PMC10861915 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Headline metric pearson-correlation Context-only references | Transfer learning to leverage larger datasets for improved prediction of protein stability changes protein-stability-20261009-source-dieckhaus2024: Table 3 and footnotes; Methods 'Datasets' Version: PNAS 121(6):e2314853121, published 2024-01-29; PMC10861915 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Limitations5 values
| Transfer learning to leverage larger datasets for improved prediction of protein stability changes protein-stability-20261009-source-dieckhaus2024: Table 3 and footnotes; Methods 'Datasets' Version: PNAS 121(6):e2314853121, published 2024-01-29; PMC10861915 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Pinned records39 values
| Transfer learning to leverage larger datasets for improved prediction of protein stability changes protein-stability-20261009-source-dieckhaus2024: Table 3 and footnotes; Methods 'Datasets' Version: PNAS 121(6):e2314853121, published 2024-01-29; PMC10861915 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Sources and history
Release 2026-11-21-adc15377fab2 · Record review: source checked
1 source record and release history
- Transfer learning to leverage larger datasets for improved prediction of protein stability changes · Original source · PNAS 121(6):e2314853121, published 2024-01-29; PMC10861915 full-text XML
Technical metadata and extraction receipts
Stable ID: use-case-mapping-protein-stability-20261009-dieckhaus2024-s669
- field
- links:assessed_by:protein-stability-20261009-protocol-dieckhaus2024-s669
- value
- protein-stability-20261009-protocol-dieckhaus2024-s669
- relevance
- proxy
- endpoint
- RMSE and correlation of predicted ddG on the S669 direct for the ThermoMPNN comparison set
- rationale
- Mostly values compiled from earlier papers, useful as context but not a fresh matched comparison; S669 duplicates Pancotti et al. 2022.
- constraints
- Inspect every linked evaluation's source locator before citing a result.; Do not combine this mapping's evaluations with any other protocol's results; datasets, splits, structures and predictor versions differ between sources.
- limitations
- Most rows are compiled from Pancotti et al. 2022 (reference 30); the S669 values here are not an independent rerun.; ThermoMPNN was trained on a homologue-filtered Megascale set for this column (footnote *); ABYSSAL was scored on 420 filtered variants (footnote dagger).; The compiled ACDC-NN RMSE (1.60) disagrees with the source it cites (Pancotti et al. 2022: 1.49) and is disputed; its Pearson 0.46 matches and is kept.; No uncertainty is printed.; ABYSSAL is excluded: it was scored on 420 of the 669 variants.
- revision
- 1
- reason
- Add primary-source stability predictor comparison evidence from the protein stability use-case pass (2026-10-09).
- citation locators
- source id: protein-stability-20261009-source-dieckhaus2024; locator: Table 3 and footnotes; Methods 'Datasets'
- source locator
- protein-stability-20261009-source-dieckhaus2024: Table 3 and footnotes; Methods 'Datasets'
- comparison group
- dieckhaus2024-thermompnn
- comparison title
- ThermoMPNN comparison sets (Dieckhaus et al. 2024)
- headline metric
- pearson-correlation
- stratum label
- S669 direct
- stratum order
- 4
- excluded evaluations
- id: protein-stability-20261009-eval-dieckhaus2024-abyssal-s669; reason: Marked dagger in Table 3: scored on a filtered S669 of 420 of the 669 variants, so not comparable with the other rows. Excluded at independent review 2026-10-09.
- reviewed evaluations
- protein-stability-20261009-eval-dieckhaus2024-acdc-nn-s669; protein-stability-20261009-eval-dieckhaus2024-foldx-s669; protein-stability-20261009-eval-dieckhaus2024-maestro-s669; protein-stability-20261009-eval-dieckhaus2024-mcsm-s669; protein-stability-20261009-eval-dieckhaus2024-mupro-s669; protein-stability-20261009-eval-dieckhaus2024-prostata-s669; protein-stability-20261009-eval-dieckhaus2024-proteinmpnn-s669; protein-stability-20261009-eval-dieckhaus2024-rasp-s669; protein-stability-20261009-eval-dieckhaus2024-rosetta-s669; protein-stability-20261009-eval-dieckhaus2024-stability-oracle-s669; protein-stability-20261009-eval-dieckhaus2024-thermompnn-s669; protein-stability-20261009-eval-dieckhaus2024-thermonet-s669
- review
- method: automated-source-review; reviewer: claude; reviewer note: Separate Claude review agent, independent of the extractor; no human review claimed; reviewed at: 2026-10-09T23:59:00Z; note: Independent review of endpoint fit, relevance grade, limitations, exclusions and grouping against the use case and the source; every value of the listed evaluations was checked against the source table. No execution, reproduction, human scientific review or clinical validation.
- pins
- record id: protein-stability-20261009-eval-dieckhaus2024-acdc-nn-s669; fields: status; links; attributes.origin; attributes.comparison; sha256: 860fef709b11fdc420b7f53bff786e9a1a6d764e23a5dfc2454179044d1c7830; record id: protein-stability-20261009-eval-dieckhaus2024-foldx-s669; fields: status; links; attributes.origin; attributes.comparison; sha256: 9a7ef7bc3d931f8e9e0e8947c15c122f57a1f838f74432917d4084d4dcf744f4; record id: protein-stability-20261009-eval-dieckhaus2024-maestro-s669; fields: status; links; attributes.origin; attributes.comparison; sha256: 800fd1eee628f8727ab5840c0933af82ee991b0aa6e6ca8a8ba46bb180e9538b; record id: protein-stability-20261009-eval-dieckhaus2024-mcsm-s669; fields: status; links; attributes.origin; attributes.comparison; sha256: 03f88a5971bd0d86efb7dbac9edc1aa46af5a6c87bca98053e4984e44e0f079b; record id: protein-stability-20261009-eval-dieckhaus2024-mupro-s669; fields: status; links; attributes.origin; attributes.comparison; sha256: 18f721c61b7f6904bd019b2ef73d19af3c20c0438a304fb85b5a8df250731a29; record id: protein-stability-20261009-eval-dieckhaus2024-prostata-s669; fields: status; links; attributes.origin; attributes.comparison; sha256: 2b746629af365f551c1014d26e7bea615ebd98c4ce0743769b130ae8e59bc323; record id: protein-stability-20261009-eval-dieckhaus2024-proteinmpnn-s669; fields: status; links; attributes.origin; attributes.comparison; sha256: eb822503350fd045972346efc37676d4a8d57126b967f8eff575dc2329f7d4ca; record id: protein-stability-20261009-eval-dieckhaus2024-rasp-s669; fields: status; links; attributes.origin; attributes.comparison; sha256: 502b371655c1c0c0d68843c1b298ac5906d4b4b34cfbcca773348eff85fe843d; record id: protein-stability-20261009-eval-dieckhaus2024-rosetta-s669; fields: status; links; attributes.origin; attributes.comparison; sha256: 2b2e83ff4002201980a2caf5fff53523b575ea6656452ad9a7c30f222e5bd0d4; record id: protein-stability-20261009-eval-dieckhaus2024-stability-oracle-s669; fields: status; links; attributes.origin; attributes.comparison; sha256: b7a0acc26843c2c807c66b46632707aa45e67980f15313ebf57137dd24d43ff6; record id: protein-stability-20261009-eval-dieckhaus2024-thermompnn-s669; fields: status; links; attributes.origin; attributes.comparison; sha256: 3b0289175030f1d502302d73f87bd627c279bb334e6f00618733b3d508f58527; record id: protein-stability-20261009-eval-dieckhaus2024-thermonet-s669; fields: status; links; attributes.origin; attributes.comparison; sha256: ca534ad362b8164608b561eb598e84ba33121bed48fe8bec47404186bfdee44d; record id: protein-stability-20261009-protocol-dieckhaus2024-s669; fields: status; name; description; facets; source_ids; links; attributes; sha256: 78e92ae77d8ded2a59679eef42999d2e4907bcfbc054bcd462f754df7542f2df; record id: protein-stability-20261009-result-dieckhaus2024-acdc-nn-s669-direct-variants-pearson-correlation; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 6071c41958464d8708a948661f1b2b6f34fe192aa37a3086f2216b4abac4a1f7; record id: protein-stability-20261009-result-dieckhaus2024-acdc-nn-s669-direct-variants-root-mean-squared-error; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 6769af2e9ae46e8724ee9de3e2a7836d331adfb3af93e06c5ec5b2ed83f1abe6; record id: protein-stability-20261009-result-dieckhaus2024-foldx-s669-direct-variants-pearson-correlation; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 06ae44a92db8268edd93070d922716db8059958ec0e38c02a38b40ba43c88dd8; record id: protein-stability-20261009-result-dieckhaus2024-foldx-s669-direct-variants-root-mean-squared-error; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: debacaa1399776485d72cf1fe661db02896eeebafcd23001746242cbe7961345; record id: protein-stability-20261009-result-dieckhaus2024-maestro-s669-direct-variants-pearson-correlation; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 0c33ec62084ddaeed2c615ddcb4b58160170ea353b386b28c8e0c38d6b679fd7; record id: protein-stability-20261009-result-dieckhaus2024-maestro-s669-direct-variants-root-mean-squared-error; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 2f529baaecac6e05637df152f9602928da4a7a58ab63f5b96e0237601be8482e; record id: protein-stability-20261009-result-dieckhaus2024-mcsm-s669-direct-variants-pearson-correlation; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: f4f826de0137cfd462ad0c900d726dbf4acd9086e33758f33fcb500fe709ea7a; record id: protein-stability-20261009-result-dieckhaus2024-mcsm-s669-direct-variants-root-mean-squared-error; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 840582a559bc49a71cff653895d128b2efd6d3c9c1b147c763c5a515e7c54a97; record id: protein-stability-20261009-result-dieckhaus2024-mupro-s669-direct-variants-pearson-correlation; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 78331e1434cb40cf47f96ee327498f6c959ff96e17b42d7fd50e98bca579b17a; record id: protein-stability-20261009-result-dieckhaus2024-mupro-s669-direct-variants-root-mean-squared-error; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 704e6224882a53c093d2ffcef4f7007aee517283f5bfb77fe18557837f2bf239; record id: protein-stability-20261009-result-dieckhaus2024-prostata-s669-direct-variants-pearson-correlation; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 45711adf80cdf282bf6df2946b141b0ac370d86bd34454807ba67240dc7a3e26; record id: protein-stability-20261009-result-dieckhaus2024-prostata-s669-direct-variants-root-mean-squared-error; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 2f529baaecac6e05637df152f9602928da4a7a58ab63f5b96e0237601be8482e; record id: protein-stability-20261009-result-dieckhaus2024-proteinmpnn-s669-direct-variants-pearson-correlation; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 0412acf01edd3a57230abb948849584e2a6883070a4315ad885cc85751fc7b11; record id: protein-stability-20261009-result-dieckhaus2024-proteinmpnn-s669-direct-variants-root-mean-squared-error; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 8c81b944e268fd27943000d47359692a559718d84d584fa5c5eb7d91a4b69886; record id: protein-stability-20261009-result-dieckhaus2024-rasp-s669-direct-variants-pearson-correlation; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 9cdabb2a9162d7e6fb310d47a4b42b2a5bcee7bb7d2f20515eb9c64b70f17d40; record id: protein-stability-20261009-result-dieckhaus2024-rasp-s669-direct-variants-root-mean-squared-error; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 919a4f68a23a607dfb7b80a2dc0d9c880827ffaa8af1ac8be52008e2e7b141a9; record id: protein-stability-20261009-result-dieckhaus2024-rosetta-s669-direct-variants-pearson-correlation; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 9cdabb2a9162d7e6fb310d47a4b42b2a5bcee7bb7d2f20515eb9c64b70f17d40; record id: protein-stability-20261009-result-dieckhaus2024-rosetta-s669-direct-variants-root-mean-squared-error; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 200e8595fa276bbf2ea2709bbd55c02c615858dab89204d03631f568fb59e883; record id: protein-stability-20261009-result-dieckhaus2024-stability-oracle-s669-direct-variants-pearson-correlation; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: a455f14352d9edd0f394e8977c87ac6ad6fada6920ce778e11f87a66cd21937a; record id: protein-stability-20261009-result-dieckhaus2024-stability-oracle-s669-direct-variants-root-mean-squared-error; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 670f766b012d651b6439cbdd4d29da4da41d858fdc9612a5c2c2a48bbccaba17; record id: protein-stability-20261009-result-dieckhaus2024-thermompnn-s669-direct-variants-pearson-correlation; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 5b499dd671fd7131181a68e3e3de316c0bcb825cae4cf9a595d54f5e8875e22a; record id: protein-stability-20261009-result-dieckhaus2024-thermompnn-s669-direct-variants-root-mean-squared-error; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 4a7a66b1dfadbfd87c6fbbf68ceb9881807307eb28fd158e6064928253cacd46; record id: protein-stability-20261009-result-dieckhaus2024-thermonet-s669-direct-variants-pearson-correlation; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 9cdabb2a9162d7e6fb310d47a4b42b2a5bcee7bb7d2f20515eb9c64b70f17d40; record id: protein-stability-20261009-result-dieckhaus2024-thermonet-s669-direct-variants-root-mean-squared-error; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 5d5ab559cd1d99057d79774ad3dd3f0d6ae6778f2d305447f55637793c738f13; record id: protein-stability-20261009-source-dieckhaus2024; fields: status; attributes.artifact_sha256; sha256: e4c02837eab159fbef7943f8346e38196625d3a62702c961e9e1e54d1d61464e; record id: use-case-protein-stability; fields: status; name; description; facets; attributes.question; attributes.decision; attributes.inputs; attributes.output; attributes.exclusions; attributes.setting; attributes.clinical_scope; attributes.intended_users; sha256: 2dd1d0e139a17e51ae72cc5945196ffbb366fe4daa4c20c4efd950346a30a54f