Relevance of ProteinGym v1.3 AMFR substitution assay to "Assess methods for protein stability experiments"
- Use case
- Assess methods for protein stability experiments
- Assessed by
- ProteinGym v1.3 AMFR substitution assay
- Relevance
- Proxy evidence
- Endpoint
- Ranking the mixed AMFR assay cohort by proteolysis-inferred folding stability using ESM-2 8M masked marginals.
This completed short-construct assay is a narrow example for assessing stability-ranking evidence. Its mixed single/double cohort does not directly answer the planned single-substitution comparison or establish transfer to another protein.
1 reviewed evaluation
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
60 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
Citation locations4 values
| Protocol metadata evidence: proteingym-reference_files-DMS_substitutions.csv rewire-local-20260920-source-proteingym-esm2: /metrics; /coverage; /execution/adapter_provenance; /execution; /input_information; /provenance; /protocol_results; rewire-local-20260920-instructions-proteingym: Data and method; Reproduce; profile-protocol-proteingym-reference-files-dms-substitutions-csv-a8f49801: AMFR_HUMAN_Tsuboyama_2023_4G3O row: seq_len, selection_assay, raw_DMS_phenotype_name and mutant-count columns; use-case-source-amfr-pilot-plan-194a78b: Question; Task and data; Methods; Gates and execution order; Runtime and cost Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Citation locations4 values
| ProteinGym v1.3 AMFR substitution assay: reproduction instructions rewire-local-20260920-source-proteingym-esm2: /metrics; /coverage; /execution/adapter_provenance; /execution; /input_information; /provenance; /protocol_results; rewire-local-20260920-instructions-proteingym: Data and method; Reproduce; profile-protocol-proteingym-reference-files-dms-substitutions-csv-a8f49801: AMFR_HUMAN_Tsuboyama_2023_4G3O row: seq_len, selection_assay, raw_DMS_phenotype_name and mutant-count columns; use-case-source-amfr-pilot-plan-194a78b: Question; Task and data; Methods; Gates and execution order; Runtime and cost Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: ca73fa47136d182f2d4ddb083d084712198fc0e2 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Citation locations4 values
| ESM-2 8M masked-marginal scoring: local execution report (20 September 2026) rewire-local-20260920-source-proteingym-esm2: /metrics; /coverage; /execution/adapter_provenance; /execution; /input_information; /provenance; /protocol_results; rewire-local-20260920-instructions-proteingym: Data and method; Reproduce; profile-protocol-proteingym-reference-files-dms-substitutions-csv-a8f49801: AMFR_HUMAN_Tsuboyama_2023_4G3O row: seq_len, selection_assay, raw_DMS_phenotype_name and mutant-count columns; use-case-source-amfr-pilot-plan-194a78b: Question; Task and data; Methods; Gates and execution order; Runtime and cost Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: ca73fa47136d182f2d4ddb083d084712198fc0e2 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Citation locations4 values
| AMFR matched single-substitution pilot: plan and execution prerequisites rewire-local-20260920-source-proteingym-esm2: /metrics; /coverage; /execution/adapter_provenance; /execution; /input_information; /provenance; /protocol_results; rewire-local-20260920-instructions-proteingym: Data and method; Reproduce; profile-protocol-proteingym-reference-files-dms-substitutions-csv-a8f49801: AMFR_HUMAN_Tsuboyama_2023_4G3O row: seq_len, selection_assay, raw_DMS_phenotype_name and mutant-count columns; use-case-source-amfr-pilot-plan-194a78b: Question; Task and data; Methods; Gates and execution order; Runtime and cost Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 194a78b37eed911d0872e9b047a2539a9fee5dd0 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Constraints3 values
| Protocol metadata evidence: proteingym-reference_files-DMS_substitutions.csv rewire-local-20260920-source-proteingym-esm2: /metrics; /coverage; /execution/adapter_provenance; /execution; /input_information; /provenance; /protocol_results; rewire-local-20260920-instructions-proteingym: Data and method; Reproduce; profile-protocol-proteingym-reference-files-dms-substitutions-csv-a8f49801: AMFR_HUMAN_Tsuboyama_2023_4G3O row: seq_len, selection_assay, raw_DMS_phenotype_name and mutant-count columns; use-case-source-amfr-pilot-plan-194a78b: Question; Task and data; Methods; Gates and execution order; Runtime and cost Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Constraints3 values
| ProteinGym v1.3 AMFR substitution assay: reproduction instructions rewire-local-20260920-source-proteingym-esm2: /metrics; /coverage; /execution/adapter_provenance; /execution; /input_information; /provenance; /protocol_results; rewire-local-20260920-instructions-proteingym: Data and method; Reproduce; profile-protocol-proteingym-reference-files-dms-substitutions-csv-a8f49801: AMFR_HUMAN_Tsuboyama_2023_4G3O row: seq_len, selection_assay, raw_DMS_phenotype_name and mutant-count columns; use-case-source-amfr-pilot-plan-194a78b: Question; Task and data; Methods; Gates and execution order; Runtime and cost Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: ca73fa47136d182f2d4ddb083d084712198fc0e2 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Constraints3 values
| ESM-2 8M masked-marginal scoring: local execution report (20 September 2026) rewire-local-20260920-source-proteingym-esm2: /metrics; /coverage; /execution/adapter_provenance; /execution; /input_information; /provenance; /protocol_results; rewire-local-20260920-instructions-proteingym: Data and method; Reproduce; profile-protocol-proteingym-reference-files-dms-substitutions-csv-a8f49801: AMFR_HUMAN_Tsuboyama_2023_4G3O row: seq_len, selection_assay, raw_DMS_phenotype_name and mutant-count columns; use-case-source-amfr-pilot-plan-194a78b: Question; Task and data; Methods; Gates and execution order; Runtime and cost Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: ca73fa47136d182f2d4ddb083d084712198fc0e2 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Constraints3 values
| AMFR matched single-substitution pilot: plan and execution prerequisites rewire-local-20260920-source-proteingym-esm2: /metrics; /coverage; /execution/adapter_provenance; /execution; /input_information; /provenance; /protocol_results; rewire-local-20260920-instructions-proteingym: Data and method; Reproduce; profile-protocol-proteingym-reference-files-dms-substitutions-csv-a8f49801: AMFR_HUMAN_Tsuboyama_2023_4G3O row: seq_len, selection_assay, raw_DMS_phenotype_name and mutant-count columns; use-case-source-amfr-pilot-plan-194a78b: Question; Task and data; Methods; Gates and execution order; Runtime and cost Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 194a78b37eed911d0872e9b047a2539a9fee5dd0 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Endpoint Ranking the mixed AMFR assay cohort by proteolysis-inferred folding stability using ESM-2 8M masked marginals. Context-only references | Protocol metadata evidence: proteingym-reference_files-DMS_substitutions.csv rewire-local-20260920-source-proteingym-esm2: /metrics; /coverage; /execution/adapter_provenance; /execution; /input_information; /provenance; /protocol_results; rewire-local-20260920-instructions-proteingym: Data and method; Reproduce; profile-protocol-proteingym-reference-files-dms-substitutions-csv-a8f49801: AMFR_HUMAN_Tsuboyama_2023_4G3O row: seq_len, selection_assay, raw_DMS_phenotype_name and mutant-count columns; use-case-source-amfr-pilot-plan-194a78b: Question; Task and data; Methods; Gates and execution order; Runtime and cost Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Endpoint Ranking the mixed AMFR assay cohort by proteolysis-inferred folding stability using ESM-2 8M masked marginals. Context-only references | ProteinGym v1.3 AMFR substitution assay: reproduction instructions rewire-local-20260920-source-proteingym-esm2: /metrics; /coverage; /execution/adapter_provenance; /execution; /input_information; /provenance; /protocol_results; rewire-local-20260920-instructions-proteingym: Data and method; Reproduce; profile-protocol-proteingym-reference-files-dms-substitutions-csv-a8f49801: AMFR_HUMAN_Tsuboyama_2023_4G3O row: seq_len, selection_assay, raw_DMS_phenotype_name and mutant-count columns; use-case-source-amfr-pilot-plan-194a78b: Question; Task and data; Methods; Gates and execution order; Runtime and cost Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: ca73fa47136d182f2d4ddb083d084712198fc0e2 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Sources and history
Release 2026-11-02-a7f03c9e55a5 · Record review: source checked
4 source records and release history
- ESM-2 8M masked-marginal scoring: local execution report (20 September 2026) · Original source · ca73fa47136d182f2d4ddb083d084712198fc0e2
- ProteinGym v1.3 AMFR substitution assay: reproduction instructions · Original source · ca73fa47136d182f2d4ddb083d084712198fc0e2
- Protocol metadata evidence: proteingym-reference_files-DMS_substitutions.csv · Original source · 144fe22b07dfaeec2b366f2346203a9838a55b4c
- AMFR matched single-substitution pilot: plan and execution prerequisites · Original source · 194a78b37eed911d0872e9b047a2539a9fee5dd0
Technical metadata and extraction receipts
Stable ID: use-case-mapping-protein-stability-amfr-esm2
- field
- links:assessed_by:rewire-protocol-proteingym-amfr-v13
- value
- rewire-protocol-proteingym-amfr-v13
- relevance
- proxy
- endpoint
- Ranking the mixed AMFR assay cohort by proteolysis-inferred folding stability using ESM-2 8M masked marginals.
- rationale
- This completed short-construct assay is a narrow example for assessing stability-ranking evidence. Its mixed single/double cohort does not directly answer the planned single-substitution comparison or establish transfer to another protein.
- constraints
- One 47-residue AMFR construct and all 2,972 variants, comprising 820 singles and 2,152 doubles; no train/test split.; Exact esm2_t6_8M_UR50D checkpoint, wild-type-context masked marginals summed over substituted sites, CPU, one thread; no assay labels, alignment or structure as scorer inputs.; Protocol-only mapping: a direct reviewed task-membership relationship is not recorded.
- limitations
- No interval or seed-variability estimate; training overlap remains unknown and assay bytes have not been independently authenticated against an upstream checksum.; Recorded inference timing excludes loading, preparation and metrics; peak memory is unreported.; The site-independent and full EVmutation methods in the planned singles study have no completed comparison here.; No general whole-protein, ProteinGym-wide or clinical inference; automated source review is not human scientific validation.
- revision
- 1
- reason
- Initial bounded applicability review of the existing AMFR ESM-2 evaluation.
- citation locators
- source id: rewire-local-20260920-source-proteingym-esm2; locator: /metrics; /coverage; /execution/adapter_provenance; /execution; /input_information; /provenance; /protocol_results; source id: rewire-local-20260920-instructions-proteingym; locator: Data and method; Reproduce; source id: profile-protocol-proteingym-reference-files-dms-substitutions-csv-a8f49801; locator: AMFR_HUMAN_Tsuboyama_2023_4G3O row: seq_len, selection_assay, raw_DMS_phenotype_name and mutant-count columns; source id: use-case-source-amfr-pilot-plan-194a78b; locator: Question; Task and data; Methods; Gates and execution order; Runtime and cost
- source locator
- rewire-local-20260920-source-proteingym-esm2: /metrics; /coverage; /execution/adapter_provenance; /execution; /input_information; /provenance; /protocol_results; rewire-local-20260920-instructions-proteingym: Data and method; Reproduce; profile-protocol-proteingym-reference-files-dms-substitutions-csv-a8f49801: AMFR_HUMAN_Tsuboyama_2023_4G3O row: seq_len, selection_assay, raw_DMS_phenotype_name and mutant-count columns; use-case-source-amfr-pilot-plan-194a78b: Question; Task and data; Methods; Gates and execution order; Runtime and cost
- review
- method: automated-source-review; reviewer: codex; reviewer note: Codex research curation; reviewed at: 2026-09-25T15:28:11Z; note: Reviewed existing measured evidence separately from the planned singles comparison. No new experiment, human domain review or clinical validation.
- reviewed evaluations
- rewire-local-20260920-evaluation-proteingym-esm2
- pins
- record id: profile-protocol-proteingym-reference-files-dms-substitutions-csv-a8f49801; fields: status; attributes.artifact_sha256; sha256: ee370c515ebb99305ca075190b732a2e0d77a134455abef73bd3ddcee8c1e3ed; record id: rewire-local-20260920-evaluation-proteingym-esm2; fields: status; links; attributes.origin; attributes.comparison; sha256: 1dc60eff29b3811f9179abf1c1fcc17bd3f7dd8b44f1164a8ed8c10301e00eba; record id: rewire-local-20260920-instructions-proteingym; fields: status; attributes.artifact_sha256; sha256: 8ecb2bfaa9ca5c2087bb96c3b1f821a57693d72dfcaf3a4c3f0f29a35340ca9e; record id: rewire-local-20260920-result-proteingym-esm2-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: b10555d6e08d0bd8c51af8e9078f39b571eab17003b94d68a14f4adc1c03c1b0; record id: rewire-local-20260920-result-proteingym-esm2-mcc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 2b80b53ee941a8c52923eb50b8936ddec9edd7e2d4d82e3ddab66224a02b1964; record id: rewire-local-20260920-result-proteingym-esm2-ndcg; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 1ac56a0c57d65fa26fbd95645c6429a1d6f3ea73cf0c0e7a34a82615d098157c; record id: rewire-local-20260920-result-proteingym-esm2-spearman; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: ecc3af58661b8e6528a7c9ad4edcb0ae44692fee1e45740dcb72720e7229ffac; record id: rewire-local-20260920-result-proteingym-esm2-top-recall; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 3a76883d2ee10b4893165e33226831517c5e1e88664ee1085900f2cc4582ffe2; record id: rewire-local-20260920-source-proteingym-esm2; fields: status; attributes.artifact_sha256; sha256: de8e9546eda296b96a98e71d371393291539029d85b27235d060a346211e1e6d; record id: rewire-protocol-proteingym-amfr-v13; fields: status; name; description; facets; source_ids; links; attributes; sha256: 400e9de75536eeb57b470d5bd9cb7a85f78454af45636b7a1c099d0bda853ec5; record id: use-case-protein-stability; fields: status; name; description; facets; attributes.question; attributes.decision; attributes.inputs; attributes.output; attributes.exclusions; attributes.setting; attributes.clinical_scope; attributes.intended_users; sha256: 2dd1d0e139a17e51ae72cc5945196ffbb366fe4daa4c20c4efd950346a30a54f; record id: use-case-source-amfr-pilot-plan-194a78b; fields: status; attributes.artifact_sha256; sha256: 16a98424d9332082177873888d6bfbfd0697fe8dea16c71420c5567258fd32c5