Protocol metadata evidence: proteingym-reference_files-DMS_substitutions.csv
144fe22b07dfaeec2b366f2346203a9838a55b4c
What this source contributed
Records in this release that cite this source. A record can cite several sources.
Results
Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.
Claims
Statements this source supports, each with where in the source it was checked.
- ProteinGym against ProteinBench on ESM3 and ProteinMPNN: different tasks: Discrepancy review explained (The outlier and consensus results of discrepancy-fed245c475fd08dc as published at https://benchmarks.rewirebio.io/contested/discrepancy-fed245c475fd08dc/ (release 2026-10-23-968c8720eea6))
- ProteinGym AMFR official zero-shot Spearman snapshot study membership: Part of ProteinGym (Official ProteinGym pinned benchmarks/DMS_zero_shot/substitutions/Spearman/DMS_substitutions_Spearman_DMS_level.csv; AMFR assay row)
- ProteinGym repository against ProteinGym paper on ESM-1v and ESM-2: different ESM-2 sizes: Discrepancy review false-positive (The outlier and consensus results of discrepancy-6e0a1543c1c68a64 as published at https://benchmarks.rewirebio.io/contested/discrepancy-6e0a1543c1c68a64/ (release 2026-10-23-968c8720eea6))
- Relevance of ProteinGym AMFR official zero-shot Spearman snapshot to "Assess methods for protein stability experiments": Assessed by ProteinGym AMFR official zero-shot Spearman snapshot (uc20260930-source-proteingym-amfr-spearman: CSV row AMFR_HUMAN_Tsuboyama_2023_4G3O; DMS metadata row; profile-protocol-proteingym-reference-files-dms-substitutions-csv-a8f49801: CSV row AMFR_HUMAN_Tsuboyama_2023_4G3O; DMS metadata row)
- Relevance of ProteinGym v1.3 AMFR substitution assay to "Assess methods for protein stability experiments": Assessed by ProteinGym v1.3 AMFR substitution assay (rewire-local-20260920-source-proteingym-esm2: /metrics; /coverage; /execution/adapter_provenance; /execution; /input_information; /provenance; /protocol_results; rewire-local-20260920-instructions-proteingym: Data and method; Reproduce; profile-protocol-proteingym-reference-files-dms-substitutions-csv-a8f49801: AMFR_HUMAN_Tsuboyama_2023_4G3O row: seq_len, selection_assay, raw_DMS_phenotype_name and mutant-count columns; use-case-source-amfr-pilot-plan-194a78b: Question; Task and data; Methods; Gates and execution order; Runtime and cost)
- Relevance of rewire-proteingym-v1-3-dms-substitutions to use-case-protein-stability: Assessed by ProteinGym v1.3 zero-shot DMS substitutions (vep-lit-20261014-source-proteingym-dms-substitutions-spearman-summary-144fe22: Summary_performance_DMS_substitutions_Spearman.csv column Function_Stability; performance_DMS_benchmarks.py lines 336-348)
Models, benchmarks and other records
Benchmarks (1)
Protocols (3)
Dataset subsets (2)
Baselines (2)
Evaluations (97)
- AIDO Protein-RAG (16B) AMFR official snapshot
- CARP (38M) AMFR official snapshot
- CARP (76M) AMFR official snapshot
- CARP (600K) AMFR official snapshot
- CARP (640M) AMFR official snapshot
- DeepSequence (ensemble) AMFR official snapshot
- DeepSequence (single) AMFR official snapshot
- ESCOTT AMFR official snapshot
- ESM-1b AMFR official snapshot
- ESM-1v (ensemble) AMFR official snapshot
- ESM-1v (single) AMFR official snapshot
- ESM-C (300M) AMFR official snapshot
- ESM-C (600M) AMFR official snapshot
- ESM-IF1 AMFR official snapshot
- ESM2 (3B) AMFR official snapshot
- ESM2 (8M) AMFR official snapshot
- ESM2 (15B) AMFR official snapshot
- ESM2 (35M) AMFR official snapshot
- ESM2 (150M) AMFR official snapshot
- ESM2 (650M) AMFR official snapshot
- ESM3 open (1.4B) AMFR official snapshot
- EVE (ensemble) AMFR official snapshot
- EVE (single) AMFR official snapshot
- EVmutation AMFR official snapshot
- GEMME AMFR official snapshot
Use cases (1)
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
13 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| Artifact SHA-256 a8f498011532a74aa9fe556a50555a75e928c5837d19c06a87592ae04049b308 Source metadata | Protocol metadata evidence: proteingym-reference_files-DMS_substitutions.csv No field-specific location recorded Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Artifact url https://raw.githubusercontent.com/OATML-Markslab/ProteinGym/144fe22b07dfaeec2b366f2346203a9838a55b4c/reference_files/DMS_substitutions.csv Source metadata | Protocol metadata evidence: proteingym-reference_files-DMS_substitutions.csv No field-specific location recorded Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Retrieved at 2026-09-23T18:39:35.604049+00:00 Source metadata | Protocol metadata evidence: proteingym-reference_files-DMS_substitutions.csv No field-specific location recorded Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Review artifact data/omics/reviewed/profile-evidence-2026-09-23/artifacts/protocols-proteingym-reference_files-DMS_substitutions.csv.gz Source metadata | Protocol metadata evidence: proteingym-reference_files-DMS_substitutions.csv No field-specific location recorded Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Url https://raw.githubusercontent.com/OATML-Markslab/ProteinGym/144fe22b07dfaeec2b366f2346203a9838a55b4c/reference_files/DMS_substitutions.csv Source metadata | Protocol metadata evidence: proteingym-reference_files-DMS_substitutions.csv No field-specific location recorded Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Version 144fe22b07dfaeec2b366f2346203a9838a55b4c Source metadata | Protocol metadata evidence: proteingym-reference_files-DMS_substitutions.csv No field-specific location recorded Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Description Primary source artifact checked for bounded protocol metadata; no model execution or scientific reproduction. Source metadata | Protocol metadata evidence: proteingym-reference_files-DMS_substitutions.csv No field-specific location recorded Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Search facets None recorded Source metadata | Protocol metadata evidence: proteingym-reference_files-DMS_substitutions.csv No field-specific location recorded Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Record ID profile-protocol-proteingym-reference-files-dms-substitutions-csv-a8f49801 Source metadata | Protocol metadata evidence: proteingym-reference_files-DMS_substitutions.csv No field-specific location recorded Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Record type source Source metadata | Protocol metadata evidence: proteingym-reference_files-DMS_substitutions.csv No field-specific location recorded Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Sources and history
Release 2026-11-21-adc15377fab2 · Record review: source checked
Primary source artifact checked for bounded protocol metadata; no model execution or scientific reproduction.
Technical metadata and extraction receipts
Stable ID: profile-protocol-proteingym-reference-files-dms-substitutions-csv-a8f49801
- url
- https://raw.githubusercontent.com/OATML-Markslab/ProteinGym/144fe22b07dfaeec2b366f2346203a9838a55b4c/reference_files/DMS_substitutions.csv
- artifact url
- https://raw.githubusercontent.com/OATML-Markslab/ProteinGym/144fe22b07dfaeec2b366f2346203a9838a55b4c/reference_files/DMS_substitutions.csv
- artifact sha256
- a8f498011532a74aa9fe556a50555a75e928c5837d19c06a87592ae04049b308
- version
- 144fe22b07dfaeec2b366f2346203a9838a55b4c
- retrieved at
- 2026-09-23T18:39:35.604049+00:00
- review artifact
- data/omics/reviewed/profile-evidence-2026-09-23/artifacts/protocols-proteingym-reference_files-DMS_substitutions.csv.gz