Evidence claim

CARP (76M) AMFR official snapshot: description

Description of CARP (76M) AMFR official snapshot

Official ProteinGym assay-level Spearman for the AMFR assay at commit 144fe22; transcribed, not reproduced.

Correct the description, which called the row author-reported (ProteinGym origin audit, issue #161).

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

14 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-10-22-1b7cf027e4f6
Property and statement	Original source and location	Review and provenance
Claimed field description Context-only references	OATML-Markslab/ProteinGym / README.md Original source ↗ DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c Retrieved: 2026-09-17T09:32:03.517591+00:00	not individually reviewed No individual claim review recorded Audit details Field: `attributes.field` Source artifact SHA-256: `321487a8de52c6cfa647a658f61150dd72e0acb0125470524fb94d1f8b23321a` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Claimed field description Context-only references	ProteinGym AMFR assay-level Spearman comparison Original source ↗ DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c Retrieved: 2026-09-30	not individually reviewed No individual claim review recorded Audit details Field: `attributes.field` Source artifact SHA-256: `f432423b87f79ac9778dfac86e3d95be041d246bc618dc0a406b35b0b7466437` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Previous value Author-reported evaluation, source checked; not independently reproduced. Context-only references	OATML-Markslab/ProteinGym / README.md Original source ↗ DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c Retrieved: 2026-09-17T09:32:03.517591+00:00	not individually reviewed No individual claim review recorded Audit details Field: `attributes.previous_value` Source artifact SHA-256: `321487a8de52c6cfa647a658f61150dd72e0acb0125470524fb94d1f8b23321a` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Previous value Author-reported evaluation, source checked; not independently reproduced. Context-only references	ProteinGym AMFR assay-level Spearman comparison Original source ↗ DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c Retrieved: 2026-09-30	not individually reviewed No individual claim review recorded Audit details Field: `attributes.previous_value` Source artifact SHA-256: `f432423b87f79ac9778dfac86e3d95be041d246bc618dc0a406b35b0b7466437` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Source location DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222) Context-only references	OATML-Markslab/ProteinGym / README.md Original source ↗ DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c Retrieved: 2026-09-17T09:32:03.517591+00:00	not individually reviewed No individual claim review recorded Audit details Field: `attributes.source_locator` Source artifact SHA-256: `321487a8de52c6cfa647a658f61150dd72e0acb0125470524fb94d1f8b23321a` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Source location DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222) Context-only references	ProteinGym AMFR assay-level Spearman comparison Original source ↗ DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c Retrieved: 2026-09-30	not individually reviewed No individual claim review recorded Audit details Field: `attributes.source_locator` Source artifact SHA-256: `f432423b87f79ac9778dfac86e3d95be041d246bc618dc0a406b35b0b7466437` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Claimed value Official ProteinGym assay-level Spearman for the AMFR assay at commit 144fe22; transcribed, not reproduced. Context-only references	OATML-Markslab/ProteinGym / README.md Original source ↗ DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c Retrieved: 2026-09-17T09:32:03.517591+00:00	not individually reviewed No individual claim review recorded Audit details Field: `attributes.value` Source artifact SHA-256: `321487a8de52c6cfa647a658f61150dd72e0acb0125470524fb94d1f8b23321a` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Claimed value Official ProteinGym assay-level Spearman for the AMFR assay at commit 144fe22; transcribed, not reproduced. Context-only references	ProteinGym AMFR assay-level Spearman comparison Original source ↗ DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c Retrieved: 2026-09-30	not individually reviewed No individual claim review recorded Audit details Field: `attributes.value` Source artifact SHA-256: `f432423b87f79ac9778dfac86e3d95be041d246bc618dc0a406b35b0b7466437` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Description Correct the description, which called the row author-reported (ProteinGym origin audit, issue #161). Context-only references	OATML-Markslab/ProteinGym / README.md Original source ↗ DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c Retrieved: 2026-09-17T09:32:03.517591+00:00	not individually reviewed No individual claim review recorded Audit details Field: `description` Source artifact SHA-256: `321487a8de52c6cfa647a658f61150dd72e0acb0125470524fb94d1f8b23321a` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Description Correct the description, which called the row author-reported (ProteinGym origin audit, issue #161). Context-only references	ProteinGym AMFR assay-level Spearman comparison Original source ↗ DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c Retrieved: 2026-09-30	not individually reviewed No individual claim review recorded Audit details Field: `description` Source artifact SHA-256: `f432423b87f79ac9778dfac86e3d95be041d246bc618dc0a406b35b0b7466437` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact

How to read the evidence

Sources and history

Release 2026-10-22-1b7cf027e4f6 · Record review: source checked

2 source records and release history

ProteinGym AMFR assay-level Spearman comparison · Original source · 144fe22b07dfaeec2b366f2346203a9838a55b4c
OATML-Markslab/ProteinGym / README.md · Original source · Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c

Download this release (gzip)

Technical metadata and extraction receipts

Stable ID: metadata-correction-pgorigin-20261014-55158e91028aad408285

field: description
previous value: Author-reported evaluation, source checked; not independently reproduced.
value: Official ProteinGym assay-level Spearman for the AMFR assay at commit 144fe22; transcribed, not reproduced.
source locator: DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222)
review: method: source-hash-verification; automated-source-review; reviewer: claude; reviewer note: Claude (Opus 5.5) agent acting as independent reviewer of PR #168; not the agent that made or applied the judgements; no human review claimed; date: 2026-10-14; method note: Re-retrieved the 144fe22 assay-level Spearman CSV and README (SHA-256 match the source records); confirmed the file has no per-model scorer field and that the README does not state who generated each model's scores; checked the subject evaluation's printed value against its CSV cell.; artifact sha256: f432423b87f79ac9778dfac86e3d95be041d246bc618dc0a406b35b0b7466437; retrieval url: https://raw.githubusercontent.com/OATML-Markslab/ProteinGym/144fe22b07dfaeec2b366f2346203a9838a55b4c/benchmarks/DMS_zero_shot/substitutions/Spearman/DMS_substitutions_Spearman_DMS_level.csv; note: Accepted in the independent review of 2026-10-14 (docs/reviews/2026-10-14-proteingym-origin-audit.md, section 'Independent review'). The old description said 'Author-reported', which the origin change makes untrue. See docs/reviews/2026-10-14-proteingym-origin-audit.md.

Related records

subject: CARP (76M) AMFR official snapshot

Suggest a correction