Evidence claim

CARP (38M) AMFR official snapshot: attributes.origin

Origin of CARP (38M) AMFR official snapshot

unreported

Correct the origin from 'author_reported' to 'unreported' (ProteinGym origin audit, issue #161).

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

14 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-10-22-1b7cf027e4f6
Property and statement	Original source and location	Review and provenance
Claimed field attributes.origin Context-only references	OATML-Markslab/ProteinGym / README.md Original source ↗ DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c Retrieved: 2026-09-17T09:32:03.517591+00:00	not individually reviewed No individual claim review recorded Audit details Field: `attributes.field` Source artifact SHA-256: `321487a8de52c6cfa647a658f61150dd72e0acb0125470524fb94d1f8b23321a` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Claimed field attributes.origin Context-only references	ProteinGym AMFR assay-level Spearman comparison Original source ↗ DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c Retrieved: 2026-09-30	not individually reviewed No individual claim review recorded Audit details Field: `attributes.field` Source artifact SHA-256: `f432423b87f79ac9778dfac86e3d95be041d246bc618dc0a406b35b0b7466437` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Previous value author_reported Context-only references	OATML-Markslab/ProteinGym / README.md Original source ↗ DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c Retrieved: 2026-09-17T09:32:03.517591+00:00	not individually reviewed No individual claim review recorded Audit details Field: `attributes.previous_value` Source artifact SHA-256: `321487a8de52c6cfa647a658f61150dd72e0acb0125470524fb94d1f8b23321a` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Previous value author_reported Context-only references	ProteinGym AMFR assay-level Spearman comparison Original source ↗ DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c Retrieved: 2026-09-30	not individually reviewed No individual claim review recorded Audit details Field: `attributes.previous_value` Source artifact SHA-256: `f432423b87f79ac9778dfac86e3d95be041d246bc618dc0a406b35b0b7466437` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Source location DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222) Context-only references	OATML-Markslab/ProteinGym / README.md Original source ↗ DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c Retrieved: 2026-09-17T09:32:03.517591+00:00	not individually reviewed No individual claim review recorded Audit details Field: `attributes.source_locator` Source artifact SHA-256: `321487a8de52c6cfa647a658f61150dd72e0acb0125470524fb94d1f8b23321a` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Source location DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222) Context-only references	ProteinGym AMFR assay-level Spearman comparison Original source ↗ DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c Retrieved: 2026-09-30	not individually reviewed No individual claim review recorded Audit details Field: `attributes.source_locator` Source artifact SHA-256: `f432423b87f79ac9778dfac86e3d95be041d246bc618dc0a406b35b0b7466437` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Claimed value unreported Context-only references	OATML-Markslab/ProteinGym / README.md Original source ↗ DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c Retrieved: 2026-09-17T09:32:03.517591+00:00	missing or unspecified No individual claim review recorded Audit details Field: `attributes.value` Source artifact SHA-256: `321487a8de52c6cfa647a658f61150dd72e0acb0125470524fb94d1f8b23321a` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Claimed value unreported Context-only references	ProteinGym AMFR assay-level Spearman comparison Original source ↗ DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c Retrieved: 2026-09-30	missing or unspecified No individual claim review recorded Audit details Field: `attributes.value` Source artifact SHA-256: `f432423b87f79ac9778dfac86e3d95be041d246bc618dc0a406b35b0b7466437` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Description Correct the origin from 'author_reported' to 'unreported' (ProteinGym origin audit, issue #161). Context-only references	OATML-Markslab/ProteinGym / README.md Original source ↗ DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c Retrieved: 2026-09-17T09:32:03.517591+00:00	not individually reviewed No individual claim review recorded Audit details Field: `description` Source artifact SHA-256: `321487a8de52c6cfa647a658f61150dd72e0acb0125470524fb94d1f8b23321a` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Description Correct the origin from 'author_reported' to 'unreported' (ProteinGym origin audit, issue #161). Context-only references	ProteinGym AMFR assay-level Spearman comparison Original source ↗ DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c Retrieved: 2026-09-30	not individually reviewed No individual claim review recorded Audit details Field: `description` Source artifact SHA-256: `f432423b87f79ac9778dfac86e3d95be041d246bc618dc0a406b35b0b7466437` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact

How to read the evidence

Sources and history

Release 2026-10-22-1b7cf027e4f6 · Record review: source checked

2 source records and release history

ProteinGym AMFR assay-level Spearman comparison · Original source · 144fe22b07dfaeec2b366f2346203a9838a55b4c
OATML-Markslab/ProteinGym / README.md · Original source · Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c

Download this release (gzip)

Technical metadata and extraction receipts

Stable ID: metadata-correction-pgorigin-20261014-08359cb9dbb1f878601e

field: attributes.origin
previous value: author_reported
value: unreported
source locator: DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222)
review: method: source-hash-verification; automated-source-review; reviewer: claude; reviewer note: Claude (Opus 5.5) agent acting as independent reviewer of PR #168; not the agent that made or applied the judgements; no human review claimed; date: 2026-10-14; method note: Re-retrieved the 144fe22 assay-level Spearman CSV and README (SHA-256 match the source records); confirmed the file has no per-model scorer field and that the README does not state who generated each model's scores; checked the subject evaluation's printed value against its CSV cell.; artifact sha256: f432423b87f79ac9778dfac86e3d95be041d246bc618dc0a406b35b0b7466437; retrieval url: https://raw.githubusercontent.com/OATML-Markslab/ProteinGym/144fe22b07dfaeec2b366f2346203a9838a55b4c/benchmarks/DMS_zero_shot/substitutions/Spearman/DMS_substitutions_Spearman_DMS_level.csv; note: Accepted in the independent review of 2026-10-14 (docs/reviews/2026-10-14-proteingym-origin-audit.md, section 'Independent review'). ProteinGym 144fe22 assay-level file does not say who generated each model's scores; ProteinGym computed the metric (ruling 2 of docs/reviews/vep-literature-2026-10-14-review.md). See docs/reviews/2026-10-14-proteingym-origin-audit.md.

Related records

subject: CARP (38M) AMFR official snapshot

Suggest a correction