AIDO Protein-RAG (16B) AMFR official snapshot: description
Description of AIDO Protein-RAG (16B) AMFR official snapshot
Official ProteinGym assay-level Spearman for the AMFR assay at commit 144fe22; transcribed, not reproduced.
Correct the description, which called the row author-reported (ProteinGym origin audit, issue #161).
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
14 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| Claimed field description Context-only references | OATML-Markslab/ProteinGym / README.md DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Claimed field description Context-only references | ProteinGym AMFR assay-level Spearman comparison DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Previous value Author-reported evaluation, source checked; not independently reproduced. Context-only references | OATML-Markslab/ProteinGym / README.md DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Previous value Author-reported evaluation, source checked; not independently reproduced. Context-only references | ProteinGym AMFR assay-level Spearman comparison DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Source location DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222) Context-only references | OATML-Markslab/ProteinGym / README.md DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Source location DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222) Context-only references | ProteinGym AMFR assay-level Spearman comparison DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Claimed value Official ProteinGym assay-level Spearman for the AMFR assay at commit 144fe22; transcribed, not reproduced. Context-only references | OATML-Markslab/ProteinGym / README.md DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Claimed value Official ProteinGym assay-level Spearman for the AMFR assay at commit 144fe22; transcribed, not reproduced. Context-only references | ProteinGym AMFR assay-level Spearman comparison DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Description Correct the description, which called the row author-reported (ProteinGym origin audit, issue #161). Context-only references | OATML-Markslab/ProteinGym / README.md DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Description Correct the description, which called the row author-reported (ProteinGym origin audit, issue #161). Context-only references | ProteinGym AMFR assay-level Spearman comparison DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Sources and history
Release 2026-10-22-1b7cf027e4f6 · Record review: source checked
2 source records and release history
- ProteinGym AMFR assay-level Spearman comparison · Original source · 144fe22b07dfaeec2b366f2346203a9838a55b4c
- OATML-Markslab/ProteinGym / README.md · Original source · Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c
Technical metadata and extraction receipts
Stable ID: metadata-correction-pgorigin-20261014-642c6d5a08e0c9b08679
- field
- description
- previous value
- Author-reported evaluation, source checked; not independently reproduced.
- value
- Official ProteinGym assay-level Spearman for the AMFR assay at commit 144fe22; transcribed, not reproduced.
- source locator
- DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222)
- review
- method: source-hash-verification; automated-source-review; reviewer: claude; reviewer note: Claude (Opus 5.5) agent acting as independent reviewer of PR #168; not the agent that made or applied the judgements; no human review claimed; date: 2026-10-14; method note: Re-retrieved the 144fe22 assay-level Spearman CSV and README (SHA-256 match the source records); confirmed the file has no per-model scorer field and that the README does not state who generated each model's scores; checked the subject evaluation's printed value against its CSV cell.; artifact sha256: f432423b87f79ac9778dfac86e3d95be041d246bc618dc0a406b35b0b7466437; retrieval url: https://raw.githubusercontent.com/OATML-Markslab/ProteinGym/144fe22b07dfaeec2b366f2346203a9838a55b4c/benchmarks/DMS_zero_shot/substitutions/Spearman/DMS_substitutions_Spearman_DMS_level.csv; note: Accepted in the independent review of 2026-10-14 (docs/reviews/2026-10-14-proteingym-origin-audit.md, section 'Independent review'). The old description said 'Author-reported', which the origin change makes untrue. See docs/reviews/2026-10-14-proteingym-origin-audit.md.