OATML-Markslab/ProteinGym / README.md
Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c
What this source contributed
Records in this release that cite this source. A record can cite several sources.
Claims
Statements this source supports, each with where in the source it was checked.
- AIDO Protein-RAG (16B) AMFR official snapshot: attributes.origin: Origin unreported (DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222))
- AIDO Protein-RAG (16B) AMFR official snapshot: description: Description Official ProteinGym assay-level Spearman for the AMFR assay at commit 144fe22; transcribed, not reproduced. (DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222))
- AIDO Protein-RAG: description: Description Retrieval-augmented protein language model from the AIDO.Protein-RAG work, which combines a pretrained protein language model with retrieved multiple sequence alignments; ProteinGym lists AIDO with alignment and structure inputs and scores it as a zero-shot substitution baseline. (uc20260930-source-proteingym-amfr-spearman: Benchmark CSV header (model scored in the zero-shot DMS substitution benchmark); run-doc-proteingym-readme-md-144fe22b: README 'Leaderboard' baseline table row AIDO (MSA & Structure); qa-descriptions-20261010-source-aido-protein-rag: abstract)
- Baseline: Predict missense variant effects in a protein of interest: Baseline Site-independent alignment model (run-doc-proteingym-readme-md-144fe22b: README lines 66-70)
- CARP (38M) AMFR official snapshot: attributes.origin: Origin unreported (DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222))
- CARP (38M) AMFR official snapshot: description: Description Official ProteinGym assay-level Spearman for the AMFR assay at commit 144fe22; transcribed, not reproduced. (DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222))
- CARP (76M) AMFR official snapshot: attributes.origin: Origin unreported (DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222))
- CARP (76M) AMFR official snapshot: description: Description Official ProteinGym assay-level Spearman for the AMFR assay at commit 144fe22; transcribed, not reproduced. (DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222))
- CARP (600K) AMFR official snapshot: attributes.origin: Origin unreported (DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222))
- CARP (600K) AMFR official snapshot: description: Description Official ProteinGym assay-level Spearman for the AMFR assay at commit 144fe22; transcribed, not reproduced. (DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222))
- CARP (640M) AMFR official snapshot: attributes.origin: Origin unreported (DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222))
- CARP (640M) AMFR official snapshot: description: Description Official ProteinGym assay-level Spearman for the AMFR assay at commit 144fe22; transcribed, not reproduced. (DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222))
- CARP: description: Description Convolutional protein language model pretrained by masked language modelling on protein sequences, scored in ProteinGym as a zero-shot single-sequence substitution baseline. (uc20260930-source-proteingym-amfr-spearman: Benchmark CSV header (model scored in the zero-shot DMS substitution benchmark); run-doc-proteingym-readme-md-144fe22b: README 'Leaderboard' baseline table (model name, input modalities, reference); qa-descriptions-20261010-source-carp: abstract)
- DeepSequence (ensemble) AMFR official snapshot: attributes.origin: Origin unreported (DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222))
- DeepSequence (ensemble) AMFR official snapshot: description: Description Official ProteinGym assay-level Spearman for the AMFR assay at commit 144fe22; transcribed, not reproduced. (DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222))
- DeepSequence (single) AMFR official snapshot: attributes.origin: Origin unreported (DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222))
- DeepSequence (single) AMFR official snapshot: description: Description Official ProteinGym assay-level Spearman for the AMFR assay at commit 144fe22; transcribed, not reproduced. (DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222))
- DeepSequence: description: Description Latent-variable deep generative model of a protein family's sequences, learned without labels from evolutionary sequence data, that predicts mutation effects; ProteinGym scores it as a zero-shot baseline from a multiple sequence alignment. (uc20260930-source-proteingym-amfr-spearman: Benchmark CSV header (model scored in the zero-shot DMS substitution benchmark); run-doc-proteingym-readme-md-144fe22b: README 'Leaderboard' baseline table (model name, input modalities, reference); qa-descriptions-20261010-source-deepsequence: abstract)
- ESCOTT AMFR official snapshot: attributes.origin: Origin unreported (DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222))
- ESCOTT AMFR official snapshot: description: Description Official ProteinGym assay-level Spearman for the AMFR assay at commit 144fe22; transcribed, not reproduced. (DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222))
- ESCOTT: description: Description Missense effect predictor that ProteinGym lists with multiple sequence alignment and structure inputs under the PRESCOTT reference, which describes an epistatic and structural model of missense effects that also uses population allele frequencies; scored as a zero-shot substitution baseline. (uc20260930-source-proteingym-amfr-spearman: Benchmark CSV header (model scored in the zero-shot DMS substitution benchmark); run-doc-proteingym-readme-md-144fe22b: README 'Leaderboard' baseline table (model name, input modalities, reference); qa-descriptions-20261010-source-escott: abstract)
- ESM-1b AMFR official snapshot: attributes.origin: Origin unreported (DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222))
- ESM-1b AMFR official snapshot: description: Description Official ProteinGym assay-level Spearman for the AMFR assay at commit 144fe22; transcribed, not reproduced. (DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222))
- ESM-1b: description: Description Deep contextual protein language model trained without labels on 250 million protein sequences, whose learned representations support mutational-effect prediction; ProteinGym scores it as a zero-shot single-sequence substitution baseline. (uc20260930-source-proteingym-amfr-spearman: Benchmark CSV header (model scored in the zero-shot DMS substitution benchmark); run-doc-proteingym-readme-md-144fe22b: README 'Leaderboard' baseline table (model name, input modalities, reference); qa-descriptions-20261010-source-esm-1b: abstract)
- ESM-1v (ensemble) AMFR official snapshot: attributes.origin: Origin unreported (DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222))
Models, benchmarks and other records
Models (27)
Configurations (27)
- BayesDel (addAF) [ProteinGym 144fe22 clinical summary]
- BayesDel (noAF) [ProteinGym 144fe22 clinical summary]
- CADD [ProteinGym 144fe22 clinical summary]
- ClinPred [ProteinGym 144fe22 clinical summary]
- DANN [ProteinGym 144fe22 clinical summary]
- DEOGEN2 [ProteinGym 144fe22 clinical summary]
- EVE [ProteinGym 144fe22 clinical summary]
- FATHMM [ProteinGym 144fe22 clinical summary]
- gMVP [ProteinGym 144fe22 clinical summary]
- Hidden Markov Model [ProteinGym 144fe22 clinical summary]
- LIST-S2 [ProteinGym 144fe22 clinical summary]
- LRT [ProteinGym 144fe22 clinical summary]
- MetaRNN [ProteinGym 144fe22 clinical summary]
- MPC [ProteinGym 144fe22 clinical summary]
- MutationAssessor [ProteinGym 144fe22 clinical summary]
- MutationTaster [ProteinGym 144fe22 clinical summary]
- MutPred [ProteinGym 144fe22 clinical summary]
- PolyPhen2 (HDIV) [ProteinGym 144fe22 clinical summary]
- PolyPhen2 (HVAR) [ProteinGym 144fe22 clinical summary]
- PrimateAI [ProteinGym 144fe22 clinical summary]
- Provean [ProteinGym 144fe22 clinical summary]
- REVEL [ProteinGym 144fe22 clinical summary]
- SIFT [ProteinGym 144fe22 clinical summary]
- SIFT4G [ProteinGym 144fe22 clinical summary]
- VARITY (ER) [ProteinGym 144fe22 clinical summary]
Benchmarks (1)
Protocols (3)
Dataset subsets (3)
Use cases (1)
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
14 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| attributes.artifact_sha256 321487a8de52c6cfa647a658f61150dd72e0acb0125470524fb94d1f8b23321a Source metadata | OATML-Markslab/ProteinGym / README.md No field-specific location recorded Version: Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Artifact url https://raw.githubusercontent.com/OATML-Markslab/ProteinGym/144fe22b07dfaeec2b366f2346203a9838a55b4c/README.md Source metadata | OATML-Markslab/ProteinGym / README.md No field-specific location recorded Version: Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Retrieved at 2026-09-17T09:32:03.517591+00:00 Source metadata | OATML-Markslab/ProteinGym / README.md No field-specific location recorded Version: Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Review method1 values
| OATML-Markslab/ProteinGym / README.md No field-specific location recorded Version: Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Review: scope Documentation and command-source review only, not computational reproduction. Source metadata | OATML-Markslab/ProteinGym / README.md No field-specific location recorded Version: Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Url https://github.com/OATML-Markslab/ProteinGym/blob/144fe22b07dfaeec2b366f2346203a9838a55b4c/README.md Source metadata | OATML-Markslab/ProteinGym / README.md No field-specific location recorded Version: Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Version Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c Source metadata | OATML-Markslab/ProteinGym / README.md No field-specific location recorded Version: Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Description Official run documentation inspected on 2026-09-17; no installation or benchmark execution performed. Source metadata | OATML-Markslab/ProteinGym / README.md No field-specific location recorded Version: Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Search facets None recorded Source metadata | OATML-Markslab/ProteinGym / README.md No field-specific location recorded Version: Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Record ID run-doc-proteingym-readme-md-144fe22b Source metadata | OATML-Markslab/ProteinGym / README.md No field-specific location recorded Version: Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Sources and history
Release 2026-10-22-1b7cf027e4f6 · Record review: source checked
Official run documentation inspected on 2026-09-17; no installation or benchmark execution performed.
Technical metadata and extraction receipts
Stable ID: run-doc-proteingym-readme-md-144fe22b
- url
- https://github.com/OATML-Markslab/ProteinGym/blob/144fe22b07dfaeec2b366f2346203a9838a55b4c/README.md
- artifact url
- https://raw.githubusercontent.com/OATML-Markslab/ProteinGym/144fe22b07dfaeec2b366f2346203a9838a55b4c/README.md
- artifact sha256
- 321487a8de52c6cfa647a658f61150dd72e0acb0125470524fb94d1f8b23321a
- version
- Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c
- retrieved at
- 2026-09-17T09:32:03.517591+00:00
- review
- scope: Documentation and command-source review only, not computational reproduction.; method: automated-source-review