rewirebio.iobenchmarks
Source

OATML-Markslab/ProteinGym / README.md

Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c

Original source

What this source contributed

Records in this release that cite this source. A record can cite several sources.

Claims

Statements this source supports, each with where in the source it was checked.

  • AIDO Protein-RAG (16B) AMFR official snapshot: attributes.origin: Origin unreported (DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222))
  • AIDO Protein-RAG (16B) AMFR official snapshot: description: Description Official ProteinGym assay-level Spearman for the AMFR assay at commit 144fe22; transcribed, not reproduced. (DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222))
  • AIDO Protein-RAG: description: Description Retrieval-augmented protein language model from the AIDO.Protein-RAG work, which combines a pretrained protein language model with retrieved multiple sequence alignments; ProteinGym lists AIDO with alignment and structure inputs and scores it as a zero-shot substitution baseline. (uc20260930-source-proteingym-amfr-spearman: Benchmark CSV header (model scored in the zero-shot DMS substitution benchmark); run-doc-proteingym-readme-md-144fe22b: README 'Leaderboard' baseline table row AIDO (MSA & Structure); qa-descriptions-20261010-source-aido-protein-rag: abstract)
  • Baseline: Predict missense variant effects in a protein of interest: Baseline Site-independent alignment model (run-doc-proteingym-readme-md-144fe22b: README lines 66-70)
  • CARP (38M) AMFR official snapshot: attributes.origin: Origin unreported (DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222))
  • CARP (38M) AMFR official snapshot: description: Description Official ProteinGym assay-level Spearman for the AMFR assay at commit 144fe22; transcribed, not reproduced. (DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222))
  • CARP (76M) AMFR official snapshot: attributes.origin: Origin unreported (DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222))
  • CARP (76M) AMFR official snapshot: description: Description Official ProteinGym assay-level Spearman for the AMFR assay at commit 144fe22; transcribed, not reproduced. (DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222))
  • CARP (600K) AMFR official snapshot: attributes.origin: Origin unreported (DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222))
  • CARP (600K) AMFR official snapshot: description: Description Official ProteinGym assay-level Spearman for the AMFR assay at commit 144fe22; transcribed, not reproduced. (DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222))
  • CARP (640M) AMFR official snapshot: attributes.origin: Origin unreported (DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222))
  • CARP (640M) AMFR official snapshot: description: Description Official ProteinGym assay-level Spearman for the AMFR assay at commit 144fe22; transcribed, not reproduced. (DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222))
  • CARP: description: Description Convolutional protein language model pretrained by masked language modelling on protein sequences, scored in ProteinGym as a zero-shot single-sequence substitution baseline. (uc20260930-source-proteingym-amfr-spearman: Benchmark CSV header (model scored in the zero-shot DMS substitution benchmark); run-doc-proteingym-readme-md-144fe22b: README 'Leaderboard' baseline table (model name, input modalities, reference); qa-descriptions-20261010-source-carp: abstract)
  • DeepSequence (ensemble) AMFR official snapshot: attributes.origin: Origin unreported (DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222))
  • DeepSequence (ensemble) AMFR official snapshot: description: Description Official ProteinGym assay-level Spearman for the AMFR assay at commit 144fe22; transcribed, not reproduced. (DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222))
  • DeepSequence (single) AMFR official snapshot: attributes.origin: Origin unreported (DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222))
  • DeepSequence (single) AMFR official snapshot: description: Description Official ProteinGym assay-level Spearman for the AMFR assay at commit 144fe22; transcribed, not reproduced. (DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222))
  • DeepSequence: description: Description Latent-variable deep generative model of a protein family's sequences, learned without labels from evolutionary sequence data, that predicts mutation effects; ProteinGym scores it as a zero-shot baseline from a multiple sequence alignment. (uc20260930-source-proteingym-amfr-spearman: Benchmark CSV header (model scored in the zero-shot DMS substitution benchmark); run-doc-proteingym-readme-md-144fe22b: README 'Leaderboard' baseline table (model name, input modalities, reference); qa-descriptions-20261010-source-deepsequence: abstract)
  • ESCOTT AMFR official snapshot: attributes.origin: Origin unreported (DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222))
  • ESCOTT AMFR official snapshot: description: Description Official ProteinGym assay-level Spearman for the AMFR assay at commit 144fe22; transcribed, not reproduced. (DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222))
  • ESCOTT: description: Description Missense effect predictor that ProteinGym lists with multiple sequence alignment and structure inputs under the PRESCOTT reference, which describes an epistatic and structural model of missense effects that also uses population allele frequencies; scored as a zero-shot substitution baseline. (uc20260930-source-proteingym-amfr-spearman: Benchmark CSV header (model scored in the zero-shot DMS substitution benchmark); run-doc-proteingym-readme-md-144fe22b: README 'Leaderboard' baseline table (model name, input modalities, reference); qa-descriptions-20261010-source-escott: abstract)
  • ESM-1b AMFR official snapshot: attributes.origin: Origin unreported (DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222))
  • ESM-1b AMFR official snapshot: description: Description Official ProteinGym assay-level Spearman for the AMFR assay at commit 144fe22; transcribed, not reproduced. (DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222))
  • ESM-1b: description: Description Deep contextual protein language model trained without labels on 250 million protein sequences, whose learned representations support mutational-effect prediction; ProteinGym scores it as a zero-shot single-sequence substitution baseline. (uc20260930-source-proteingym-amfr-spearman: Benchmark CSV header (model scored in the zero-shot DMS substitution benchmark); run-doc-proteingym-readme-md-144fe22b: README 'Leaderboard' baseline table (model name, input modalities, reference); qa-descriptions-20261010-source-esm-1b: abstract)
  • ESM-1v (ensemble) AMFR official snapshot: attributes.origin: Origin unreported (DMS_substitutions_Spearman_DMS_level.csv: per-model columns with no scorer field; README.md at 144fe22, 'New baselines' (lines 159-170) and Acknowledgements (line 222))

Models, benchmarks and other records

Models (27)

Configurations (27)

Benchmarks (1)

Protocols (3)

Dataset subsets (3)

Use cases (1)

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

14 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-10-22-1b7cf027e4f6
Property and statementOriginal source and locationReview and provenance
attributes.artifact_sha256
321487a8de52c6cfa647a658f61150dd72e0acb0125470524fb94d1f8b23321a
Source metadata
OATML-Markslab/ProteinGym / README.md

Original source ↗

No field-specific location recorded

Version: Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c
Retrieved: 2026-09-17T09:32:03.517591+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_sha256

Source artifact SHA-256: 321487a8de52c6cfa647a658f61150dd72e0acb0125470524fb94d1f8b23321a

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Artifact url
https://raw.githubusercontent.com/OATML-Markslab/ProteinGym/144fe22b07dfaeec2b366f2346203a9838a55b4c/README.md
Source metadata
OATML-Markslab/ProteinGym / README.md

Original source ↗

No field-specific location recorded

Version: Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c
Retrieved: 2026-09-17T09:32:03.517591+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_url

Source artifact SHA-256: 321487a8de52c6cfa647a658f61150dd72e0acb0125470524fb94d1f8b23321a

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Retrieved at
2026-09-17T09:32:03.517591+00:00
Source metadata
OATML-Markslab/ProteinGym / README.md

Original source ↗

No field-specific location recorded

Version: Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c
Retrieved: 2026-09-17T09:32:03.517591+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.retrieved_at

Source artifact SHA-256: 321487a8de52c6cfa647a658f61150dd72e0acb0125470524fb94d1f8b23321a

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Review method
1 values
  • automated-source-review
Source metadata
OATML-Markslab/ProteinGym / README.md

Original source ↗

No field-specific location recorded

Version: Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c
Retrieved: 2026-09-17T09:32:03.517591+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.review.method

Source artifact SHA-256: 321487a8de52c6cfa647a658f61150dd72e0acb0125470524fb94d1f8b23321a

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Review: scope
Documentation and command-source review only, not computational reproduction.
Source metadata
OATML-Markslab/ProteinGym / README.md

Original source ↗

No field-specific location recorded

Version: Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c
Retrieved: 2026-09-17T09:32:03.517591+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.review.scope

Source artifact SHA-256: 321487a8de52c6cfa647a658f61150dd72e0acb0125470524fb94d1f8b23321a

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Url
https://github.com/OATML-Markslab/ProteinGym/blob/144fe22b07dfaeec2b366f2346203a9838a55b4c/README.md
Source metadata
OATML-Markslab/ProteinGym / README.md

Original source ↗

No field-specific location recorded

Version: Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c
Retrieved: 2026-09-17T09:32:03.517591+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.url

Source artifact SHA-256: 321487a8de52c6cfa647a658f61150dd72e0acb0125470524fb94d1f8b23321a

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Version
Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c
Source metadata
OATML-Markslab/ProteinGym / README.md

Original source ↗

No field-specific location recorded

Version: Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c
Retrieved: 2026-09-17T09:32:03.517591+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.version

Source artifact SHA-256: 321487a8de52c6cfa647a658f61150dd72e0acb0125470524fb94d1f8b23321a

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Description
Official run documentation inspected on 2026-09-17; no installation or benchmark execution performed.
Source metadata
OATML-Markslab/ProteinGym / README.md

Original source ↗

No field-specific location recorded

Version: Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c
Retrieved: 2026-09-17T09:32:03.517591+00:00

catalogued

No individual claim review recorded

Audit details

Field: description

Source artifact SHA-256: 321487a8de52c6cfa647a658f61150dd72e0acb0125470524fb94d1f8b23321a

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Search facets
None recorded
Source metadata
OATML-Markslab/ProteinGym / README.md

Original source ↗

No field-specific location recorded

Version: Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c
Retrieved: 2026-09-17T09:32:03.517591+00:00

catalogued

No individual claim review recorded

Audit details

Field: facets

Source artifact SHA-256: 321487a8de52c6cfa647a658f61150dd72e0acb0125470524fb94d1f8b23321a

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Record ID
run-doc-proteingym-readme-md-144fe22b
Source metadata
OATML-Markslab/ProteinGym / README.md

Original source ↗

No field-specific location recorded

Version: Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c
Retrieved: 2026-09-17T09:32:03.517591+00:00

catalogued

No individual claim review recorded

Audit details

Field: id

Source artifact SHA-256: 321487a8de52c6cfa647a658f61150dd72e0acb0125470524fb94d1f8b23321a

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

How to read the evidence

Sources and history

Release 2026-10-22-1b7cf027e4f6 · Record review: source checked

Official run documentation inspected on 2026-09-17; no installation or benchmark execution performed.

Release history

No supporting source is linked yet.

Read original source

Download this release (gzip)
Technical metadata and extraction receipts

Stable ID: run-doc-proteingym-readme-md-144fe22b

url
https://github.com/OATML-Markslab/ProteinGym/blob/144fe22b07dfaeec2b366f2346203a9838a55b4c/README.md
artifact url
https://raw.githubusercontent.com/OATML-Markslab/ProteinGym/144fe22b07dfaeec2b366f2346203a9838a55b4c/README.md
artifact sha256
321487a8de52c6cfa647a658f61150dd72e0acb0125470524fb94d1f8b23321a
version
Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c
retrieved at
2026-09-17T09:32:03.517591+00:00
review
scope: Documentation and command-source review only, not computational reproduction.; method: automated-source-review
Related records

    Suggest a correction