rewirebio.iobenchmarks
Source

Protocol metadata evidence: proteingym-reference_files-DMS_substitutions.csv

144fe22b07dfaeec2b366f2346203a9838a55b4c

Original source

What this source contributed

Records in this release that cite this source. A record can cite several sources.

Results

Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.

Model or configurationMetricValueDatasetEvaluation
AIDO Protein-RAG (16B) [ProteinGym 144fe22b snapshot]Spearman0.445 unitlessProteinGym AMFR 4G3O official snapshot cohortAIDO Protein-RAG (16B) AMFR official snapshot
CARP (38M) [ProteinGym 144fe22b snapshot]Spearman-0.185 unitlessProteinGym AMFR 4G3O official snapshot cohortCARP (38M) AMFR official snapshot
CARP (76M) [ProteinGym 144fe22b snapshot]Spearman0.114 unitlessProteinGym AMFR 4G3O official snapshot cohortCARP (76M) AMFR official snapshot
CARP (600K) [ProteinGym 144fe22b snapshot]Spearman-0.194 unitlessProteinGym AMFR 4G3O official snapshot cohortCARP (600K) AMFR official snapshot
CARP (640M) [ProteinGym 144fe22b snapshot]Spearman0.165 unitlessProteinGym AMFR 4G3O official snapshot cohortCARP (640M) AMFR official snapshot
DeepSequence (ensemble) [ProteinGym 144fe22b snapshot]Spearman0.407 unitlessProteinGym AMFR 4G3O official snapshot cohortDeepSequence (ensemble) AMFR official snapshot
DeepSequence (single) [ProteinGym 144fe22b snapshot]Spearman0.419 unitlessProteinGym AMFR 4G3O official snapshot cohortDeepSequence (single) AMFR official snapshot
ESCOTT [ProteinGym 144fe22b snapshot]Spearman0.41 unitlessProteinGym AMFR 4G3O official snapshot cohortESCOTT AMFR official snapshot
ESM-1b [ProteinGym 144fe22b snapshot]Spearman0.374 unitlessProteinGym AMFR 4G3O official snapshot cohortESM-1b AMFR official snapshot
ESM-1v (ensemble) [ProteinGym 144fe22b snapshot]Spearman0.423 unitlessProteinGym AMFR 4G3O official snapshot cohortESM-1v (ensemble) AMFR official snapshot
ESM-1v (single) [ProteinGym 144fe22b snapshot]Spearman0.07 unitlessProteinGym AMFR 4G3O official snapshot cohortESM-1v (single) AMFR official snapshot
ESM-C (300M) [ProteinGym 144fe22b snapshot]Spearman0.364 unitlessProteinGym AMFR 4G3O official snapshot cohortESM-C (300M) AMFR official snapshot
ESM-C (600M) [ProteinGym 144fe22b snapshot]Spearman0.262 unitlessProteinGym AMFR 4G3O official snapshot cohortESM-C (600M) AMFR official snapshot
ESM-IF1 [ProteinGym 144fe22b snapshot]Spearman0.433 unitlessProteinGym AMFR 4G3O official snapshot cohortESM-IF1 AMFR official snapshot
ESM2 (3B) [ProteinGym 144fe22b snapshot]Spearman0.297 unitlessProteinGym AMFR 4G3O official snapshot cohortESM2 (3B) AMFR official snapshot
ESM2 (8M) [ProteinGym 144fe22b snapshot]Spearman-0.209 unitlessProteinGym AMFR 4G3O official snapshot cohortESM2 (8M) AMFR official snapshot
ESM2 (15B) [ProteinGym 144fe22b snapshot]Spearman0.26 unitlessProteinGym AMFR 4G3O official snapshot cohortESM2 (15B) AMFR official snapshot
ESM2 (35M) [ProteinGym 144fe22b snapshot]Spearman0.286 unitlessProteinGym AMFR 4G3O official snapshot cohortESM2 (35M) AMFR official snapshot
ESM2 (150M) [ProteinGym 144fe22b snapshot]Spearman0.321 unitlessProteinGym AMFR 4G3O official snapshot cohortESM2 (150M) AMFR official snapshot
ESM2 (650M) [ProteinGym 144fe22b snapshot]Spearman0.261 unitlessProteinGym AMFR 4G3O official snapshot cohortESM2 (650M) AMFR official snapshot
ESM3 open (1.4B) [ProteinGym 144fe22b snapshot]Spearman0.29 unitlessProteinGym AMFR 4G3O official snapshot cohortESM3 open (1.4B) AMFR official snapshot
EVE (ensemble) [ProteinGym 144fe22b snapshot]Spearman0.398 unitlessProteinGym AMFR 4G3O official snapshot cohortEVE (ensemble) AMFR official snapshot
EVE (single) [ProteinGym 144fe22b snapshot]Spearman0.386 unitlessProteinGym AMFR 4G3O official snapshot cohortEVE (single) AMFR official snapshot
EVmutation [ProteinGym 144fe22b snapshot]Spearman0.418 unitlessProteinGym AMFR 4G3O official snapshot cohortEVmutation AMFR official snapshot
GEMME [ProteinGym 144fe22b snapshot]Spearman0.396 unitlessProteinGym AMFR 4G3O official snapshot cohortGEMME AMFR official snapshot
MIF [ProteinGym 144fe22b snapshot]Spearman0.251 unitlessProteinGym AMFR 4G3O official snapshot cohortMIF AMFR official snapshot
MIF-ST [ProteinGym 144fe22b snapshot]Spearman0.112 unitlessProteinGym AMFR 4G3O official snapshot cohortMIF-ST AMFR official snapshot
MSA Transformer (ensemble) [ProteinGym 144fe22b snapshot]Spearman0.24 unitlessProteinGym AMFR 4G3O official snapshot cohortMSA Transformer (ensemble) AMFR official snapshot
MSA Transformer (single) [ProteinGym 144fe22b snapshot]Spearman0.22 unitlessProteinGym AMFR 4G3O official snapshot cohortMSA Transformer (single) AMFR official snapshot
MULAN [ProteinGym 144fe22b snapshot]Spearman0.09 unitlessProteinGym AMFR 4G3O official snapshot cohortMULAN AMFR official snapshot
PoET (200M) [ProteinGym 144fe22b snapshot]Spearman0.272 unitlessProteinGym AMFR 4G3O official snapshot cohortPoET (200M) AMFR official snapshot
Progen2 Base [ProteinGym 144fe22b snapshot]Spearman-0.05 unitlessProteinGym AMFR 4G3O official snapshot cohortProgen2 Base AMFR official snapshot
Progen2 L [ProteinGym 144fe22b snapshot]Spearman-0.121 unitlessProteinGym AMFR 4G3O official snapshot cohortProgen2 L AMFR official snapshot
Progen2 M [ProteinGym 144fe22b snapshot]Spearman-0.089 unitlessProteinGym AMFR 4G3O official snapshot cohortProgen2 M AMFR official snapshot
Progen2 S [ProteinGym 144fe22b snapshot]Spearman-0.317 unitlessProteinGym AMFR 4G3O official snapshot cohortProgen2 S AMFR official snapshot
Progen2 XL [ProteinGym 144fe22b snapshot]Spearman0.056 unitlessProteinGym AMFR 4G3O official snapshot cohortProgen2 XL AMFR official snapshot
Progen3 1B [ProteinGym 144fe22b snapshot]Spearman-0.153 unitlessProteinGym AMFR 4G3O official snapshot cohortProgen3 1B AMFR official snapshot
Progen3 3B [ProteinGym 144fe22b snapshot]Spearman-0.133 unitlessProteinGym AMFR 4G3O official snapshot cohortProgen3 3B AMFR official snapshot
Progen3 112m [ProteinGym 144fe22b snapshot]Spearman-0.257 unitlessProteinGym AMFR 4G3O official snapshot cohortProgen3 112m AMFR official snapshot
Progen3 219m [ProteinGym 144fe22b snapshot]Spearman-0.164 unitlessProteinGym AMFR 4G3O official snapshot cohortProgen3 219m AMFR official snapshot
Progen3 339m [ProteinGym 144fe22b snapshot]Spearman-0.253 unitlessProteinGym AMFR 4G3O official snapshot cohortProgen3 339m AMFR official snapshot
Progen3 762m [ProteinGym 144fe22b snapshot]Spearman-0.209 unitlessProteinGym AMFR 4G3O official snapshot cohortProgen3 762m AMFR official snapshot
ProSST (K=20) [ProteinGym 144fe22b snapshot]Spearman0.363 unitlessProteinGym AMFR 4G3O official snapshot cohortProSST (K=20) AMFR official snapshot
ProSST (K=128) [ProteinGym 144fe22b snapshot]Spearman0.418 unitlessProteinGym AMFR 4G3O official snapshot cohortProSST (K=128) AMFR official snapshot
ProSST (K=512) [ProteinGym 144fe22b snapshot]Spearman0.479 unitlessProteinGym AMFR 4G3O official snapshot cohortProSST (K=512) AMFR official snapshot
ProSST (K=1024) [ProteinGym 144fe22b snapshot]Spearman0.535 unitlessProteinGym AMFR 4G3O official snapshot cohortProSST (K=1024) AMFR official snapshot
ProSST (K=2048) [ProteinGym 144fe22b snapshot]Spearman0.481 unitlessProteinGym AMFR 4G3O official snapshot cohortProSST (K=2048) AMFR official snapshot
ProSST (K=4096) [ProteinGym 144fe22b snapshot]Spearman0.587 unitlessProteinGym AMFR 4G3O official snapshot cohortProSST (K=4096) AMFR official snapshot
ProteinMPNN [ProteinGym 144fe22b snapshot]Spearman0.353 unitlessProteinGym AMFR 4G3O official snapshot cohortProteinMPNN AMFR official snapshot
ProtGPT2 [ProteinGym 144fe22b snapshot]Spearman0.09 unitlessProteinGym AMFR 4G3O official snapshot cohortProtGPT2 AMFR official snapshot

Claims

Statements this source supports, each with where in the source it was checked.

Models, benchmarks and other records

Benchmarks (1)

Protocols (3)

Dataset subsets (2)

Baselines (2)

Evaluations (97)

Use cases (1)

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

13 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-adc15377fab2
Property and statementOriginal source and locationReview and provenance
Artifact SHA-256
a8f498011532a74aa9fe556a50555a75e928c5837d19c06a87592ae04049b308
Source metadata
Protocol metadata evidence: proteingym-reference_files-DMS_substitutions.csv

Original source ↗

No field-specific location recorded

Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c
Retrieved: 2026-09-23T18:39:35.604049+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_sha256

Source artifact SHA-256: a8f498011532a74aa9fe556a50555a75e928c5837d19c06a87592ae04049b308

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Artifact url
https://raw.githubusercontent.com/OATML-Markslab/ProteinGym/144fe22b07dfaeec2b366f2346203a9838a55b4c/reference_files/DMS_substitutions.csv
Source metadata
Protocol metadata evidence: proteingym-reference_files-DMS_substitutions.csv

Original source ↗

No field-specific location recorded

Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c
Retrieved: 2026-09-23T18:39:35.604049+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_url

Source artifact SHA-256: a8f498011532a74aa9fe556a50555a75e928c5837d19c06a87592ae04049b308

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Retrieved at
2026-09-23T18:39:35.604049+00:00
Source metadata
Protocol metadata evidence: proteingym-reference_files-DMS_substitutions.csv

Original source ↗

No field-specific location recorded

Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c
Retrieved: 2026-09-23T18:39:35.604049+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.retrieved_at

Source artifact SHA-256: a8f498011532a74aa9fe556a50555a75e928c5837d19c06a87592ae04049b308

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Review artifact
data/omics/reviewed/profile-evidence-2026-09-23/artifacts/protocols-proteingym-reference_files-DMS_substitutions.csv.gz
Source metadata
Protocol metadata evidence: proteingym-reference_files-DMS_substitutions.csv

Original source ↗

No field-specific location recorded

Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c
Retrieved: 2026-09-23T18:39:35.604049+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.review_artifact

Source artifact SHA-256: a8f498011532a74aa9fe556a50555a75e928c5837d19c06a87592ae04049b308

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Url
https://raw.githubusercontent.com/OATML-Markslab/ProteinGym/144fe22b07dfaeec2b366f2346203a9838a55b4c/reference_files/DMS_substitutions.csv
Source metadata
Protocol metadata evidence: proteingym-reference_files-DMS_substitutions.csv

Original source ↗

No field-specific location recorded

Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c
Retrieved: 2026-09-23T18:39:35.604049+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.url

Source artifact SHA-256: a8f498011532a74aa9fe556a50555a75e928c5837d19c06a87592ae04049b308

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Version
144fe22b07dfaeec2b366f2346203a9838a55b4c
Source metadata
Protocol metadata evidence: proteingym-reference_files-DMS_substitutions.csv

Original source ↗

No field-specific location recorded

Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c
Retrieved: 2026-09-23T18:39:35.604049+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.version

Source artifact SHA-256: a8f498011532a74aa9fe556a50555a75e928c5837d19c06a87592ae04049b308

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Description
Primary source artifact checked for bounded protocol metadata; no model execution or scientific reproduction.
Source metadata
Protocol metadata evidence: proteingym-reference_files-DMS_substitutions.csv

Original source ↗

No field-specific location recorded

Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c
Retrieved: 2026-09-23T18:39:35.604049+00:00

catalogued

No individual claim review recorded

Audit details

Field: description

Source artifact SHA-256: a8f498011532a74aa9fe556a50555a75e928c5837d19c06a87592ae04049b308

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Search facets
None recorded
Source metadata
Protocol metadata evidence: proteingym-reference_files-DMS_substitutions.csv

Original source ↗

No field-specific location recorded

Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c
Retrieved: 2026-09-23T18:39:35.604049+00:00

catalogued

No individual claim review recorded

Audit details

Field: facets

Source artifact SHA-256: a8f498011532a74aa9fe556a50555a75e928c5837d19c06a87592ae04049b308

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Record ID
profile-protocol-proteingym-reference-files-dms-substitutions-csv-a8f49801
Source metadata
Protocol metadata evidence: proteingym-reference_files-DMS_substitutions.csv

Original source ↗

No field-specific location recorded

Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c
Retrieved: 2026-09-23T18:39:35.604049+00:00

catalogued

No individual claim review recorded

Audit details

Field: id

Source artifact SHA-256: a8f498011532a74aa9fe556a50555a75e928c5837d19c06a87592ae04049b308

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Record type
source
Source metadata
Protocol metadata evidence: proteingym-reference_files-DMS_substitutions.csv

Original source ↗

No field-specific location recorded

Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c
Retrieved: 2026-09-23T18:39:35.604049+00:00

catalogued

No individual claim review recorded

Audit details

Field: kind

Source artifact SHA-256: a8f498011532a74aa9fe556a50555a75e928c5837d19c06a87592ae04049b308

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-21-adc15377fab2 · Record review: source checked

Primary source artifact checked for bounded protocol metadata; no model execution or scientific reproduction.

Release history

No supporting source is linked yet.

Read original source

Download this release (gzip)
Technical metadata and extraction receipts

Stable ID: profile-protocol-proteingym-reference-files-dms-substitutions-csv-a8f49801

url
https://raw.githubusercontent.com/OATML-Markslab/ProteinGym/144fe22b07dfaeec2b366f2346203a9838a55b4c/reference_files/DMS_substitutions.csv
artifact url
https://raw.githubusercontent.com/OATML-Markslab/ProteinGym/144fe22b07dfaeec2b366f2346203a9838a55b4c/reference_files/DMS_substitutions.csv
artifact sha256
a8f498011532a74aa9fe556a50555a75e928c5837d19c06a87592ae04049b308
version
144fe22b07dfaeec2b366f2346203a9838a55b4c
retrieved at
2026-09-23T18:39:35.604049+00:00
review artifact
data/omics/reviewed/profile-evidence-2026-09-23/artifacts/protocols-proteingym-reference_files-DMS_substitutions.csv.gz
Related records

    Suggest a correction