rewirebio.iobenchmarks
Configuration

ESM3 open (1.4B) [ProteinGym 144fe22b snapshot]

ESM3 generates and completes protein sequence, structure and functional annotations using a shared multimodal representation.

Sources (3)evolutionaryscale/esm: README.md; evolutionaryscale/esm: _assets/ESM3_README.md; evolutionaryscale/esm: THIRD_PARTY_NOTICE.md · _assets/ESM3_README.md: overview, ESM3 Family, Running Locally and Licenses

2 evaluations · 19 results

How it worksESM3 workflow
ESM3 workflow1. Partial protein tracks. Then: 2. Multitrack transformer. Then: 3. Iterative unmasking. Then: 4. Completed sequence or structureESM3 workflow1. Partial protein tracks. Then: 2. Multitrack transformer. Then: 3. Iterative unmasking. Then: 4. Completed sequence or structureESM3 workflow1. Partial protein tracks. Then: 2. Multitrack transformer. Then: 3. Iterative unmasking. Then: 4. Completed sequence or structure

Conceptual summary of the documented data flow; optional inputs and configured downstream stages must be reported for a reproducible evaluation.

Sources (3)evolutionaryscale/esm: README.md; evolutionaryscale/esm: _assets/ESM3_README.md; evolutionaryscale/esm: THIRD_PARTY_NOTICE.md · _assets/ESM3_README.md: overview, ESM3 Family, Running Locally and Licenses

Overview

Model type

Multitrack generative protein transformer

Inputs

Complete or partial protein sequence, structure and function-keyword tracks.

Outputs

Completed sequence, structure and functional tracks.

Sources (3)evolutionaryscale/esm: README.md; evolutionaryscale/esm: _assets/ESM3_README.md; evolutionaryscale/esm: THIRD_PARTY_NOTICE.md · _assets/ESM3_README.md: overview, ESM3 Family, Running Locally and Licenses

limited source coverage · Automated source review, 2026-09-16. All specifications and missing details

Evaluations and results

2 evaluations · 19 results. Different protocols are not a single leaderboard.

Sorted by Spearman (higher is better). The best value in each column is highlighted. Decimals are rounded for display; each value links to the printed value and its source.

Tested configurationProtocol and datasetSpearmanSpearman (ProteinGym zero-shot DMS substitutions, Activity assays: mean over proteins of assay-level Spearman)Spearman (ProteinGym zero-shot DMS substitutions, Binding assays: mean over proteins of assay-level Spearman)Spearman (ProteinGym zero-shot DMS substitutions, Expression assays: mean over proteins of assay-level Spearman)Spearman (ProteinGym zero-shot DMS substitutions, High MSA depth proteins: mean over proteins of assay-level Spearman)Spearman (ProteinGym zero-shot DMS substitutions, Human proteins: mean over proteins of assay-level Spearman)Spearman (ProteinGym zero-shot DMS substitutions, Low MSA depth proteins: mean over proteins of assay-level Spearman)Spearman (ProteinGym zero-shot DMS substitutions, mean over selection types of the per-type mean over proteins of assay-level Spearman (all 217 assays))Spearman (ProteinGym zero-shot DMS substitutions, Medium MSA depth proteins: mean over proteins of assay-level Spearman)Spearman (ProteinGym zero-shot DMS substitutions, Organismal fitness assays: mean over proteins of assay-level Spearman)Spearman (ProteinGym zero-shot DMS substitutions, Other eukaryote proteins: mean over proteins of assay-level Spearman)Spearman (ProteinGym zero-shot DMS substitutions, Prokaryote proteins: mean over proteins of assay-level Spearman)Spearman (ProteinGym zero-shot DMS substitutions, Stability assays: mean over proteins of assay-level Spearman)Spearman (ProteinGym zero-shot DMS substitutions, variants with 1 substitution: mean over protein and selection-type groups of assay-level Spearman)Spearman (ProteinGym zero-shot DMS substitutions, variants with 2 substitutions: mean over protein and selection-type groups of assay-level Spearman)Spearman (ProteinGym zero-shot DMS substitutions, variants with 3 substitutions: mean over protein and selection-type groups of assay-level Spearman)Spearman (ProteinGym zero-shot DMS substitutions, variants with 4 substitutions: mean over protein and selection-type groups of assay-level Spearman)Spearman (ProteinGym zero-shot DMS substitutions, variants with 5 or more substitutions: mean over protein and selection-type groups of assay-level Spearman)Spearman (ProteinGym zero-shot DMS substitutions, Virus proteins: mean over proteins of assay-level Spearman)
ESM3 open (1.4B) [ProteinGym 144fe22b snapshot]EvaluationProteinGym AMFR official zero-shot Spearman snapshot, ProteinGym AMFR 4G3O official snapshot cohort0.29Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ESM3 open (1.4B) [ProteinGym 144fe22b snapshot]EvaluationProteinGym v1.3 zero-shot DMS substitutions, ProteinGym DMS substitution assays at commit 144fe22 (217 assays)Not reported0.430.40.470.5750.480.3970.4660.4660.3890.5480.530.6410.4870.3370.3070.2850.3630.406
All 19 result rows with coverage, uncertainty and sources
Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: ESM3 open (1.4B) [ProteinGym 144fe22b snapshot]Protocol: ProteinGym AMFR official zero-shot Spearman snapshot
Dataset subset: ProteinGym AMFR 4G3O official snapshot cohort
0.29 Spearman
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

ESM3 open (1.4B) AMFR official snapshot

Not reported

Aggregation: Not reported

ProteinGym AMFR assay-level Spearman comparison · DMS_substitutions_Spearman_DMS_level.csv line 15, DMS ID=AMFR_HUMAN_Tsuboyama_2023_4G3O, column=ESM3 open (1.4B)
Configuration: ESM3 open (1.4B) [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.466 Spearman (ProteinGym zero-shot DMS substitutions, mean over selection types of the per-type mean over proteins of assay-level Spearman (all 217 assays))
unitless · higher

Uncertainty: SE 0.006. From compute_bootstrap_standard_error_functional_categories in performance_DMS_benchmarks.py at 144fe22 (default 10,000 resamples, lines 95-111 and 310-315); not an absolute standard error of the model's own average.

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

ESM3 open (1.4B): ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 15, row 'ESM3 open (1.4B)', column 'Average_Spearman'
Configuration: ESM3 open (1.4B) [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.487 Spearman (ProteinGym zero-shot DMS substitutions, variants with 1 substitution: mean over protein and selection-type groups of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

ESM3 open (1.4B): ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 15, row 'ESM3 open (1.4B)', column 'Depth_1'
Configuration: ESM3 open (1.4B) [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.337 Spearman (ProteinGym zero-shot DMS substitutions, variants with 2 substitutions: mean over protein and selection-type groups of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

ESM3 open (1.4B): ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 15, row 'ESM3 open (1.4B)', column 'Depth_2'
Configuration: ESM3 open (1.4B) [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.307 Spearman (ProteinGym zero-shot DMS substitutions, variants with 3 substitutions: mean over protein and selection-type groups of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

ESM3 open (1.4B): ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 15, row 'ESM3 open (1.4B)', column 'Depth_3'
Configuration: ESM3 open (1.4B) [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.285 Spearman (ProteinGym zero-shot DMS substitutions, variants with 4 substitutions: mean over protein and selection-type groups of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

ESM3 open (1.4B): ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 15, row 'ESM3 open (1.4B)', column 'Depth_4'
Configuration: ESM3 open (1.4B) [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.363 Spearman (ProteinGym zero-shot DMS substitutions, variants with 5 or more substitutions: mean over protein and selection-type groups of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

ESM3 open (1.4B): ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 15, row 'ESM3 open (1.4B)', column 'Depth_5+'
Configuration: ESM3 open (1.4B) [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.43 Spearman (ProteinGym zero-shot DMS substitutions, Activity assays: mean over proteins of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

ESM3 open (1.4B): ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 15, row 'ESM3 open (1.4B)', column 'Function_Activity'
Configuration: ESM3 open (1.4B) [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.4 Spearman (ProteinGym zero-shot DMS substitutions, Binding assays: mean over proteins of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

ESM3 open (1.4B): ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 15, row 'ESM3 open (1.4B)', column 'Function_Binding'
Configuration: ESM3 open (1.4B) [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.47 Spearman (ProteinGym zero-shot DMS substitutions, Expression assays: mean over proteins of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

ESM3 open (1.4B): ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 15, row 'ESM3 open (1.4B)', column 'Function_Expression'
Configuration: ESM3 open (1.4B) [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.389 Spearman (ProteinGym zero-shot DMS substitutions, Organismal fitness assays: mean over proteins of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

ESM3 open (1.4B): ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 15, row 'ESM3 open (1.4B)', column 'Function_OrganismalFitness'
Configuration: ESM3 open (1.4B) [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.641 Spearman (ProteinGym zero-shot DMS substitutions, Stability assays: mean over proteins of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

ESM3 open (1.4B): ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 15, row 'ESM3 open (1.4B)', column 'Function_Stability'
Configuration: ESM3 open (1.4B) [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.575 Spearman (ProteinGym zero-shot DMS substitutions, High MSA depth proteins: mean over proteins of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

ESM3 open (1.4B): ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 15, row 'ESM3 open (1.4B)', column 'High_MSA_depth'
Configuration: ESM3 open (1.4B) [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.397 Spearman (ProteinGym zero-shot DMS substitutions, Low MSA depth proteins: mean over proteins of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

ESM3 open (1.4B): ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 15, row 'ESM3 open (1.4B)', column 'Low_MSA_depth'
Configuration: ESM3 open (1.4B) [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.466 Spearman (ProteinGym zero-shot DMS substitutions, Medium MSA depth proteins: mean over proteins of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

ESM3 open (1.4B): ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 15, row 'ESM3 open (1.4B)', column 'Medium_MSA_depth'
Configuration: ESM3 open (1.4B) [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.48 Spearman (ProteinGym zero-shot DMS substitutions, Human proteins: mean over proteins of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

ESM3 open (1.4B): ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 15, row 'ESM3 open (1.4B)', column 'Taxa_Human'
Configuration: ESM3 open (1.4B) [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.548 Spearman (ProteinGym zero-shot DMS substitutions, Other eukaryote proteins: mean over proteins of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

ESM3 open (1.4B): ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 15, row 'ESM3 open (1.4B)', column 'Taxa_Other_Eukaryote'
Configuration: ESM3 open (1.4B) [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.53 Spearman (ProteinGym zero-shot DMS substitutions, Prokaryote proteins: mean over proteins of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

ESM3 open (1.4B): ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 15, row 'ESM3 open (1.4B)', column 'Taxa_Prokaryote'
Configuration: ESM3 open (1.4B) [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.406 Spearman (ProteinGym zero-shot DMS substitutions, Virus proteins: mean over proteins of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

ESM3 open (1.4B): ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 15, row 'ESM3 open (1.4B)', column 'Taxa_Virus'

Source checking is not independent reproduction. Release 2026-10-22-1b7cf027e4f6.

Use this configuration

How it works, versions and access

Related profile: ESM3. This page retains the exact record and its evaluation context.

This configuration

ESM3 open (1.4B), from the ProteinGym reference scores at commit 144fe22b.

record
ESM3 open (1.4B) [ProteinGym 144fe22b snapshot]
configuration
144fe22b07dfaeec2b366f2346203a9838a55b4c
entity type
Configuration

How it works

How it works

Transformer generative masked-language model with discrete sequence, structure and function tracks; generation iteratively fills masked positions. The documented inputs are complete or partial protein sequence, structure and function-keyword tracks. The output consists of completed sequence, structure and functional tracks.

Sources (3)evolutionaryscale/esm: README.md; evolutionaryscale/esm: _assets/ESM3_README.md; evolutionaryscale/esm: THIRD_PARTY_NOTICE.md · _assets/ESM3_README.md: overview, ESM3 Family, Running Locally and Licenses
Versions and reproducibility

Published March 2024 small/medium/large models, August 2024 small/medium models, and esm3-sm-open-v1 local weights. The applicable input limits require configuration-specific checking.

Sources (3)evolutionaryscale/esm: README.md; evolutionaryscale/esm: _assets/ESM3_README.md; evolutionaryscale/esm: THIRD_PARTY_NOTICE.md · _assets/ESM3_README.md: overview, ESM3 Family, Running Locally and Licenses
Strengths, limitations and unresolved questions

Strengths and limitations

Profile review details

Inspected pinned official documentation, relevant implementation files and named primary-paper sections. Claims are limited to those artifacts. Remaining field extraction and identity conflicts are explicit; no new performance claims, model runs or human review are implied.

Stable record: discovery-model-esm3

Specifications

Inputs, training, access and other details

Explanatory profile: limited source coverage · Automated source review, 2026-09-16. Review applies to the cited claims; unresolved fields are listed below. Numerical results retain their own review status.

Inputs, outputs and configuration
PropertyDescription and evidence
Model typeMultitrack generative protein transformer
Sources (3)evolutionaryscale/esm: README.md; evolutionaryscale/esm: _assets/ESM3_README.md; evolutionaryscale/esm: THIRD_PARTY_NOTICE.md · _assets/ESM3_README.md: overview, ESM3 Family, Running Locally and Licenses
ArchitectureTransformer generative masked-language model with discrete sequence, structure and function tracks; generation iteratively fills masked positions.
Sources (3)evolutionaryscale/esm: README.md; evolutionaryscale/esm: _assets/ESM3_README.md; evolutionaryscale/esm: THIRD_PARTY_NOTICE.md · _assets/ESM3_README.md: overview, ESM3 Family, Running Locally and Licenses
InputsComplete or partial protein sequence, structure and function-keyword tracks.
Sources (3)evolutionaryscale/esm: README.md; evolutionaryscale/esm: _assets/ESM3_README.md; evolutionaryscale/esm: THIRD_PARTY_NOTICE.md · _assets/ESM3_README.md: overview, ESM3 Family, Running Locally and Licenses
OutputsCompleted sequence, structure and functional tracks.
Sources (3)evolutionaryscale/esm: README.md; evolutionaryscale/esm: _assets/ESM3_README.md; evolutionaryscale/esm: THIRD_PARTY_NOTICE.md · _assets/ESM3_README.md: overview, ESM3 Family, Running Locally and Licenses
Parameters1.4B small, 7B medium and 98B large variants.
Sources (3)evolutionaryscale/esm: README.md; evolutionaryscale/esm: _assets/ESM3_README.md; evolutionaryscale/esm: THIRD_PARTY_NOTICE.md · _assets/ESM3_README.md: overview, ESM3 Family, Running Locally and Licenses
Known versionsPublished March 2024 small/medium/large models, August 2024 small/medium models, and esm3-sm-open-v1 local weights.
Sources (3)evolutionaryscale/esm: README.md; evolutionaryscale/esm: _assets/ESM3_README.md; evolutionaryscale/esm: THIRD_PARTY_NOTICE.md · _assets/ESM3_README.md: overview, ESM3 Family, Running Locally and Licenses
Training dataESM3 overview reports 2.78 billion proteins and 771 billion unique tokens for the largest model; this is not a verified per-checkpoint manifest.
Sources (3)evolutionaryscale/esm: README.md; evolutionaryscale/esm: _assets/ESM3_README.md; evolutionaryscale/esm: THIRD_PARTY_NOTICE.md · _assets/ESM3_README.md: overview, ESM3 Family, Running Locally and Licenses
Training cutoffThe inspected ESM3 release documentation does not supply one latest-data date shared across its sequence, structure and function tracks. · Not reported in inspected sources
Sources (3)evolutionaryscale/esm: README.md; evolutionaryscale/esm: _assets/ESM3_README.md; evolutionaryscale/esm: THIRD_PARTY_NOTICE.md · _assets/ESM3_README.md: overview, ESM3 Family, Running Locally and Licenses
Context limitsThe inspected ESM3 family documentation does not establish one context limit for local small, hosted medium and hosted large models; a specific service/checkpoint is required. · Not reported in inspected sources
Sources (3)evolutionaryscale/esm: README.md; evolutionaryscale/esm: _assets/ESM3_README.md; evolutionaryscale/esm: THIRD_PARTY_NOTICE.md · _assets/ESM3_README.md: overview, ESM3 Family, Running Locally and Licenses
Weights licenceMIT stated in the inspected ESM3 README; model and API access conditions remain separate.
Sources (3)evolutionaryscale/esm: README.md; evolutionaryscale/esm: _assets/ESM3_README.md; evolutionaryscale/esm: THIRD_PARTY_NOTICE.md · _assets/ESM3_README.md: overview, ESM3 Family, Running Locally and Licenses
AccessOfficial project documentation and implementation: https://github.com/evolutionaryscale/esm
Sources (3)evolutionaryscale/esm: README.md; evolutionaryscale/esm: _assets/ESM3_README.md; evolutionaryscale/esm: THIRD_PARTY_NOTICE.md · _assets/ESM3_README.md: overview, ESM3 Family, Running Locally and Licenses
Code licenceMIT
Sourcesevolutionaryscale/esm: LICENSE.md · LICENSE.md: licence text

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

2 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-10-22-1b7cf027e4f6
Property and statementOriginal source and locationReview and provenance
Facets: method types
1 values
  • foundation_model
Individual claims
ProteinGym AMFR assay-level Spearman comparison

Original source ↗

Proposer's report, ProteinGym AMFR: protein language and structure-conditioned models fit foundation_model

Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c
Retrieved: 2026-09-30

conflicting claim

["automated-source-review"] · 2026-10-12

Audit details

Correct the method type from none to foundation_model (use-case baseline review 2026-10-12, table 2). Not source-checked in the review; this comparison has no baseline row. Evidence from docs/reviews/use-cases/baselines-2026-10-12.md. Independent review 2026-10-12: approved. See docs/reviews/2026-10-12-method-type-corrections.md.

Conflicting source claim: "[\"foundation_model\"]". Claim record status: source_checked.

Field: facets.method_types

Claim: metadata-correction-tags-20261012-b4e71b6666c5efcd6f1f

Source artifact SHA-256: f432423b87f79ac9778dfac86e3d95be041d246bc618dc0a406b35b0b7466437

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Relationship: configuration of
discovery-model-esm3
Individual claims
ProteinGym AMFR assay-level Spearman comparison

Original source ↗

Pinned ProteinGym Spearman CSV header: ESM3 open (1.4B)

Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c
Retrieved: 2026-09-30

source checked

["automated-source-review"] · 2026-09-30T21:40:59.576893+00:00

Audit details

Field: links:configuration_of:discovery-model-esm3

Claim: uc20260930-config-family-b2aa9ed7a7729807

Source artifact SHA-256: f432423b87f79ac9778dfac86e3d95be041d246bc618dc0a406b35b0b7466437

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Sources and history

Release 2026-10-22-1b7cf027e4f6 · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: uc20260930-proteingym-amfr-config-esm3-open-1-4b

areas
proteins-complexes
method types
foundation_model
source locator
See linked evaluation and result locators
missing metadata
checkpoint hash: reason: unextracted
review
method: automated-source-review; reviewer: codex; reviewed at: 2026-09-30T21:40:59.576893+00:00; scope: Primary-source transcription and catalogue applicability audit; not human scientific review or independent experimental reproduction.; reviewer note: role: experimental use-case curation
reported name
ESM3 open (1.4B)
version
144fe22b07dfaeec2b366f2346203a9838a55b4c
provenance note
Exact official CSV source-label configuration; checkpoint and per-assay scoring details are not inferred from similarly named methods.
Related records

Suggest a correction