rewire.itbenchmarks
Configuration

ESM3 open (1.4B) [ProteinGym 144fe22b snapshot]

ESM3 generates and completes protein sequence, structure and functional annotations using a shared multimodal representation.

Sources (3)evolutionaryscale/esm: README.md; evolutionaryscale/esm: _assets/ESM3_README.md; evolutionaryscale/esm: THIRD_PARTY_NOTICE.md · _assets/ESM3_README.md: overview, ESM3 Family, Running Locally and Licenses

1 evaluation · 1 result

How it worksESM3 workflow
ESM3 workflow1. Partial protein tracks. Then: 2. Multitrack transformer. Then: 3. Iterative unmasking. Then: 4. Completed sequence or structureESM3 workflow1. Partial protein tracks. Then: 2. Multitrack transformer. Then: 3. Iterative unmasking. Then: 4. Completed sequence or structureESM3 workflow1. Partial protein tracks. Then: 2. Multitrack transformer. Then: 3. Iterative unmasking. Then: 4. Completed sequence or structure

Conceptual summary of the documented data flow; optional inputs and configured downstream stages must be reported for a reproducible evaluation.

Sources (3)evolutionaryscale/esm: README.md; evolutionaryscale/esm: _assets/ESM3_README.md; evolutionaryscale/esm: THIRD_PARTY_NOTICE.md · _assets/ESM3_README.md: overview, ESM3 Family, Running Locally and Licenses

Overview

Model type

Multitrack generative protein transformer

Inputs

Complete or partial protein sequence, structure and function-keyword tracks.

Outputs

Completed sequence, structure and functional tracks.

Sources (3)evolutionaryscale/esm: README.md; evolutionaryscale/esm: _assets/ESM3_README.md; evolutionaryscale/esm: THIRD_PARTY_NOTICE.md · _assets/ESM3_README.md: overview, ESM3 Family, Running Locally and Licenses

limited source coverage · Automated source review, 2026-09-16. All specifications and missing details

Evaluations and results

1 evaluation · 1 result. Different protocols are not a single leaderboard.

Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: ESM3 open (1.4B) [ProteinGym 144fe22b snapshot]Protocol: ProteinGym AMFR official zero-shot Spearman snapshot
Dataset subset: ProteinGym AMFR 4G3O official snapshot cohort
0.29 spearman_rho
correlation · higher

Uncertainty: type: unreported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM3 open (1.4B) AMFR official snapshot

Not reported

Aggregation: Not reported

ProteinGym AMFR assay-level Spearman comparison · DMS_substitutions_Spearman_DMS_level.csv line 15, DMS ID=AMFR_HUMAN_Tsuboyama_2023_4G3O, column=ESM3 open (1.4B)

Source checking is not independent reproduction. Release 2026-09-30-e37e3ab1284d.

Use this model

How it works, versions and access

Related profile: ESM3. This page retains the exact record and its evaluation context.

This configuration

Exact official CSV source-label configuration; checkpoint and per-assay scoring details are not inferred from similarly named methods.

record
ESM3 open (1.4B) [ProteinGym 144fe22b snapshot]
configuration
144fe22b07dfaeec2b366f2346203a9838a55b4c
entity type
Configuration

How it works

How it works

ESM3 generates and completes protein sequence, structure and functional annotations using a shared multimodal representation. Transformer generative masked-language model with discrete sequence, structure and function tracks; generation iteratively fills masked positions. The documented inputs are complete or partial protein sequence, structure and function-keyword tracks. The output consists of completed sequence, structure and functional tracks.

Sources (3)evolutionaryscale/esm: README.md; evolutionaryscale/esm: _assets/ESM3_README.md; evolutionaryscale/esm: THIRD_PARTY_NOTICE.md · _assets/ESM3_README.md: overview, ESM3 Family, Running Locally and Licenses
Versions and reproducibility

Published March 2024 small/medium/large models, August 2024 small/medium models, and esm3-sm-open-v1 local weights. The applicable input limits require configuration-specific checking.

Sources (3)evolutionaryscale/esm: README.md; evolutionaryscale/esm: _assets/ESM3_README.md; evolutionaryscale/esm: THIRD_PARTY_NOTICE.md · _assets/ESM3_README.md: overview, ESM3 Family, Running Locally and Licenses
Strengths, limitations and unresolved questions

Strengths and limitations

Profile review details

Inspected pinned official documentation, relevant implementation files and named primary-paper sections. Claims are limited to those artifacts. Remaining field extraction and identity conflicts are explicit; no new performance claims, model runs or human review are implied.

Stable record: discovery-model-esm3

Specifications

Inputs, training, access and other details

Explanatory profile: limited source coverage · Automated source review, 2026-09-16. Review applies to the cited claims; unresolved fields are listed below. Numerical results retain their own review status.

Inputs, outputs and configuration
PropertyDescription and evidence
Model typeMultitrack generative protein transformer
Sources (3)evolutionaryscale/esm: README.md; evolutionaryscale/esm: _assets/ESM3_README.md; evolutionaryscale/esm: THIRD_PARTY_NOTICE.md · _assets/ESM3_README.md: overview, ESM3 Family, Running Locally and Licenses
ArchitectureTransformer generative masked-language model with discrete sequence, structure and function tracks; generation iteratively fills masked positions.
Sources (3)evolutionaryscale/esm: README.md; evolutionaryscale/esm: _assets/ESM3_README.md; evolutionaryscale/esm: THIRD_PARTY_NOTICE.md · _assets/ESM3_README.md: overview, ESM3 Family, Running Locally and Licenses
InputsComplete or partial protein sequence, structure and function-keyword tracks.
Sources (3)evolutionaryscale/esm: README.md; evolutionaryscale/esm: _assets/ESM3_README.md; evolutionaryscale/esm: THIRD_PARTY_NOTICE.md · _assets/ESM3_README.md: overview, ESM3 Family, Running Locally and Licenses
OutputsCompleted sequence, structure and functional tracks.
Sources (3)evolutionaryscale/esm: README.md; evolutionaryscale/esm: _assets/ESM3_README.md; evolutionaryscale/esm: THIRD_PARTY_NOTICE.md · _assets/ESM3_README.md: overview, ESM3 Family, Running Locally and Licenses
Parameters1.4B small, 7B medium and 98B large variants.
Sources (3)evolutionaryscale/esm: README.md; evolutionaryscale/esm: _assets/ESM3_README.md; evolutionaryscale/esm: THIRD_PARTY_NOTICE.md · _assets/ESM3_README.md: overview, ESM3 Family, Running Locally and Licenses
Known versionsPublished March 2024 small/medium/large models, August 2024 small/medium models, and esm3-sm-open-v1 local weights.
Sources (3)evolutionaryscale/esm: README.md; evolutionaryscale/esm: _assets/ESM3_README.md; evolutionaryscale/esm: THIRD_PARTY_NOTICE.md · _assets/ESM3_README.md: overview, ESM3 Family, Running Locally and Licenses
Training dataESM3 overview reports 2.78 billion proteins and 771 billion unique tokens for the largest model; this is not a verified per-checkpoint manifest.
Sources (3)evolutionaryscale/esm: README.md; evolutionaryscale/esm: _assets/ESM3_README.md; evolutionaryscale/esm: THIRD_PARTY_NOTICE.md · _assets/ESM3_README.md: overview, ESM3 Family, Running Locally and Licenses
Training cutoffThe inspected ESM3 release documentation does not supply one latest-data date shared across its sequence, structure and function tracks. · Not reported in inspected sources
Sources (3)evolutionaryscale/esm: README.md; evolutionaryscale/esm: _assets/ESM3_README.md; evolutionaryscale/esm: THIRD_PARTY_NOTICE.md · _assets/ESM3_README.md: overview, ESM3 Family, Running Locally and Licenses
Context limitsThe inspected ESM3 family documentation does not establish one context limit for local small, hosted medium and hosted large models; a specific service/checkpoint is required. · Not reported in inspected sources
Sources (3)evolutionaryscale/esm: README.md; evolutionaryscale/esm: _assets/ESM3_README.md; evolutionaryscale/esm: THIRD_PARTY_NOTICE.md · _assets/ESM3_README.md: overview, ESM3 Family, Running Locally and Licenses
Weights licenceMIT stated in the inspected ESM3 README; model and API access conditions remain separate.
Sources (3)evolutionaryscale/esm: README.md; evolutionaryscale/esm: _assets/ESM3_README.md; evolutionaryscale/esm: THIRD_PARTY_NOTICE.md · _assets/ESM3_README.md: overview, ESM3 Family, Running Locally and Licenses
AccessOfficial project documentation and implementation: https://github.com/evolutionaryscale/esm
Sources (3)evolutionaryscale/esm: README.md; evolutionaryscale/esm: _assets/ESM3_README.md; evolutionaryscale/esm: THIRD_PARTY_NOTICE.md · _assets/ESM3_README.md: overview, ESM3 Family, Running Locally and Licenses
Code licenceMIT
Sourcesevolutionaryscale/esm: LICENSE.md · LICENSE.md: licence text

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

1 evidence row matching the loaded filters

Claims, original sources and review scope · Release 2026-09-30-e37e3ab1284d
Property and statementOriginal source and locationReview and provenance
Relationship: variant of
discovery-model-esm3
Individual claims
ProteinGym AMFR assay-level Spearman comparison

Original source ↗

Pinned ProteinGym Spearman CSV header: ESM3 open (1.4B)

Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c
Retrieved: 2026-09-30

source checked

automated source review · 2026-09-30T21:40:59.576893+00:00

Audit details

Field: links:variant_of:discovery-model-esm3

Claim: uc20260930-config-family-b2aa9ed7a7729807

Source artifact SHA-256: f432423b87f79ac9778dfac86e3d95be041d246bc618dc0a406b35b0b7466437

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Sources and history

View linked audit checks and correction history

Release 2026-09-30-e37e3ab1284d · Record review: source checked

1 source records and release historyDownload this release
Technical metadata and extraction receipts

Stable ID: uc20260930-proteingym-amfr-config-esm3-open-1-4b

areas
proteins-complexes
source locator
See linked evaluation and result locators
missing metadata
checkpoint hash: unextracted
review
method: automated_source_review; reviewer: Codex experimental-use-case curation; date: 2026-09-30; reviewed at: 2026-09-30T21:40:59.576893+00:00; scope: Primary-source transcription and catalogue applicability audit; not human scientific review or independent experimental reproduction.
reported name
ESM3 open (1.4B)
version
144fe22b07dfaeec2b366f2346203a9838a55b4c
Related records

Suggest a correction