Model type
Protein transformer for variant-effect scoring
ESM-1v provides protein language models intended for zero-shot variant-effect scoring.
1 evaluation · 5 results · 5 evaluated configurations using this model
Conceptual summary of the documented data flow; optional inputs and configured downstream stages must be reported for a reproducible evaluation.
Protein transformer for variant-effect scoring
Protein amino-acid sequence and the specified sequence variation.
Token probabilities used to calculate sequence-variant scores.
Official project documentation and implementation: https://github.com/facebookresearch/esm
limited source coverage · Automated source review, 2026-09-16. All specifications and missing details
1 evaluation · 5 results. Different protocols are not a single leaderboard.
Applied filters: All linked evaluations
| Tested configuration | Protocol and dataset | Finding | Evidence and details |
|---|---|---|---|
| Configuration: ESM-1v (ensemble) | Task: ProteinGym ZS-SUB-AUC: Zero-shot substitutions, AUC Dataset subset: ProteinGym substitution DMS assays (ProteinGym split) | 0.723 auc fraction · higher Uncertainty: Not reported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceESM-1v (ensemble) on ProteinGym ZS-SUB-AUC: Zero-shot substitutions, AUC Zero-shot scoring of substitution assays, averaged over assays with the correction the paper describes. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 2, row(ESM-1v (ensemble)), column(Zero-shot substitutions, AUC) |
| Configuration: ESM-1v (ensemble) | Task: ProteinGym ZS-SUB-MCC: Zero-shot substitutions, MCC Dataset subset: ProteinGym substitution DMS assays (ProteinGym split) | 0.32 mcc correlation · higher Uncertainty: Not reported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceESM-1v (ensemble) on ProteinGym ZS-SUB-MCC: Zero-shot substitutions, MCC Zero-shot scoring of substitution assays, averaged over assays with the correction the paper describes. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 2, row(ESM-1v (ensemble)), column(Zero-shot substitutions, MCC) |
| Configuration: ESM-1v (ensemble) | Task: ProteinGym ZS-SUB-NDCG: Zero-shot substitutions, NDCG@10% Dataset subset: ProteinGym substitution DMS assays (ProteinGym split) | 0.749 ndcg fraction · higher Uncertainty: Not reported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceESM-1v (ensemble) on ProteinGym ZS-SUB-NDCG: Zero-shot substitutions, NDCG@10% Zero-shot scoring of substitution assays, averaged over assays with the correction the paper describes. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 2, row(ESM-1v (ensemble)), column(Zero-shot substitutions, NDCG@10%) |
| Configuration: ESM-1v (ensemble) | Task: ProteinGym ZS-SUB-RECALL: Zero-shot substitutions, top 10% recall Dataset subset: ProteinGym substitution DMS assays (ProteinGym split) | 0.211 recall fraction · higher Uncertainty: Not reported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceESM-1v (ensemble) on ProteinGym ZS-SUB-RECALL: Zero-shot substitutions, top 10% recall Zero-shot scoring of substitution assays, averaged over assays with the correction the paper describes. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 2, row(ESM-1v (ensemble)), column(Zero-shot substitutions, top 10% recall) |
| Configuration: ESM-1v (ensemble) | Task: ProteinGym ZS-SUB-SPEARMAN: Zero-shot substitutions, Spearman Dataset subset: ProteinGym substitution DMS assays (ProteinGym split) | 0.407 spearman correlation · higher Uncertainty: Not reported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceESM-1v (ensemble) on ProteinGym ZS-SUB-SPEARMAN: Zero-shot substitutions, Spearman Zero-shot scoring of substitution assays, averaged over assays with the correction the paper describes. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 2, row(ESM-1v (ensemble)), column(Zero-shot substitutions, Spearman) |
Source checking is not independent reproduction. Release 2026-09-29-06401fd5b220.
These configurations, services and pipelines use this model within their own configurations. Their results, where available, are not assigned to the underlying model.
ESM-1v provides protein language models intended for zero-shot variant-effect scoring. Transformer architecture shared with ESM-1b, trained on UniRef90; multiple released model instances support the variant-scoring workflow. The documented inputs are protein amino-acid sequence and the specified sequence variation. The output consists of token probabilities used to calculate sequence-variant scores.
esm1v_t33_650M_UR90S_1 through _5. The applicable input limits require configuration-specific checking.
Inspected pinned official documentation, relevant implementation files and named primary-paper sections. Claims are limited to those artifacts. Remaining field extraction and identity conflicts are explicit; no new performance claims, model runs or human review are implied.
Stable record: discovery-model-esm-1vExplanatory profile: limited source coverage · Automated source review, 2026-09-16. Review applies to the cited claims; unresolved fields are listed below. Numerical results retain their own review status.
| Property | Description and evidence |
|---|---|
| Model type | Protein transformer for variant-effect scoringSources (2)facebookresearch/esm: README.md; facebook/esm1v_t33_650M_UR90S_1: config.json · README.md: Main models, Zero-shot variant prediction and Pre-trained Models |
| Architecture | Transformer architecture shared with ESM-1b, trained on UniRef90; multiple released model instances support the variant-scoring workflow.Sources (2)facebookresearch/esm: README.md; facebook/esm1v_t33_650M_UR90S_1: config.json · README.md: Main models, Zero-shot variant prediction and Pre-trained Models |
| Inputs | Protein amino-acid sequence and the specified sequence variation.Sources (2)facebookresearch/esm: README.md; facebook/esm1v_t33_650M_UR90S_1: config.json · README.md: Main models, Zero-shot variant prediction and Pre-trained Models |
| Outputs | Token probabilities used to calculate sequence-variant scores.Sources (2)facebookresearch/esm: README.md; facebook/esm1v_t33_650M_UR90S_1: config.json · README.md: Main models, Zero-shot variant prediction and Pre-trained Models |
| Parameters | 650 million per model; 33 transformer layers.Sources (2)facebookresearch/esm: README.md; facebook/esm1v_t33_650M_UR90S_1: config.json · README.md: Main models, Zero-shot variant prediction and Pre-trained Models |
| Known versions | esm1v_t33_650M_UR90S_1 through _5.Sources (2)facebookresearch/esm: README.md; facebook/esm1v_t33_650M_UR90S_1: config.json · README.md: Main models, Zero-shot variant prediction and Pre-trained Models |
| Training data | UniRef90/S 2020_03, as reported in the pretrained-model table.Sources (2)facebookresearch/esm: README.md; facebook/esm1v_t33_650M_UR90S_1: config.json · README.md: Main models, Zero-shot variant prediction and Pre-trained Models |
| Training cutoff | The official model table identifies the UniRef90/S2020_03 training release; this is a corpus version rather than a verified latest-sequence deposition date.Sources (2)facebookresearch/esm: README.md; facebook/esm1v_t33_650M_UR90S_1: config.json · README.md: Main models, Zero-shot variant prediction and Pre-trained Models |
| Context limits | The inspected official esm1v_t33_650M_UR90S_1 config reserves 1,026 absolute positions. This includes model positions and is not a claim of 1,026-residue validated biological context.Sources (2)facebookresearch/esm: README.md; facebook/esm1v_t33_650M_UR90S_1: config.json · README.md: Main models, Zero-shot variant prediction and Pre-trained Models |
| Weights licence | Separate checkpoint-distribution terms are not stated in the inspected release documentation and licence material. The source-code licence alone is not recorded as an explicit weight grant. · Not reported in inspected sourcesSources (3)facebookresearch/esm: README.md; facebook/esm1v_t33_650M_UR90S_1: config.json; facebookresearch/esm: LICENSE · README.md: Main models, Zero-shot variant prediction and Pre-trained Models; LICENSE: licence text |
| Access | Official project documentation and implementation: https://github.com/facebookresearch/esmSources (2)facebookresearch/esm: README.md; facebook/esm1v_t33_650M_UR90S_1: config.json · README.md: Main models, Zero-shot variant prediction and Pre-trained Models |
| Code licence | MITSourcesfacebookresearch/esm: LICENSE · LICENSE: licence text |
Applicability is distinct from a completed evaluation.
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
40 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| Diagram caption Conceptual summary of the documented data flow; optional inputs and configured downstream stages must be reported for a reproducible evaluation. Individual claims | facebook/esm1v_t33_650M_UR90S_1: config.json README.md: Main models, Zero-shot variant prediction and Pre-trained Models Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 8bfdb1892536cc77bd0760b9c25ddced2cd0b4c8 | source checked automated source review · 2026-09-16 Audit detailsInspected pinned official documentation, relevant implementation files and named primary-paper sections. Claims are limited to those artifacts. Remaining field extraction and identity conflicts are explicit; no new performance claims, model runs or human review are implied. Field: Source artifact SHA-256: Hash scope: SHA-256 of retrieved original artifact bytes Format: original_artifact |
| Diagram caption Conceptual summary of the documented data flow; optional inputs and configured downstream stages must be reported for a reproducible evaluation. Individual claims | facebookresearch/esm: README.md README.md: Main models, Zero-shot variant prediction and Pre-trained Models Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 2b369911bb5b4b0dda914521b9475cad1656b2ac | source checked automated source review · 2026-09-16 Audit detailsInspected pinned official documentation, relevant implementation files and named primary-paper sections. Claims are limited to those artifacts. Remaining field extraction and identity conflicts are explicit; no new performance claims, model runs or human review are implied. Field: Source artifact SHA-256: Hash scope: SHA-256 of retrieved original artifact bytes Format: original_artifact |
Diagram steps
| facebook/esm1v_t33_650M_UR90S_1: config.json README.md: Main models, Zero-shot variant prediction and Pre-trained Models Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 8bfdb1892536cc77bd0760b9c25ddced2cd0b4c8 | source checked automated source review · 2026-09-16 Audit detailsInspected pinned official documentation, relevant implementation files and named primary-paper sections. Claims are limited to those artifacts. Remaining field extraction and identity conflicts are explicit; no new performance claims, model runs or human review are implied. Field: Source artifact SHA-256: Hash scope: SHA-256 of retrieved original artifact bytes Format: original_artifact |
Diagram steps
| facebookresearch/esm: README.md README.md: Main models, Zero-shot variant prediction and Pre-trained Models Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 2b369911bb5b4b0dda914521b9475cad1656b2ac | source checked automated source review · 2026-09-16 Audit detailsInspected pinned official documentation, relevant implementation files and named primary-paper sections. Claims are limited to those artifacts. Remaining field extraction and identity conflicts are explicit; no new performance claims, model runs or human review are implied. Field: Source artifact SHA-256: Hash scope: SHA-256 of retrieved original artifact bytes Format: original_artifact |
| Diagram title ESM-1v workflow Individual claims | facebook/esm1v_t33_650M_UR90S_1: config.json README.md: Main models, Zero-shot variant prediction and Pre-trained Models Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 8bfdb1892536cc77bd0760b9c25ddced2cd0b4c8 | source checked automated source review · 2026-09-16 Audit detailsInspected pinned official documentation, relevant implementation files and named primary-paper sections. Claims are limited to those artifacts. Remaining field extraction and identity conflicts are explicit; no new performance claims, model runs or human review are implied. Field: Source artifact SHA-256: Hash scope: SHA-256 of retrieved original artifact bytes Format: original_artifact |
| Diagram title ESM-1v workflow Individual claims | facebookresearch/esm: README.md README.md: Main models, Zero-shot variant prediction and Pre-trained Models Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 2b369911bb5b4b0dda914521b9475cad1656b2ac | source checked automated source review · 2026-09-16 Audit detailsInspected pinned official documentation, relevant implementation files and named primary-paper sections. Claims are limited to those artifacts. Remaining field extraction and identity conflicts are explicit; no new performance claims, model runs or human review are implied. Field: Source artifact SHA-256: Hash scope: SHA-256 of retrieved original artifact bytes Format: original_artifact |
| Model type Protein transformer for variant-effect scoring Individual claims | facebook/esm1v_t33_650M_UR90S_1: config.json README.md: Main models, Zero-shot variant prediction and Pre-trained Models Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 8bfdb1892536cc77bd0760b9c25ddced2cd0b4c8 | source checked automated source review · 2026-09-16 Audit detailsInspected pinned official documentation, relevant implementation files and named primary-paper sections. Claims are limited to those artifacts. Remaining field extraction and identity conflicts are explicit; no new performance claims, model runs or human review are implied. Field: Source artifact SHA-256: Hash scope: SHA-256 of retrieved original artifact bytes Format: original_artifact |
| Model type Protein transformer for variant-effect scoring Individual claims | facebookresearch/esm: README.md README.md: Main models, Zero-shot variant prediction and Pre-trained Models Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 2b369911bb5b4b0dda914521b9475cad1656b2ac | source checked automated source review · 2026-09-16 Audit detailsInspected pinned official documentation, relevant implementation files and named primary-paper sections. Claims are limited to those artifacts. Remaining field extraction and identity conflicts are explicit; no new performance claims, model runs or human review are implied. Field: Source artifact SHA-256: Hash scope: SHA-256 of retrieved original artifact bytes Format: original_artifact |
| Architecture Transformer architecture shared with ESM-1b, trained on UniRef90; multiple released model instances support the variant-scoring workflow. Individual claims | facebook/esm1v_t33_650M_UR90S_1: config.json README.md: Main models, Zero-shot variant prediction and Pre-trained Models Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 8bfdb1892536cc77bd0760b9c25ddced2cd0b4c8 | source checked automated source review · 2026-09-16 Audit detailsInspected pinned official documentation, relevant implementation files and named primary-paper sections. Claims are limited to those artifacts. Remaining field extraction and identity conflicts are explicit; no new performance claims, model runs or human review are implied. Field: Source artifact SHA-256: Hash scope: SHA-256 of retrieved original artifact bytes Format: original_artifact |
| Architecture Transformer architecture shared with ESM-1b, trained on UniRef90; multiple released model instances support the variant-scoring workflow. Individual claims | facebookresearch/esm: README.md README.md: Main models, Zero-shot variant prediction and Pre-trained Models Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 2b369911bb5b4b0dda914521b9475cad1656b2ac | source checked automated source review · 2026-09-16 Audit detailsInspected pinned official documentation, relevant implementation files and named primary-paper sections. Claims are limited to those artifacts. Remaining field extraction and identity conflicts are explicit; no new performance claims, model runs or human review are implied. Field: Source artifact SHA-256: Hash scope: SHA-256 of retrieved original artifact bytes Format: original_artifact |
View linked audit checks and correction history
Release 2026-09-29-06401fd5b220 · Record review: discovered
Stable ID: discovery-model-esm-1v