rewirebio.iobenchmarks
Configuration

ESM-2 650M, the mean over residue embeddings, not fine-tuned (PRIME)

ESM-2 650M representations taken as the mean over residue embeddings, frozen, with the PRIME supervised head.

8 evaluations · 8 results

Overview

An explanatory profile has not yet been reviewed for this record.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Evaluations and results

8 evaluations · 8 results. Different protocols are not a single leaderboard.

Dataset: SARS-CoV-2 RBD mutant binding and expression measurements

Sorted by R² (ACE2 binding; Position-stratified split holding out whole mutated positions; the mean over residue embeddings, frozen) (higher is better). The best value in each column is highlighted. Decimals are rounded for display; each value links to the printed value and its source.

Tested configurationProtocol and datasetR² (ACE2 binding; Position-stratified split holding out whole mutated positions; the mean over residue embeddings, frozen)R² (ACE2 binding; Random split over RBD mutants; the mean over residue embeddings, frozen)R² (RBD expression; Position-stratified split holding out whole mutated positions; the mean over residue embeddings, frozen)R² (RBD expression; Random split over RBD mutants; the mean over residue embeddings, frozen)RMSE (ACE2 binding; Position-stratified split holding out whole mutated positions; the mean over residue embeddings, frozen)RMSE (ACE2 binding; Random split over RBD mutants; the mean over residue embeddings, frozen)RMSE (RBD expression; Position-stratified split holding out whole mutated positions; the mean over residue embeddings, frozen)RMSE (RBD expression; Random split over RBD mutants; the mean over residue embeddings, frozen)
ESM-2 650M, the mean over residue embeddings, not fine-tuned (PRIME)EvaluationPRIME ACE2 binding regression, Position-stratified split holding out whole mutated positions, R²-0.0865 ± 0.04Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ESM-2 650M, the mean over residue embeddings, not fine-tuned (PRIME)EvaluationPRIME ACE2 binding regression, Position-stratified split holding out whole mutated positions, RMSENot reportedNot reportedNot reportedNot reported1.8488 ± 0.03Not reportedNot reportedNot reported
ESM-2 650M, the mean over residue embeddings, not fine-tuned (PRIME)EvaluationPRIME RBD expression regression, Position-stratified split holding out whole mutated positions, R²Not reportedNot reported-0.0103 ± 0.03Not reportedNot reportedNot reportedNot reportedNot reported
ESM-2 650M, the mean over residue embeddings, not fine-tuned (PRIME)EvaluationPRIME RBD expression regression, Position-stratified split holding out whole mutated positions, RMSENot reportedNot reportedNot reportedNot reportedNot reportedNot reported1.0807 ± 0.01Not reported
ESM-2 650M, the mean over residue embeddings, not fine-tuned (PRIME)EvaluationPRIME ACE2 binding regression, Random split over RBD mutants, R²Not reported0.7981 ± 0.13Not reportedNot reportedNot reportedNot reportedNot reportedNot reported
ESM-2 650M, the mean over residue embeddings, not fine-tuned (PRIME)EvaluationPRIME ACE2 binding regression, Random split over RBD mutants, RMSENot reportedNot reportedNot reportedNot reportedNot reported0.8091 ± 0.28Not reportedNot reported
ESM-2 650M, the mean over residue embeddings, not fine-tuned (PRIME)EvaluationPRIME RBD expression regression, Random split over RBD mutants, R²Not reportedNot reportedNot reported0.7337 ± 0.15Not reportedNot reportedNot reportedNot reported
ESM-2 650M, the mean over residue embeddings, not fine-tuned (PRIME)EvaluationPRIME RBD expression regression, Random split over RBD mutants, RMSENot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.4942 ± 0.14
All 8 result rows with coverage, uncertainty and sources
Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: ESM-2 650M, the mean over residue embeddings, not fine-tuned (PRIME)Protocol: PRIME ACE2 binding regression, Position-stratified split holding out whole mutated positions, R²
Dataset: SARS-CoV-2 RBD mutant binding and expression measurements
-0.0865 ± 0.04 R² (ACE2 binding; Position-stratified split holding out whole mutated positions; the mean over residue embeddings, frozen)
unitless · higher

Uncertainty: SD 0.04

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-2 650M Mean frozen: ACE2 binding R², Position-stratified split holding out whole mutated positions

lit-protein-20261011-prime-protocol-position-stratified-binding-r2

Aggregation: Not reported

PRIME: An evaluation framework for protein representation inference and generalization in viral mutation space · Table 1, row 'ESM-2 650M' / 'Mean' / '×', columns 'Position-Stratified Split' / 'Binding' / 'R²'
Configuration: ESM-2 650M, the mean over residue embeddings, not fine-tuned (PRIME)Protocol: PRIME ACE2 binding regression, Position-stratified split holding out whole mutated positions, RMSE
Dataset: SARS-CoV-2 RBD mutant binding and expression measurements
1.8488 ± 0.03 RMSE (ACE2 binding; Position-stratified split holding out whole mutated positions; the mean over residue embeddings, frozen)
unit-unreported · lower

Uncertainty: SD 0.03

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-2 650M Mean frozen: ACE2 binding RMSE, Position-stratified split holding out whole mutated positions

lit-protein-20261011-prime-protocol-position-stratified-binding-rmse

Aggregation: Not reported

PRIME: An evaluation framework for protein representation inference and generalization in viral mutation space · Table 1, row 'ESM-2 650M' / 'Mean' / '×', columns 'Position-Stratified Split' / 'Binding' / 'RMSE'
Configuration: ESM-2 650M, the mean over residue embeddings, not fine-tuned (PRIME)Protocol: PRIME RBD expression regression, Position-stratified split holding out whole mutated positions, R²
Dataset: SARS-CoV-2 RBD mutant binding and expression measurements
-0.0103 ± 0.03 R² (RBD expression; Position-stratified split holding out whole mutated positions; the mean over residue embeddings, frozen)
unitless · higher

Uncertainty: SD 0.03

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-2 650M Mean frozen: RBD expression R², Position-stratified split holding out whole mutated positions

lit-protein-20261011-prime-protocol-position-stratified-expression-r2

Aggregation: Not reported

PRIME: An evaluation framework for protein representation inference and generalization in viral mutation space · Table 1, row 'ESM-2 650M' / 'Mean' / '×', columns 'Position-Stratified Split' / 'Expression' / 'R²'
Configuration: ESM-2 650M, the mean over residue embeddings, not fine-tuned (PRIME)Protocol: PRIME RBD expression regression, Position-stratified split holding out whole mutated positions, RMSE
Dataset: SARS-CoV-2 RBD mutant binding and expression measurements
1.0807 ± 0.01 RMSE (RBD expression; Position-stratified split holding out whole mutated positions; the mean over residue embeddings, frozen)
unit-unreported · lower

Uncertainty: SD 0.01

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-2 650M Mean frozen: RBD expression RMSE, Position-stratified split holding out whole mutated positions

lit-protein-20261011-prime-protocol-position-stratified-expression-rmse

Aggregation: Not reported

PRIME: An evaluation framework for protein representation inference and generalization in viral mutation space · Table 1, row 'ESM-2 650M' / 'Mean' / '×', columns 'Position-Stratified Split' / 'Expression' / 'RMSE'
Configuration: ESM-2 650M, the mean over residue embeddings, not fine-tuned (PRIME)Protocol: PRIME ACE2 binding regression, Random split over RBD mutants, R²
Dataset: SARS-CoV-2 RBD mutant binding and expression measurements
0.7981 ± 0.13 R² (ACE2 binding; Random split over RBD mutants; the mean over residue embeddings, frozen)
unitless · higher

Uncertainty: SD 0.13

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-2 650M Mean frozen: ACE2 binding R², Random split over RBD mutants

lit-protein-20261011-prime-protocol-random-binding-r2

Aggregation: Not reported

PRIME: An evaluation framework for protein representation inference and generalization in viral mutation space · Table 1, row 'ESM-2 650M' / 'Mean' / '×', columns 'Random Split' / 'Binding' / 'R²'
Configuration: ESM-2 650M, the mean over residue embeddings, not fine-tuned (PRIME)Protocol: PRIME ACE2 binding regression, Random split over RBD mutants, RMSE
Dataset: SARS-CoV-2 RBD mutant binding and expression measurements
0.8091 ± 0.28 RMSE (ACE2 binding; Random split over RBD mutants; the mean over residue embeddings, frozen)
unit-unreported · lower

Uncertainty: SD 0.28

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-2 650M Mean frozen: ACE2 binding RMSE, Random split over RBD mutants

lit-protein-20261011-prime-protocol-random-binding-rmse

Aggregation: Not reported

PRIME: An evaluation framework for protein representation inference and generalization in viral mutation space · Table 1, row 'ESM-2 650M' / 'Mean' / '×', columns 'Random Split' / 'Binding' / 'RMSE'
Configuration: ESM-2 650M, the mean over residue embeddings, not fine-tuned (PRIME)Protocol: PRIME RBD expression regression, Random split over RBD mutants, R²
Dataset: SARS-CoV-2 RBD mutant binding and expression measurements
0.7337 ± 0.15 R² (RBD expression; Random split over RBD mutants; the mean over residue embeddings, frozen)
unitless · higher

Uncertainty: SD 0.15

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-2 650M Mean frozen: RBD expression R², Random split over RBD mutants

lit-protein-20261011-prime-protocol-random-expression-r2

Aggregation: Not reported

PRIME: An evaluation framework for protein representation inference and generalization in viral mutation space · Table 1, row 'ESM-2 650M' / 'Mean' / '×', columns 'Random Split' / 'Expression' / 'R²'
Configuration: ESM-2 650M, the mean over residue embeddings, not fine-tuned (PRIME)Protocol: PRIME RBD expression regression, Random split over RBD mutants, RMSE
Dataset: SARS-CoV-2 RBD mutant binding and expression measurements
0.4942 ± 0.14 RMSE (RBD expression; Random split over RBD mutants; the mean over residue embeddings, frozen)
unit-unreported · lower

Uncertainty: SD 0.14

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-2 650M Mean frozen: RBD expression RMSE, Random split over RBD mutants

lit-protein-20261011-prime-protocol-random-expression-rmse

Aggregation: Not reported

PRIME: An evaluation framework for protein representation inference and generalization in viral mutation space · Table 1, row 'ESM-2 650M' / 'Mean' / '×', columns 'Random Split' / 'Expression' / 'RMSE'

Source checking is not independent reproduction. Release 2026-10-22-1b7cf027e4f6.

Use this configuration

How it works, versions and access
Strengths, limitations and unresolved questions

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-10-22-1b7cf027e4f6
Property and statementOriginal source and locationReview and provenance

No evidence rows match these filters. Choose another scope or clear the search.

Sources and history

Release 2026-10-22-1b7cf027e4f6 · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: lit-protein-20261011-prime-config-esm-2-650m-mean-frozen

areas
protein-function
contexts
research
method types
foundation_model
reported name
ESM-2 650M
version
ESM-2 650M
representation
the mean over residue embeddings
training setting
None; frozen representations
foundation model eligible
true
source locator
Table 1, row 'ESM-2 650M' / 'Mean' / '×'
Related records

Suggest a correction