rewirebio.iobenchmarks
Configuration

ESM-1b (HyPLM report)

Runs the public ESM-1b checkpoint in BF16 through Hugging Face Transformers to produce embeddings, probe features and masked-language-model scores.

32 evaluations · 32 results13 open disagreements between studies involve its model

Overview

An explanatory profile has not yet been reviewed for this record.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Model Capabilities & Hardware Requirements

Deployment facts recorded for ESM-1b (HyPLM report). Fields the record does not carry are marked not recorded.

ParametersNot recorded
Minimum VRAMNot recorded
Inference LatencyNot recorded
Context WindowNot recorded
AccessNot recorded
LicenseNot recorded

Evaluated Checkpoint: Public ESM-1b checkpoint; no revision printed

Evaluations and results

32 evaluations · 32 results. Different protocols are not a single leaderboard.

Sorted by Accuracy (Binary localisation accuracy on DeepLoc 1.0 via PEER) (higher is better). The best value in each column is highlighted. Decimals are rounded for display; each value links to the printed value and its source.

Tested configurationProtocol and datasetAccuracy (Binary localisation accuracy on DeepLoc 1.0 via PEER)Accuracy (Fold-level classification accuracy on the TAPE remote-homology (SCOP) test set)Accuracy (Human protein-protein interaction classification accuracy on PEER HumanPPI, with pair features [a, b, a*b, |a-b|])Accuracy (Metal-ion binding classification accuracy on the split packaged by SaProt)Accuracy (Ten-class subcellular localisation accuracy on DeepLoc 1.0 via PEER)Accuracy (Three-state (Q3) per-residue secondary-structure accuracy on the CB513 test set)F1 max (Protein-centric Fmax over Enzyme Commission numbers on the DeepFRI EC split)F1 max (Protein-centric Fmax over Enzyme Commission numbers on the SaProt EC split)F1 max (Protein-centric Fmax over Gene Ontology biological-process terms on the DeepFRI GO split as packaged by SaProt)F1 max (Protein-centric Fmax over Gene Ontology cellular-component terms on the DeepFRI GO split as packaged by SaProt)F1 max (Protein-centric Fmax over Gene Ontology molecular-function terms on the DeepFRI GO split as packaged by SaProt)Log loss (Mean negative log-likelihood of masked residues in nats on the report's held-out UniRef panel, identical masks and crops for every model)Log loss (Mean negative log-likelihood of masked residues in nats on the report's recent-PDB panel, identical masks and crops for every model)Macro F1 (Macro-averaged F1 of Enzyme Commission classification on DGEB, with the layer and regularisation chosen by 5-fold cross-validation on the training split because this task has no validation split)Mean average precision at 5 (Zero-shot retrieval mean average precision at 5 on DGEB Arch, ranked by cosine similarity between mean-pooled representations)Precision at l 5 (Long-range contact precision of the top L/5 predictions (sequence separation at least 24) on 82 CASP14 evaluation domains)Precision at l 5 (Long-range contact precision of the top L/5 predictions (sequence separation at least 24) on 95 CASP15 evaluation domains)Precision at l 5 (Long-range contact precision of the top L/5 predictions (sequence separation at least 24) on the ProteinNet CASP12 test set of 40 proteins)Spearman (Spearman correlation averaged over the 217 substitution assays of ProteinGym v1.3 with the benchmark's official aggregation, from masked-marginal zero-shot scores; per-assay values rounded to three decimals before aggregation)Spearman (Spearman correlation on the FLIP AAV low-vs-high split)Spearman (Spearman correlation on the FLIP AAV two-vs-many split)Spearman (Spearman correlation on the FLIP GB1 low-vs-high split)Spearman (Spearman correlation on the FLIP GB1 three-vs-rest split)Spearman (Spearman correlation on the FLIP GB1 two-vs-rest split)Spearman (Spearman correlation on the FLIP Meltome human-cell split)Spearman (Spearman correlation on the FLIP Meltome mixed split)Spearman (Spearman correlation on the FLIP2 amylase one-to-many split)Spearman (Spearman correlation on the FLIP2 amylase split partitioned by mutation count)Spearman (Spearman correlation on the FLIP2 cross-protein hydrolase split, training on other hydrolases and testing on P06241)Spearman (Spearman correlation on the Meltome human-cell split as packaged by SaProt, which the report lists separately from its own FLIP Meltome human-cell row)Spearman (Spearman correlation on the TAPE fluorescence regression split)Spearman (Spearman correlation on the TAPE stability regression split)
ESM-1b (HyPLM report)EvaluationLocalization, binary (HyPLM report), DeepLoc binary localisation via PEER (HyPLM report)0.922Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ESM-1b (HyPLM report)EvaluationAAV low-vs-high (HyPLM report), FLIP AAV, low-vs-high split (FLIP split)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.28Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ESM-1b (HyPLM report)EvaluationAAV two-vs-many (HyPLM report), FLIP AAV, 2-vs-rest split (FLIP split)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.544Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ESM-1b (HyPLM report)EvaluationAmylase by mutation count (HyPLM report), Amylase by mutation count (FLIP2, HyPLM report)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.503Not reportedNot reportedNot reportedNot reported
ESM-1b (HyPLM report)EvaluationAmylase one-to-many (HyPLM report), Amylase one-to-many (FLIP2, HyPLM report)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.653Not reportedNot reportedNot reportedNot reportedNot reported
ESM-1b (HyPLM report)EvaluationArch retrieval (DGEB) (HyPLM report), DGEB Arch retrieval (HyPLM report)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.206Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ESM-1b (HyPLM report)EvaluationContacts, CASP14 (HyPLM report), CASP14 evaluation domains (82, HyPLM report)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.322Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ESM-1b (HyPLM report)EvaluationContacts, CASP15 (HyPLM report), CASP15 evaluation domains (95, HyPLM report)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.404Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ESM-1b (HyPLM report)EvaluationContacts, ProteinNet (HyPLM report), ProteinNet CASP12Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.41Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ESM-1b (HyPLM report)EvaluationEC classification (DGEB) (HyPLM report), DGEB EC classification (HyPLM report)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.673Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ESM-1b (HyPLM report)EvaluationEC, DeepFRI split (HyPLM report), EC annotation, DeepFRI split (HyPLM report)Not reportedNot reportedNot reportedNot reportedNot reportedNot reported0.878Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ESM-1b (HyPLM report)EvaluationEC, SaProt split (HyPLM report), EC annotation, SaProt split (HyPLM report)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.889Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ESM-1b (HyPLM report)EvaluationFluorescence (HyPLM report), Fluorescence (TAPE)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.659Not reported
ESM-1b (HyPLM report)EvaluationGB1 low-vs-high (HyPLM report), FLIP GB1, low-vs-high split (FLIP split)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.417Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ESM-1b (HyPLM report)EvaluationGB1 three-vs-rest (HyPLM report), FLIP GB1, 3-vs-rest split (FLIP split)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.807Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ESM-1b (HyPLM report)EvaluationGB1 two-vs-rest (HyPLM report), FLIP GB1, 2-vs-rest split (FLIP split)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.615Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ESM-1b (HyPLM report)EvaluationGO-BP (HyPLM report), GO biological process, DeepFRI split via SaProt (HyPLM report)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.485Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ESM-1b (HyPLM report)EvaluationGO-CC (HyPLM report), GO cellular component, DeepFRI split via SaProt (HyPLM report)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.52Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ESM-1b (HyPLM report)EvaluationGO-MF (HyPLM report), GO molecular function, DeepFRI split via SaProt (HyPLM report)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.659Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ESM-1b (HyPLM report)EvaluationHumanPPI (HyPLM report), HumanPPI via PEER (HyPLM report)Not reportedNot reported0.867Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ESM-1b (HyPLM report)EvaluationHydrolase to P06241 (HyPLM report), Hydrolase to P06241 (FLIP2 cross-protein, HyPLM report)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported−0.224Not reportedNot reportedNot reported
ESM-1b (HyPLM report)EvaluationLocalization, 10-class (HyPLM report), DeepLoc ten-class localisation via PEER (HyPLM report)Not reportedNot reportedNot reportedNot reported0.793Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ESM-1b (HyPLM report)EvaluationMeltome human cell (HyPLM report), FLIP Thermostability, Human-Cell split (FLIP split)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.698Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ESM-1b (HyPLM report)EvaluationMeltome mixed (HyPLM report), FLIP Thermostability, Mixed split (FLIP split)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.593Not reportedNot reportedNot reportedNot reportedNot reportedNot reported
ESM-1b (HyPLM report)EvaluationMetal-ion binding (HyPLM report), Metal-ion binding, SaProt packaging (HyPLM report)Not reportedNot reportedNot reported0.69Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ESM-1b (HyPLM report)EvaluationNLL, held-out UniRef panel (HyPLM report), Held-out UniRef panel (479 proteins, HyPLM report)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported1.86Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ESM-1b (HyPLM report)EvaluationNLL, recent PDB chains (HyPLM report), Recent PDB chains (887, HyPLM report)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported1.5Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ESM-1b (HyPLM report)EvaluationProteinGym zero-shot (HyPLM report), ProteinGym DMS substitution assays at commit 144fe22 (217 assays)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.389Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ESM-1b (HyPLM report)EvaluationRemote homology (fold) (HyPLM report), Fold classification (TAPE)Not reported0.362Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ESM-1b (HyPLM report)EvaluationSecondary structure (CB513) (HyPLM report), Secondary structure prediction (TAPE)Not reportedNot reportedNot reportedNot reportedNot reported0.814Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ESM-1b (HyPLM report)EvaluationStability (HyPLM report), Stability (TAPE, HyPLM report)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.596
ESM-1b (HyPLM report)EvaluationThermostability (HyPLM report), Thermostability, Meltome human cell via SaProt (HyPLM report)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.699Not reportedNot reported
All 32 result rows with coverage, uncertainty and sources
Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: ESM-1b (HyPLM report)Protocol: AAV low-vs-high (HyPLM report)
Dataset subset: FLIP AAV, low-vs-high split (FLIP split)
0.28 Spearman (Spearman correlation on the FLIP AAV low-vs-high split)
unitless · higher

Uncertainty: Not reported by the source: Section 4 says intervals are paired bootstrap intervals; none is printed here.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-1b on aav-low-vs-high (HyPLM report)

hyplm-flash-20261106-protocol-aav-low-vs-high

Aggregation: Not reported

HyPLM Technical Report (Hyra Team, 2026-10-12) · Table 6, row 'AAV low-vs-high', column 'ESM-1b' (page 12 of 13)
Configuration: ESM-1b (HyPLM report)Protocol: AAV two-vs-many (HyPLM report)
Dataset subset: FLIP AAV, 2-vs-rest split (FLIP split)
0.544 Spearman (Spearman correlation on the FLIP AAV two-vs-many split)
unitless · higher

Uncertainty: Not reported by the source: Section 4 says intervals are paired bootstrap intervals; none is printed here.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-1b on aav-two-vs-many (HyPLM report)

hyplm-flash-20261106-protocol-aav-two-vs-many

Aggregation: Not reported

HyPLM Technical Report (Hyra Team, 2026-10-12) · Table 6, row 'AAV two-vs-many', column 'ESM-1b' (page 12 of 13)
Configuration: ESM-1b (HyPLM report)Protocol: Amylase by mutation count (HyPLM report)
Dataset: Amylase by mutation count (FLIP2, HyPLM report)
0.503 Spearman (Spearman correlation on the FLIP2 amylase split partitioned by mutation count)
unitless · higher

Uncertainty: Not reported by the source: Section 4 says intervals are paired bootstrap intervals; none is printed here.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-1b on amylase-by-mutation-count (HyPLM report)

hyplm-flash-20261106-protocol-amylase-by-mutation-count

Aggregation: Not reported

HyPLM Technical Report (Hyra Team, 2026-10-12) · Table 6, row 'Amylase by mutation count', column 'ESM-1b' (page 12 of 13)
Configuration: ESM-1b (HyPLM report)Protocol: Amylase one-to-many (HyPLM report)
Dataset: Amylase one-to-many (FLIP2, HyPLM report)
0.653 Spearman (Spearman correlation on the FLIP2 amylase one-to-many split)
unitless · higher

Uncertainty: Not reported by the source: Section 4 says intervals are paired bootstrap intervals; none is printed here.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-1b on amylase-one-to-many (HyPLM report)

hyplm-flash-20261106-protocol-amylase-one-to-many

Aggregation: Not reported

HyPLM Technical Report (Hyra Team, 2026-10-12) · Table 6, row 'Amylase one-to-many', column 'ESM-1b' (page 12 of 13)
Configuration: ESM-1b (HyPLM report)Protocol: Arch retrieval (DGEB) (HyPLM report)
Dataset: DGEB Arch retrieval (HyPLM report)
0.206 Mean average precision at 5 (Zero-shot retrieval mean average precision at 5 on DGEB Arch, ranked by cosine similarity between mean-pooled representations)
fraction · higher

Uncertainty: Not reported by the source: Section 4 says intervals are paired bootstrap intervals; none is printed here.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-1b on arch-retrieval-dgeb (HyPLM report)

hyplm-flash-20261106-protocol-arch-retrieval-dgeb

Aggregation: Not reported

HyPLM Technical Report (Hyra Team, 2026-10-12) · Table 6, row 'Arch retrieval (DGEB)', column 'ESM-1b' (page 12 of 13)
Configuration: ESM-1b (HyPLM report)Protocol: Contacts, CASP14 (HyPLM report)
Dataset: CASP14 evaluation domains (82, HyPLM report)
0.322 Precision at l 5 (Long-range contact precision of the top L/5 predictions (sequence separation at least 24) on 82 CASP14 evaluation domains)
fraction · higher

Uncertainty: Not reported by the source: Section 4 says intervals are paired bootstrap intervals; none is printed here.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-1b on contacts-casp14 (HyPLM report)

hyplm-flash-20261106-protocol-contacts-casp14

Aggregation: Not reported

HyPLM Technical Report (Hyra Team, 2026-10-12) · Table 6, row 'Contacts, CASP14', column 'ESM-1b' (page 12 of 13)
Configuration: ESM-1b (HyPLM report)Protocol: Contacts, CASP15 (HyPLM report)
Dataset: CASP15 evaluation domains (95, HyPLM report)
0.404 Precision at l 5 (Long-range contact precision of the top L/5 predictions (sequence separation at least 24) on 95 CASP15 evaluation domains)
fraction · higher

Uncertainty: Not reported by the source: Section 4 says intervals are paired bootstrap intervals; none is printed here.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-1b on contacts-casp15 (HyPLM report)

hyplm-flash-20261106-protocol-contacts-casp15

Aggregation: Not reported

HyPLM Technical Report (Hyra Team, 2026-10-12) · Table 6, row 'Contacts, CASP15', column 'ESM-1b' (page 12 of 13)
Configuration: ESM-1b (HyPLM report)Protocol: Contacts, ProteinNet (HyPLM report)
Dataset: ProteinNet CASP12
0.41 Precision at l 5 (Long-range contact precision of the top L/5 predictions (sequence separation at least 24) on the ProteinNet CASP12 test set of 40 proteins)
fraction · higher

Uncertainty: Not reported by the source: Section 4 says intervals are paired bootstrap intervals; none is printed here.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-1b on contacts-proteinnet (HyPLM report)

hyplm-flash-20261106-protocol-contacts-proteinnet

Aggregation: Not reported

HyPLM Technical Report (Hyra Team, 2026-10-12) · Table 6, row 'Contacts, ProteinNet', column 'ESM-1b' (page 12 of 13)
Configuration: ESM-1b (HyPLM report)Protocol: EC classification (DGEB) (HyPLM report)
Dataset: DGEB EC classification (HyPLM report)
0.673 Macro F1 (Macro-averaged F1 of Enzyme Commission classification on DGEB, with the layer and regularisation chosen by 5-fold cross-validation on the training split because this task has no validation split)
fraction · higher

Uncertainty: Not reported by the source: Section 4 says intervals are paired bootstrap intervals; none is printed here.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-1b on ec-classification-dgeb (HyPLM report)

hyplm-flash-20261106-protocol-ec-classification-dgeb

Aggregation: Not reported

HyPLM Technical Report (Hyra Team, 2026-10-12) · Table 6, row 'EC classification (DGEB)', column 'ESM-1b' (page 12 of 13)
Configuration: ESM-1b (HyPLM report)Protocol: EC, DeepFRI split (HyPLM report)
Dataset: EC annotation, DeepFRI split (HyPLM report)
0.878 F1 max (Protein-centric Fmax over Enzyme Commission numbers on the DeepFRI EC split)
fraction · higher

Uncertainty: Not reported by the source: Section 4 says intervals are paired bootstrap intervals; none is printed here.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-1b on ec-deepfri-split (HyPLM report)

hyplm-flash-20261106-protocol-ec-deepfri-split

Aggregation: Not reported

HyPLM Technical Report (Hyra Team, 2026-10-12) · Table 6, row 'EC, DeepFRI split', column 'ESM-1b' (page 12 of 13)
Configuration: ESM-1b (HyPLM report)Protocol: EC, SaProt split (HyPLM report)
Dataset: EC annotation, SaProt split (HyPLM report)
0.889 F1 max (Protein-centric Fmax over Enzyme Commission numbers on the SaProt EC split)
fraction · higher

Uncertainty: Not reported by the source: Section 4 says intervals are paired bootstrap intervals; none is printed here.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-1b on ec-saprot-split (HyPLM report)

hyplm-flash-20261106-protocol-ec-saprot-split

Aggregation: Not reported

HyPLM Technical Report (Hyra Team, 2026-10-12) · Table 6, row 'EC, SaProt split', column 'ESM-1b' (page 12 of 13)
Configuration: ESM-1b (HyPLM report)Protocol: Fluorescence (HyPLM report)
Dataset: Fluorescence (TAPE)
0.659 Spearman (Spearman correlation on the TAPE fluorescence regression split)
unitless · higher

Uncertainty: Not reported by the source: Section 4 says intervals are paired bootstrap intervals; none is printed here.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-1b on fluorescence (HyPLM report)

hyplm-flash-20261106-protocol-fluorescence

Aggregation: Not reported

HyPLM Technical Report (Hyra Team, 2026-10-12) · Table 6, row 'Fluorescence', column 'ESM-1b' (page 12 of 13)
Configuration: ESM-1b (HyPLM report)Protocol: GB1 low-vs-high (HyPLM report)
Dataset subset: FLIP GB1, low-vs-high split (FLIP split)
0.417 Spearman (Spearman correlation on the FLIP GB1 low-vs-high split)
unitless · higher

Uncertainty: Not reported by the source: Section 4 says intervals are paired bootstrap intervals; none is printed here.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-1b on gb1-low-vs-high (HyPLM report)

hyplm-flash-20261106-protocol-gb1-low-vs-high

Aggregation: Not reported

HyPLM Technical Report (Hyra Team, 2026-10-12) · Table 6, row 'GB1 low-vs-high', column 'ESM-1b' (page 12 of 13)
Configuration: ESM-1b (HyPLM report)Protocol: GB1 three-vs-rest (HyPLM report)
Dataset subset: FLIP GB1, 3-vs-rest split (FLIP split)
0.807 Spearman (Spearman correlation on the FLIP GB1 three-vs-rest split)
unitless · higher

Uncertainty: Not reported by the source: Section 4 says intervals are paired bootstrap intervals; none is printed here.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-1b on gb1-three-vs-rest (HyPLM report)

hyplm-flash-20261106-protocol-gb1-three-vs-rest

Aggregation: Not reported

HyPLM Technical Report (Hyra Team, 2026-10-12) · Table 6, row 'GB1 three-vs-rest', column 'ESM-1b' (page 12 of 13)
Configuration: ESM-1b (HyPLM report)Protocol: GB1 two-vs-rest (HyPLM report)
Dataset subset: FLIP GB1, 2-vs-rest split (FLIP split)
0.615 Spearman (Spearman correlation on the FLIP GB1 two-vs-rest split)
unitless · higher

Uncertainty: Not reported by the source: Section 4 says intervals are paired bootstrap intervals; none is printed here.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-1b on gb1-two-vs-rest (HyPLM report)

hyplm-flash-20261106-protocol-gb1-two-vs-rest

Aggregation: Not reported

HyPLM Technical Report (Hyra Team, 2026-10-12) · Table 6, row 'GB1 two-vs-rest', column 'ESM-1b' (page 12 of 13)
Configuration: ESM-1b (HyPLM report)Protocol: GO-BP (HyPLM report)
Dataset: GO biological process, DeepFRI split via SaProt (HyPLM report)
0.485 F1 max (Protein-centric Fmax over Gene Ontology biological-process terms on the DeepFRI GO split as packaged by SaProt)
fraction · higher

Uncertainty: Not reported by the source: Section 4 says intervals are paired bootstrap intervals; none is printed here.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-1b on go-bp (HyPLM report)

hyplm-flash-20261106-protocol-go-bp

Aggregation: Not reported

HyPLM Technical Report (Hyra Team, 2026-10-12) · Table 6, row 'GO-BP', column 'ESM-1b' (page 12 of 13)
Configuration: ESM-1b (HyPLM report)Protocol: GO-CC (HyPLM report)
Dataset: GO cellular component, DeepFRI split via SaProt (HyPLM report)
0.52 F1 max (Protein-centric Fmax over Gene Ontology cellular-component terms on the DeepFRI GO split as packaged by SaProt)
fraction · higher

Uncertainty: Not reported by the source: Section 4 says intervals are paired bootstrap intervals; none is printed here.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-1b on go-cc (HyPLM report)

hyplm-flash-20261106-protocol-go-cc

Aggregation: Not reported

HyPLM Technical Report (Hyra Team, 2026-10-12) · Table 6, row 'GO-CC', column 'ESM-1b' (page 12 of 13)
Configuration: ESM-1b (HyPLM report)Protocol: GO-MF (HyPLM report)
Dataset: GO molecular function, DeepFRI split via SaProt (HyPLM report)
0.659 F1 max (Protein-centric Fmax over Gene Ontology molecular-function terms on the DeepFRI GO split as packaged by SaProt)
fraction · higher

Uncertainty: Not reported by the source: Section 4 says intervals are paired bootstrap intervals; none is printed here.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-1b on go-mf (HyPLM report)

hyplm-flash-20261106-protocol-go-mf

Aggregation: Not reported

HyPLM Technical Report (Hyra Team, 2026-10-12) · Table 6, row 'GO-MF', column 'ESM-1b' (page 12 of 13)
Configuration: ESM-1b (HyPLM report)Protocol: HumanPPI (HyPLM report)
Dataset: HumanPPI via PEER (HyPLM report)
0.867 Accuracy (Human protein-protein interaction classification accuracy on PEER HumanPPI, with pair features [a, b, a*b, |a-b|])
fraction · higher

Uncertainty: Not reported by the source: Section 4 says intervals are paired bootstrap intervals; none is printed here.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-1b on humanppi (HyPLM report)

hyplm-flash-20261106-protocol-humanppi

Aggregation: Not reported

HyPLM Technical Report (Hyra Team, 2026-10-12) · Table 6, row 'HumanPPI', column 'ESM-1b' (page 12 of 13)
Configuration: ESM-1b (HyPLM report)Protocol: Hydrolase to P06241 (HyPLM report)
Dataset: Hydrolase to P06241 (FLIP2 cross-protein, HyPLM report)
−0.224 Spearman (Spearman correlation on the FLIP2 cross-protein hydrolase split, training on other hydrolases and testing on P06241)
unitless · higher

Uncertainty: Not reported by the source: Section 4 says intervals are paired bootstrap intervals; none is printed here.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-1b on hydrolase-to-p06241 (HyPLM report)

hyplm-flash-20261106-protocol-hydrolase-to-p06241

Aggregation: Not reported

HyPLM Technical Report (Hyra Team, 2026-10-12) · Table 6, row 'Hydrolase to P06241', column 'ESM-1b' (page 12 of 13)
Configuration: ESM-1b (HyPLM report)Protocol: Localization, 10-class (HyPLM report)
Dataset: DeepLoc ten-class localisation via PEER (HyPLM report)
0.793 Accuracy (Ten-class subcellular localisation accuracy on DeepLoc 1.0 via PEER)
fraction · higher

Uncertainty: Not reported by the source: Section 4 says intervals are paired bootstrap intervals; none is printed here.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-1b on localization-10-class (HyPLM report)

hyplm-flash-20261106-protocol-localization-10-class

Aggregation: Not reported

HyPLM Technical Report (Hyra Team, 2026-10-12) · Table 6, row 'Localization, 10-class', column 'ESM-1b' (page 12 of 13)
Configuration: ESM-1b (HyPLM report)Protocol: Localization, binary (HyPLM report)
Dataset: DeepLoc binary localisation via PEER (HyPLM report)
0.922 Accuracy (Binary localisation accuracy on DeepLoc 1.0 via PEER)
fraction · higher

Uncertainty: Not reported by the source: Section 4 says intervals are paired bootstrap intervals; none is printed here.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-1b on localization-binary (HyPLM report)

hyplm-flash-20261106-protocol-localization-binary

Aggregation: Not reported

HyPLM Technical Report (Hyra Team, 2026-10-12) · Table 6, row 'Localization, binary', column 'ESM-1b' (page 12 of 13)
Configuration: ESM-1b (HyPLM report)Protocol: Meltome human cell (HyPLM report)
Dataset subset: FLIP Thermostability, Human-Cell split (FLIP split)
0.698 Spearman (Spearman correlation on the FLIP Meltome human-cell split)
unitless · higher

Uncertainty: Not reported by the source: Section 4 says intervals are paired bootstrap intervals; none is printed here.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-1b on meltome-human-cell (HyPLM report)

hyplm-flash-20261106-protocol-meltome-human-cell

Aggregation: Not reported

HyPLM Technical Report (Hyra Team, 2026-10-12) · Table 6, row 'Meltome human cell', column 'ESM-1b' (page 12 of 13)
Configuration: ESM-1b (HyPLM report)Protocol: Meltome mixed (HyPLM report)
Dataset subset: FLIP Thermostability, Mixed split (FLIP split)
0.593 Spearman (Spearman correlation on the FLIP Meltome mixed split)
unitless · higher

Uncertainty: Not reported by the source: Section 4 says intervals are paired bootstrap intervals; none is printed here.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-1b on meltome-mixed (HyPLM report)

hyplm-flash-20261106-protocol-meltome-mixed

Aggregation: Not reported

HyPLM Technical Report (Hyra Team, 2026-10-12) · Table 6, row 'Meltome mixed', column 'ESM-1b' (page 12 of 13)
Configuration: ESM-1b (HyPLM report)Protocol: Metal-ion binding (HyPLM report)
Dataset: Metal-ion binding, SaProt packaging (HyPLM report)
0.69 Accuracy (Metal-ion binding classification accuracy on the split packaged by SaProt)
fraction · higher

Uncertainty: Not reported by the source: Section 4 says intervals are paired bootstrap intervals; none is printed here.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-1b on metal-ion-binding (HyPLM report)

hyplm-flash-20261106-protocol-metal-ion-binding

Aggregation: Not reported

HyPLM Technical Report (Hyra Team, 2026-10-12) · Table 6, row 'Metal-ion binding', column 'ESM-1b' (page 12 of 13)

Source checking is not independent reproduction. Release 2026-11-21-adc15377fab2.

Use this configuration

How it works, versions and access

Additional methodological details, versions and access terms have not yet been extracted into a structured profile for this configuration. Consult the linked sources and evaluation records below.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-adc15377fab2
Property and statementOriginal source and locationReview and provenance

No evidence rows match these filters. Choose another scope or clear the search.

Sources and history

Release 2026-11-21-adc15377fab2 · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and record identifiers

Technical metadata for this record is tracked under stable ID hyplm-flash-20261106-config-esm-1b.

Source locator: Appendix A 'Models' and 'Deviations'; Section 4

Related records

How to cite

ESM-1b (HyPLM report). Rewire biological model benchmark database, release 2026-11-21-adc15377fab2. https://benchmarks.rewirebio.io/database/configuration/hyplm-flash-20261106-config-esm-1b/

Release 2026-11-21-adc15377fab2. Rankings and values change between releases, so keep the release id in the citation. Cite the original publication as well for any value you reuse: each result links its source.

The compilation and annotations made by Rewire in this release are offered under CC BY 4.0; values and text taken from cited sources stay under the terms of those sources and are not covered by this licence. Data licence

Suggest a correction