rewire.itbenchmarks
Configuration

ESM-untrained (per AA)

Protein language model embedding with the stated pooling, fed to a supervised head by the FLIP authors.

14 evaluations · 14 results

Overview

Protein language model embedding with the stated pooling, fed to a supervised head by the FLIP authors.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Evaluations and results

14 evaluations · 14 results. Different protocols are not a single leaderboard.

Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: ESM-untrained (per AA)Task: FLIP AAV-1-VS-REST: AAV fitness prediction, 1-vs-rest split
Dataset subset: FLIP AAV, 1-vs-rest split (FLIP split)
0.18 spearman
correlation · higher

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-untrained (per AA) on FLIP AAV-1-VS-REST: AAV fitness prediction, 1-vs-rest split

Trained on the split's training set with ten percent held out for validation, scored on its test set.

Aggregation: Not reported

flip primary benchmark evidence · Table 5, row(ESM-untrained (per AA)), column(1-vs-rest)
Configuration: ESM-untrained (per AA)Task: FLIP AAV-2-VS-REST: AAV fitness prediction, 2-vs-rest split
Dataset subset: FLIP AAV, 2-vs-rest split (FLIP split)
0.22 spearman
correlation · higher

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-untrained (per AA) on FLIP AAV-2-VS-REST: AAV fitness prediction, 2-vs-rest split

Trained on the split's training set with ten percent held out for validation, scored on its test set.

Aggregation: Not reported

flip primary benchmark evidence · Table 5, row(ESM-untrained (per AA)), column(2-vs-rest)
Configuration: ESM-untrained (per AA)Task: FLIP AAV-7-VS-REST: AAV fitness prediction, 7-vs-rest split
Dataset subset: FLIP AAV, 7-vs-rest split (FLIP split)
0.42 spearman
correlation · higher

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-untrained (per AA) on FLIP AAV-7-VS-REST: AAV fitness prediction, 7-vs-rest split

Trained on the split's training set with ten percent held out for validation, scored on its test set.

Aggregation: Not reported

flip primary benchmark evidence · Table 5, row(ESM-untrained (per AA)), column(7-vs-rest)
Configuration: ESM-untrained (per AA)Task: FLIP AAV-LOW-VS-HIGH: AAV fitness prediction, low-vs-high split
Dataset subset: FLIP AAV, low-vs-high split (FLIP split)
0.08 spearman
correlation · higher

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-untrained (per AA) on FLIP AAV-LOW-VS-HIGH: AAV fitness prediction, low-vs-high split

Trained on the split's training set with ten percent held out for validation, scored on its test set.

Aggregation: Not reported

flip primary benchmark evidence · Table 5, row(ESM-untrained (per AA)), column(low-vs-high)
Configuration: ESM-untrained (per AA)Task: FLIP AAV-MUT-DES: AAV fitness prediction, Mut-Des split
Dataset subset: FLIP AAV, Mut-Des split (FLIP split)
0.56 spearman
correlation · higher

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-untrained (per AA) on FLIP AAV-MUT-DES: AAV fitness prediction, Mut-Des split

Trained on the split's training set with ten percent held out for validation, scored on its test set.

Aggregation: Not reported

flip primary benchmark evidence · Table 5, row(ESM-untrained (per AA)), column(Mut-Des)
Configuration: ESM-untrained (per AA)Task: FLIP GB1-1-VS-REST: GB1 fitness prediction, 1-vs-rest split
Dataset subset: FLIP GB1, 1-vs-rest split (FLIP split)
0.06 spearman
correlation · higher

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-untrained (per AA) on FLIP GB1-1-VS-REST: GB1 fitness prediction, 1-vs-rest split

Trained on the split's training set with ten percent held out for validation, scored on its test set.

Aggregation: Not reported

flip primary benchmark evidence · Table 4, row(ESM-untrained (per AA)), column(1-vs-rest)
Configuration: ESM-untrained (per AA)Task: FLIP GB1-2-VS-REST: GB1 fitness prediction, 2-vs-rest split
Dataset subset: FLIP GB1, 2-vs-rest split (FLIP split)
0.06 spearman
correlation · higher

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-untrained (per AA) on FLIP GB1-2-VS-REST: GB1 fitness prediction, 2-vs-rest split

Trained on the split's training set with ten percent held out for validation, scored on its test set.

Aggregation: Not reported

flip primary benchmark evidence · Table 4, row(ESM-untrained (per AA)), column(2-vs-rest)
Configuration: ESM-untrained (per AA)Task: FLIP GB1-3-VS-REST: GB1 fitness prediction, 3-vs-rest split
Dataset subset: FLIP GB1, 3-vs-rest split (FLIP split)
0.48 spearman
correlation · higher

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-untrained (per AA) on FLIP GB1-3-VS-REST: GB1 fitness prediction, 3-vs-rest split

Trained on the split's training set with ten percent held out for validation, scored on its test set.

Aggregation: Not reported

flip primary benchmark evidence · Table 4, row(ESM-untrained (per AA)), column(3-vs-rest)
Configuration: ESM-untrained (per AA)Task: FLIP GB1-LOW-VS-HIGH: GB1 fitness prediction, low-vs-high split
Dataset subset: FLIP GB1, low-vs-high split (FLIP split)
0.23 spearman
correlation · higher

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-untrained (per AA) on FLIP GB1-LOW-VS-HIGH: GB1 fitness prediction, low-vs-high split

Trained on the split's training set with ten percent held out for validation, scored on its test set.

Aggregation: Not reported

flip primary benchmark evidence · Table 4, row(ESM-untrained (per AA)), column(low-vs-high)
Configuration: ESM-untrained (per AA)Task: FLIP RANDOM-SAMPLED-SPLITS-AAV: Random sampled splits fitness prediction, AAV split
Dataset subset: FLIP Random sampled splits, AAV split (FLIP split)
0.78 spearman
correlation · higher

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-untrained (per AA) on FLIP RANDOM-SAMPLED-SPLITS-AAV: Random sampled splits fitness prediction, AAV split

Trained on the split's training set with ten percent held out for validation, scored on its test set. The authors report these separately and call them optimistic: a random split of a mutational landscape leaks close relatives between train and test.

Aggregation: Not reported

flip primary benchmark evidence · Table 7, row(ESM-untrained (per AA)), column(AAV)
Configuration: ESM-untrained (per AA)Task: FLIP RANDOM-SAMPLED-SPLITS-GB1: Random sampled splits fitness prediction, GB1 split
Dataset subset: FLIP Random sampled splits, GB1 split (FLIP split)
0.79 spearman
correlation · higher

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-untrained (per AA) on FLIP RANDOM-SAMPLED-SPLITS-GB1: Random sampled splits fitness prediction, GB1 split

Trained on the split's training set with ten percent held out for validation, scored on its test set. The authors report these separately and call them optimistic: a random split of a mutational landscape leaks close relatives between train and test.

Aggregation: Not reported

flip primary benchmark evidence · Table 7, row(ESM-untrained (per AA)), column(GB1)
Configuration: ESM-untrained (per AA)Task: FLIP THERMOSTABILITY-HUMAN-CELL: Thermostability fitness prediction, Human-Cell split
Dataset subset: FLIP Thermostability, Human-Cell split (FLIP split)
0.46 spearman
correlation · higher

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-untrained (per AA) on FLIP THERMOSTABILITY-HUMAN-CELL: Thermostability fitness prediction, Human-Cell split

Trained on the split's training set with ten percent held out for validation, scored on its test set.

Aggregation: Not reported

flip primary benchmark evidence · Table 6, row(ESM-untrained (per AA)), column(Human-Cell)
Configuration: ESM-untrained (per AA)Task: FLIP THERMOSTABILITY-HUMAN: Thermostability fitness prediction, Human split
Dataset subset: FLIP Thermostability, Human split (FLIP split)
0.44 spearman
correlation · higher

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-untrained (per AA) on FLIP THERMOSTABILITY-HUMAN: Thermostability fitness prediction, Human split

Trained on the split's training set with ten percent held out for validation, scored on its test set.

Aggregation: Not reported

flip primary benchmark evidence · Table 6, row(ESM-untrained (per AA)), column(Human)
Configuration: ESM-untrained (per AA)Task: FLIP THERMOSTABILITY-MIXED: Thermostability fitness prediction, Mixed split
Dataset subset: FLIP Thermostability, Mixed split (FLIP split)
0.44 spearman
correlation · higher

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ESM-untrained (per AA) on FLIP THERMOSTABILITY-MIXED: Thermostability fitness prediction, Mixed split

Trained on the split's training set with ten percent held out for validation, scored on its test set.

Aggregation: Not reported

flip primary benchmark evidence · Table 6, row(ESM-untrained (per AA)), column(Mixed)

Source checking is not independent reproduction. Release 2026-09-29-06401fd5b220.

Use this model

How it works, versions and access
Strengths, limitations and unresolved questions

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-09-29-06401fd5b220
Property and statementOriginal source and locationReview and provenance

No evidence rows match these filters. Choose another scope or clear the search.

Sources and history

View linked audit checks and correction history

Release 2026-09-29-06401fd5b220 · Record review: source checked

1 source records and release historyDownload this release
Technical metadata and extraction receipts

Stable ID: flip-method-esm-untrained-per-aa

areas
proteins-complexes
source locator
Table 4, row(ESM-untrained (per AA))
missing metadata
checkpoint revision: unreported; parameters: unextracted
Related records

Suggest a correction