rewirebio.iobenchmarks
Source

flip primary benchmark evidence

2021 manuscript

Original source

What this source contributed

Records in this release that cite this source. A record can cite several sources.

Results

Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.

Model or configurationMetricValueDatasetEvaluation
BLOSUM62Spearman0.15 unitlessFLIP GB1, 1-vs-rest split (FLIP split)BLOSUM62 on FLIP GB1-1-VS-REST: GB1 fitness prediction, 1-vs-rest split
BLOSUM62Spearman0.14 unitlessFLIP GB1, 2-vs-rest split (FLIP split)BLOSUM62 on FLIP GB1-2-VS-REST: GB1 fitness prediction, 2-vs-rest split
BLOSUM62Spearman0.01 unitlessFLIP GB1, 3-vs-rest split (FLIP split)BLOSUM62 on FLIP GB1-3-VS-REST: GB1 fitness prediction, 3-vs-rest split
BLOSUM62Spearman-0.13 unitlessFLIP GB1, low-vs-high split (FLIP split)BLOSUM62 on FLIP GB1-LOW-VS-HIGH: GB1 fitness prediction, low-vs-high split
CNNSpearman0.48 unitlessFLIP AAV, 1-vs-rest split (FLIP split)CNN on FLIP AAV-1-VS-REST: AAV fitness prediction, 1-vs-rest split
CNNSpearman0.74 unitlessFLIP AAV, 2-vs-rest split (FLIP split)CNN on FLIP AAV-2-VS-REST: AAV fitness prediction, 2-vs-rest split
CNNSpearman0.74 unitlessFLIP AAV, 7-vs-rest split (FLIP split)CNN on FLIP AAV-7-VS-REST: AAV fitness prediction, 7-vs-rest split
CNNSpearman0.75 unitlessFLIP AAV, Des-Mut split (FLIP split)CNN on FLIP AAV-DES-MUT: AAV fitness prediction, Des-Mut split
CNNSpearman0.34 unitlessFLIP AAV, low-vs-high split (FLIP split)CNN on FLIP AAV-LOW-VS-HIGH: AAV fitness prediction, low-vs-high split
CNNSpearman0.71 unitlessFLIP AAV, Mut-Des split (FLIP split)CNN on FLIP AAV-MUT-DES: AAV fitness prediction, Mut-Des split
CNNSpearman0.17 unitlessFLIP GB1, 1-vs-rest split (FLIP split)CNN on FLIP GB1-1-VS-REST: GB1 fitness prediction, 1-vs-rest split
CNNSpearman0.32 unitlessFLIP GB1, 2-vs-rest split (FLIP split)CNN on FLIP GB1-2-VS-REST: GB1 fitness prediction, 2-vs-rest split
CNNSpearman0.83 unitlessFLIP GB1, 3-vs-rest split (FLIP split)CNN on FLIP GB1-3-VS-REST: GB1 fitness prediction, 3-vs-rest split
CNNSpearman0.51 unitlessFLIP GB1, low-vs-high split (FLIP split)CNN on FLIP GB1-LOW-VS-HIGH: GB1 fitness prediction, low-vs-high split
CNNSpearman0.92 unitlessFLIP Random sampled splits, AAV split (FLIP split)CNN on FLIP RANDOM-SAMPLED-SPLITS-AAV: Random sampled splits fitness prediction, AAV split
CNNSpearman0.91 unitlessFLIP Random sampled splits, GB1 split (FLIP split)CNN on FLIP RANDOM-SAMPLED-SPLITS-GB1: Random sampled splits fitness prediction, GB1 split
CNNSpearman0.49 unitlessFLIP Thermostability, Human-Cell split (FLIP split)CNN on FLIP THERMOSTABILITY-HUMAN-CELL: Thermostability fitness prediction, Human-Cell split
CNNSpearman0.50 unitlessFLIP Thermostability, Human split (FLIP split)CNN on FLIP THERMOSTABILITY-HUMAN: Thermostability fitness prediction, Human split
CNNSpearman0.34 unitlessFLIP Thermostability, Mixed split (FLIP split)CNN on FLIP THERMOSTABILITY-MIXED: Thermostability fitness prediction, Mixed split
ESM-1b (mean)Spearman0.04 unitlessFLIP AAV, 1-vs-rest split (FLIP split)ESM-1b (mean) on FLIP AAV-1-VS-REST: AAV fitness prediction, 1-vs-rest split
ESM-1b (mean)Spearman0.26 unitlessFLIP AAV, 2-vs-rest split (FLIP split)ESM-1b (mean) on FLIP AAV-2-VS-REST: AAV fitness prediction, 2-vs-rest split
ESM-1b (mean)Spearman0.46 unitlessFLIP AAV, 7-vs-rest split (FLIP split)ESM-1b (mean) on FLIP AAV-7-VS-REST: AAV fitness prediction, 7-vs-rest split
ESM-1b (mean)Spearman0.59 unitlessFLIP AAV, Des-Mut split (FLIP split)ESM-1b (mean) on FLIP AAV-DES-MUT: AAV fitness prediction, Des-Mut split
ESM-1b (mean)Spearman0.18 unitlessFLIP AAV, low-vs-high split (FLIP split)ESM-1b (mean) on FLIP AAV-LOW-VS-HIGH: AAV fitness prediction, low-vs-high split
ESM-1b (mean)Spearman0.63 unitlessFLIP AAV, Mut-Des split (FLIP split)ESM-1b (mean) on FLIP AAV-MUT-DES: AAV fitness prediction, Mut-Des split
ESM-1b (mean)Spearman0.32 unitlessFLIP GB1, 1-vs-rest split (FLIP split)ESM-1b (mean) on FLIP GB1-1-VS-REST: GB1 fitness prediction, 1-vs-rest split
ESM-1b (mean)Spearman0.36 unitlessFLIP GB1, 2-vs-rest split (FLIP split)ESM-1b (mean) on FLIP GB1-2-VS-REST: GB1 fitness prediction, 2-vs-rest split
ESM-1b (mean)Spearman0.54 unitlessFLIP GB1, 3-vs-rest split (FLIP split)ESM-1b (mean) on FLIP GB1-3-VS-REST: GB1 fitness prediction, 3-vs-rest split
ESM-1b (mean)Spearman0.13 unitlessFLIP GB1, low-vs-high split (FLIP split)ESM-1b (mean) on FLIP GB1-LOW-VS-HIGH: GB1 fitness prediction, low-vs-high split
ESM-1b (mean)Spearman0.75 unitlessFLIP Thermostability, Human-Cell split (FLIP split)ESM-1b (mean) on FLIP THERMOSTABILITY-HUMAN-CELL: Thermostability fitness prediction, Human-Cell split
ESM-1b (mean)Spearman0.70 unitlessFLIP Thermostability, Human split (FLIP split)ESM-1b (mean) on FLIP THERMOSTABILITY-HUMAN: Thermostability fitness prediction, Human split
ESM-1b (mean)Spearman0.68 unitlessFLIP Thermostability, Mixed split (FLIP split)ESM-1b (mean) on FLIP THERMOSTABILITY-MIXED: Thermostability fitness prediction, Mixed split
ESM-1b (mut mean)Spearman0.31 unitlessFLIP AAV, 1-vs-rest split (FLIP split)ESM-1b (mut mean) on FLIP AAV-1-VS-REST: AAV fitness prediction, 1-vs-rest split
ESM-1b (mut mean)Spearman0.65 unitlessFLIP AAV, 2-vs-rest split (FLIP split)ESM-1b (mut mean) on FLIP AAV-2-VS-REST: AAV fitness prediction, 2-vs-rest split
ESM-1b (mut mean)Spearman0.61 unitlessFLIP AAV, 7-vs-rest split (FLIP split)ESM-1b (mut mean) on FLIP AAV-7-VS-REST: AAV fitness prediction, 7-vs-rest split
ESM-1b (mut mean)Spearman0.70 unitlessFLIP AAV, Des-Mut split (FLIP split)ESM-1b (mut mean) on FLIP AAV-DES-MUT: AAV fitness prediction, Des-Mut split
ESM-1b (mut mean)Spearman0.33 unitlessFLIP AAV, low-vs-high split (FLIP split)ESM-1b (mut mean) on FLIP AAV-LOW-VS-HIGH: AAV fitness prediction, low-vs-high split
ESM-1b (mut mean)Spearman0.70 unitlessFLIP AAV, Mut-Des split (FLIP split)ESM-1b (mut mean) on FLIP AAV-MUT-DES: AAV fitness prediction, Mut-Des split
ESM-1b (mut mean)Spearman-0.08 unitlessFLIP GB1, 1-vs-rest split (FLIP split)ESM-1b (mut mean) on FLIP GB1-1-VS-REST: GB1 fitness prediction, 1-vs-rest split
ESM-1b (mut mean)Spearman0.19 unitlessFLIP GB1, 2-vs-rest split (FLIP split)ESM-1b (mut mean) on FLIP GB1-2-VS-REST: GB1 fitness prediction, 2-vs-rest split
ESM-1b (mut mean)Spearman0.49 unitlessFLIP GB1, 3-vs-rest split (FLIP split)ESM-1b (mut mean) on FLIP GB1-3-VS-REST: GB1 fitness prediction, 3-vs-rest split
ESM-1b (mut mean)Spearman0.45 unitlessFLIP GB1, low-vs-high split (FLIP split)ESM-1b (mut mean) on FLIP GB1-LOW-VS-HIGH: GB1 fitness prediction, low-vs-high split
ESM-1b (per AA)Spearman0.03 unitlessFLIP AAV, 1-vs-rest split (FLIP split)ESM-1b (per AA) on FLIP AAV-1-VS-REST: AAV fitness prediction, 1-vs-rest split
ESM-1b (per AA)Spearman0.65 unitlessFLIP AAV, 2-vs-rest split (FLIP split)ESM-1b (per AA) on FLIP AAV-2-VS-REST: AAV fitness prediction, 2-vs-rest split
ESM-1b (per AA)Spearman0.65 unitlessFLIP AAV, 7-vs-rest split (FLIP split)ESM-1b (per AA) on FLIP AAV-7-VS-REST: AAV fitness prediction, 7-vs-rest split
ESM-1b (per AA)Spearman0.39 unitlessFLIP AAV, low-vs-high split (FLIP split)ESM-1b (per AA) on FLIP AAV-LOW-VS-HIGH: AAV fitness prediction, low-vs-high split
ESM-1b (per AA)Spearman0.76 unitlessFLIP AAV, Mut-Des split (FLIP split)ESM-1b (per AA) on FLIP AAV-MUT-DES: AAV fitness prediction, Mut-Des split
ESM-1b (per AA)Spearman0.28 unitlessFLIP GB1, 1-vs-rest split (FLIP split)ESM-1b (per AA) on FLIP GB1-1-VS-REST: GB1 fitness prediction, 1-vs-rest split
ESM-1b (per AA)Spearman0.55 unitlessFLIP GB1, 2-vs-rest split (FLIP split)ESM-1b (per AA) on FLIP GB1-2-VS-REST: GB1 fitness prediction, 2-vs-rest split
ESM-1b (per AA)Spearman0.79 unitlessFLIP GB1, 3-vs-rest split (FLIP split)ESM-1b (per AA) on FLIP GB1-3-VS-REST: GB1 fitness prediction, 3-vs-rest split

Claims

Statements this source supports, each with where in the source it was checked.

Models, benchmarks and other records

Methods (4)

Configurations (9)

Benchmarks (1)

Tasks (15)

Dataset subsets (15)

Evaluations (155)

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

15 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-02-a7f03c9e55a5
Property and statementOriginal source and locationReview and provenance
Artifact SHA-256
afcf360c88a7a4ae153b3c2d8d4fa6d4ac0abe84f2131b94409abff6447ce363
Source metadata
flip primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 2021 manuscript
Retrieved: 2026-09-16T21:07:13.889041+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_sha256

Source artifact SHA-256: afcf360c88a7a4ae153b3c2d8d4fa6d4ac0abe84f2131b94409abff6447ce363

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Artifact url
https://flip.protein.properties/assets/FLIP_2021_manuscript.pdf
Source metadata
flip primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 2021 manuscript
Retrieved: 2026-09-16T21:07:13.889041+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_url

Source artifact SHA-256: afcf360c88a7a4ae153b3c2d8d4fa6d4ac0abe84f2131b94409abff6447ce363

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Hash scope
Exact retrieved primary paper artifact bytes.
Source metadata
flip primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 2021 manuscript
Retrieved: 2026-09-16T21:07:13.889041+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.hash_scope

Source artifact SHA-256: afcf360c88a7a4ae153b3c2d8d4fa6d4ac0abe84f2131b94409abff6447ce363

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Retrieved at
2026-09-16T21:07:13.889041+00:00
Source metadata
flip primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 2021 manuscript
Retrieved: 2026-09-16T21:07:13.889041+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.retrieved_at

Source artifact SHA-256: afcf360c88a7a4ae153b3c2d8d4fa6d4ac0abe84f2131b94409abff6447ce363

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Review method
1 values
  • automated-source-review
Source metadata
flip primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 2021 manuscript
Retrieved: 2026-09-16T21:07:13.889041+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.review.method

Source artifact SHA-256: afcf360c88a7a4ae153b3c2d8d4fa6d4ac0abe84f2131b94409abff6447ce363

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Review: scope
Source identification and table transcription; no independent experimental reproduction.
Source metadata
flip primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 2021 manuscript
Retrieved: 2026-09-16T21:07:13.889041+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.review.scope

Source artifact SHA-256: afcf360c88a7a4ae153b3c2d8d4fa6d4ac0abe84f2131b94409abff6447ce363

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Url
https://flip.protein.properties/assets/FLIP_2021_manuscript.pdf
Source metadata
flip primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 2021 manuscript
Retrieved: 2026-09-16T21:07:13.889041+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.url

Source artifact SHA-256: afcf360c88a7a4ae153b3c2d8d4fa6d4ac0abe84f2131b94409abff6447ce363

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Version
2021 manuscript
Source metadata
flip primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 2021 manuscript
Retrieved: 2026-09-16T21:07:13.889041+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.version

Source artifact SHA-256: afcf360c88a7a4ae153b3c2d8d4fa6d4ac0abe84f2131b94409abff6447ce363

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Description
Primary reference; inspect retrieval status and review scope.
Source metadata
flip primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 2021 manuscript
Retrieved: 2026-09-16T21:07:13.889041+00:00

catalogued

No individual claim review recorded

Audit details

Field: description

Source artifact SHA-256: afcf360c88a7a4ae153b3c2d8d4fa6d4ac0abe84f2131b94409abff6447ce363

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Search facets
None recorded
Source metadata
flip primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 2021 manuscript
Retrieved: 2026-09-16T21:07:13.889041+00:00

catalogued

No individual claim review recorded

Audit details

Field: facets

Source artifact SHA-256: afcf360c88a7a4ae153b3c2d8d4fa6d4ac0abe84f2131b94409abff6447ce363

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-02-a7f03c9e55a5 · Record review: source checked

Primary reference; inspect retrieval status and review scope.

Release history

No supporting source is linked yet.

Read original source

Download this release (gzip)
Technical metadata and extraction receipts

Stable ID: expansion-p3-flip

url
https://flip.protein.properties/assets/FLIP_2021_manuscript.pdf
version
2021 manuscript
retrieved at
2026-09-16T21:07:13.889041+00:00
artifact sha256
afcf360c88a7a4ae153b3c2d8d4fa6d4ac0abe84f2131b94409abff6447ce363
artifact url
https://flip.protein.properties/assets/FLIP_2021_manuscript.pdf
hash scope
Exact retrieved primary paper artifact bytes.
review
scope: Source identification and table transcription; no independent experimental reproduction.; method: automated-source-review
Related records

    Suggest a correction