rewirebio.iobenchmarks
Source

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications

Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256

Original source

What this source contributed

Records in this release that cite this source. A record can cite several sources.

Results

Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.

Model or configurationMetricValueDatasetEvaluation
CARP-640M likelihoodNDCG (cutoff not stated)0.906 unitlessAmylaseCARP-640M likelihood · FLIP2 Amylase by-mutation; held-out test set · Amylase
CARP-640M likelihoodSpearman0.468 unitlessAmylaseCARP-640M likelihood · FLIP2 Amylase by-mutation; held-out test set · Amylase
CARP-640M likelihoodNDCG (cutoff not stated)0.945 unitlessAmylaseCARP-640M likelihood · FLIP2 Amylase close-to-far; held-out test set · Amylase
CARP-640M likelihoodSpearman0.543 unitlessAmylaseCARP-640M likelihood · FLIP2 Amylase close-to-far; held-out test set · Amylase
CARP-640M likelihoodNDCG (cutoff not stated)0.919 unitlessAmylaseCARP-640M likelihood · FLIP2 Amylase far-to-close; held-out test set · Amylase
CARP-640M likelihoodSpearman0.566 unitlessAmylaseCARP-640M likelihood · FLIP2 Amylase far-to-close; held-out test set · Amylase
CARP-640M likelihoodNDCG (cutoff not stated)0.931 unitlessAmylaseCARP-640M likelihood · FLIP2 Amylase one-to-many; held-out test set · Amylase
CARP-640M likelihoodSpearman0.513 unitlessAmylaseCARP-640M likelihood · FLIP2 Amylase one-to-many; held-out test set · Amylase
CARP-640M likelihoodNDCG (cutoff not stated)0.921 unitlesshydroCARP-640M likelihood · FLIP2 hydro low-to-high; held-out test set · hydro
CARP-640M likelihoodSpearman0.284 unitlesshydroCARP-640M likelihood · FLIP2 hydro low-to-high; held-out test set · hydro
CARP-640M likelihoodNDCG (cutoff not stated)0.963 unitlesshydroCARP-640M likelihood · FLIP2 hydro three-to-many; held-out test set · hydro
CARP-640M likelihoodSpearman0.165 unitlesshydroCARP-640M likelihood · FLIP2 hydro three-to-many; held-out test set · hydro
CARP-640M likelihoodNDCG (cutoff not stated)0.967 unitlesshydroCARP-640M likelihood · FLIP2 hydro to-P0A9X9; held-out test set · hydro
CARP-640M likelihoodSpearman−0.032 unitlesshydroCARP-640M likelihood · FLIP2 hydro to-P0A9X9; held-out test set · hydro
CARP-640M likelihoodNDCG (cutoff not stated)0.948 unitlesshydroCARP-640M likelihood · FLIP2 hydro to-P01053; held-out test set · hydro
CARP-640M likelihoodNDCG (cutoff not stated)0.957 unitlesshydroCARP-640M likelihood · FLIP2 hydro to-P06241; held-out test set · hydro
CARP-640M likelihoodSpearman0.393 unitlesshydroCARP-640M likelihood · FLIP2 hydro to-P06241; held-out test set · hydro
CARP-640M likelihoodNDCG (cutoff not stated)0.956 unitlessIREDCARP-640M likelihood · FLIP2 IRED two-to-many; held-out test set · IRED
CARP-640M likelihoodSpearman0.144 unitlessIREDCARP-640M likelihood · FLIP2 IRED two-to-many; held-out test set · IRED
CARP-640M likelihoodNDCG (cutoff not stated)0.889 unitlessNucBCARP-640M likelihood · FLIP2 NucB two-to-many; held-out test set · NucB
CARP-640M likelihoodSpearman0.188 unitlessNucBCARP-640M likelihood · FLIP2 NucB two-to-many; held-out test set · NucB
CARP-640M likelihoodNDCG (cutoff not stated)0.863 unitlessPDZ3CARP-640M likelihood · FLIP2 PDZ3 single-to-double; held-out test set · PDZ3
CARP-640M likelihoodSpearman0.043 unitlessPDZ3CARP-640M likelihood · FLIP2 PDZ3 single-to-double; held-out test set · PDZ3
CARP-640M likelihoodNDCG (cutoff not stated)0.937 unitlessrhomaxCARP-640M likelihood · FLIP2 rhomax by-wild-type; held-out test set · rhomax
CARP-640M likelihoodSpearman0.379 unitlessrhomaxCARP-640M likelihood · FLIP2 rhomax by-wild-type; held-out test set · rhomax
CARP-640M likelihoodNDCG (cutoff not stated)0.988 unitlessTrpBCARP-640M likelihood · FLIP2 TrpB by-position; held-out test set · TrpB
CARP-640M likelihoodSpearman0.252 unitlessTrpBCARP-640M likelihood · FLIP2 TrpB by-position; held-out test set · TrpB
CARP-640M likelihoodNDCG (cutoff not stated)0.992 unitlessTrpBCARP-640M likelihood · FLIP2 TrpB one-to-many; held-out test set · TrpB
CARP-640M likelihoodSpearman0.418 unitlessTrpBCARP-640M likelihood · FLIP2 TrpB one-to-many; held-out test set · TrpB
CARP-640M likelihoodNDCG (cutoff not stated)0.992 unitlessTrpBCARP-640M likelihood · FLIP2 TrpB two-to-many; held-out test set · TrpB
CARP-640M likelihoodSpearman0.417 unitlessTrpBCARP-640M likelihood · FLIP2 TrpB two-to-many; held-out test set · TrpB
CARP-640M naive supervisedNDCG (cutoff not stated)0.819 ± 0.029 unitlessAmylaseCARP-640M naive supervised · FLIP2 Amylase by-mutation; held-out test set · Amylase
CARP-640M naive supervisedSpearman0.109 ± 0.134 unitlessAmylaseCARP-640M naive supervised · FLIP2 Amylase by-mutation; held-out test set · Amylase
CARP-640M naive supervisedNDCG (cutoff not stated)0.864 ± 0.016 unitlessAmylaseCARP-640M naive supervised · FLIP2 Amylase close-to-far; held-out test set · Amylase
CARP-640M naive supervisedSpearman0.006 ± 0.117 unitlessAmylaseCARP-640M naive supervised · FLIP2 Amylase close-to-far; held-out test set · Amylase
CARP-640M naive supervisedNDCG (cutoff not stated)0.825 ± 0.009 unitlessAmylaseCARP-640M naive supervised · FLIP2 Amylase far-to-close; held-out test set · Amylase
CARP-640M naive supervisedSpearman−0.019 ± 0.057 unitlessAmylaseCARP-640M naive supervised · FLIP2 Amylase far-to-close; held-out test set · Amylase
CARP-640M naive supervisedNDCG (cutoff not stated)0.863 ± 0.023 unitlessAmylaseCARP-640M naive supervised · FLIP2 Amylase one-to-many; held-out test set · Amylase
CARP-640M naive supervisedSpearman0.087 ± 0.172 unitlessAmylaseCARP-640M naive supervised · FLIP2 Amylase one-to-many; held-out test set · Amylase
CARP-640M naive supervisedNDCG (cutoff not stated)0.896 ± 0.032 unitlesshydroCARP-640M naive supervised · FLIP2 hydro low-to-high; held-out test set · hydro
CARP-640M naive supervisedSpearman0.188 ± 0.202 unitlesshydroCARP-640M naive supervised · FLIP2 hydro low-to-high; held-out test set · hydro
CARP-640M naive supervisedNDCG (cutoff not stated)0.984 ± 0.001 unitlesshydroCARP-640M naive supervised · FLIP2 hydro three-to-many; held-out test set · hydro
CARP-640M naive supervisedSpearman0.604 ± 0.035 unitlesshydroCARP-640M naive supervised · FLIP2 hydro three-to-many; held-out test set · hydro
CARP-640M naive supervisedNDCG (cutoff not stated)0.960 ± 0.002 unitlesshydroCARP-640M naive supervised · FLIP2 hydro to-P0A9X9; held-out test set · hydro
CARP-640M naive supervisedSpearman−0.029 ± 0.074 unitlesshydroCARP-640M naive supervised · FLIP2 hydro to-P0A9X9; held-out test set · hydro
CARP-640M naive supervisedNDCG (cutoff not stated)0.907 ± 0.009 unitlesshydroCARP-640M naive supervised · FLIP2 hydro to-P01053; held-out test set · hydro
CARP-640M naive supervisedSpearman0.061 ± 0.094 unitlesshydroCARP-640M naive supervised · FLIP2 hydro to-P01053; held-out test set · hydro
CARP-640M naive supervisedNDCG (cutoff not stated)0.927 ± 0.006 unitlesshydroCARP-640M naive supervised · FLIP2 hydro to-P06241; held-out test set · hydro
CARP-640M naive supervisedSpearman0.006 ± 0.137 unitlesshydroCARP-640M naive supervised · FLIP2 hydro to-P06241; held-out test set · hydro
CARP-640M naive supervisedNDCG (cutoff not stated)0.944 ± 0.001 unitlessIREDCARP-640M naive supervised · FLIP2 IRED two-to-many; held-out test set · IRED

Claims

Statements this source supports, each with where in the source it was checked.

Models, benchmarks and other records

Configurations (9)

Benchmarks (1)

Protocols (16)

Dataset subsets (7)

Evaluations (144)

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

15 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Artifact SHA-256
d0e61ca27863c023adddcc225a3e4af1718f2e3fdfe3642bef89c24c93621a17
Source metadata
FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications

Original source ↗

No field-specific location recorded

Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256
Retrieved: 2026-09-17T08:06:28.183348+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_sha256

Source artifact SHA-256: d0e61ca27863c023adddcc225a3e4af1718f2e3fdfe3642bef89c24c93621a17

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Artifact url
https://flip.protein.properties/assets/FLIP_manuscipt.pdf
Source metadata
FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications

Original source ↗

No field-specific location recorded

Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256
Retrieved: 2026-09-17T08:06:28.183348+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_url

Source artifact SHA-256: d0e61ca27863c023adddcc225a3e4af1718f2e3fdfe3642bef89c24c93621a17

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Hash scope
Exact retrieved primary paper artifact bytes.
Source metadata
FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications

Original source ↗

No field-specific location recorded

Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256
Retrieved: 2026-09-17T08:06:28.183348+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.hash_scope

Source artifact SHA-256: d0e61ca27863c023adddcc225a3e4af1718f2e3fdfe3642bef89c24c93621a17

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Retrieved at
2026-09-17T08:06:28.183348+00:00
Source metadata
FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications

Original source ↗

No field-specific location recorded

Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256
Retrieved: 2026-09-17T08:06:28.183348+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.retrieved_at

Source artifact SHA-256: d0e61ca27863c023adddcc225a3e4af1718f2e3fdfe3642bef89c24c93621a17

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Review method
1 values
  • automated-source-review
Source metadata
FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications

Original source ↗

No field-specific location recorded

Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256
Retrieved: 2026-09-17T08:06:28.183348+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.review.method

Source artifact SHA-256: d0e61ca27863c023adddcc225a3e4af1718f2e3fdfe3642bef89c24c93621a17

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Review: scope
Source identification and table transcription; no independent experimental reproduction.
Source metadata
FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications

Original source ↗

No field-specific location recorded

Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256
Retrieved: 2026-09-17T08:06:28.183348+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.review.scope

Source artifact SHA-256: d0e61ca27863c023adddcc225a3e4af1718f2e3fdfe3642bef89c24c93621a17

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Url
https://flip.protein.properties/assets/FLIP_manuscipt.pdf
Source metadata
FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications

Original source ↗

No field-specific location recorded

Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256
Retrieved: 2026-09-17T08:06:28.183348+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.url

Source artifact SHA-256: d0e61ca27863c023adddcc225a3e4af1718f2e3fdfe3642bef89c24c93621a17

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Version
Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256
Source metadata
FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications

Original source ↗

No field-specific location recorded

Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256
Retrieved: 2026-09-17T08:06:28.183348+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.version

Source artifact SHA-256: d0e61ca27863c023adddcc225a3e4af1718f2e3fdfe3642bef89c24c93621a17

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Description
Primary reference; inspect retrieval status and review scope.
Source metadata
FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications

Original source ↗

No field-specific location recorded

Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256
Retrieved: 2026-09-17T08:06:28.183348+00:00

catalogued

No individual claim review recorded

Audit details

Field: description

Source artifact SHA-256: d0e61ca27863c023adddcc225a3e4af1718f2e3fdfe3642bef89c24c93621a17

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Search facets
None recorded
Source metadata
FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications

Original source ↗

No field-specific location recorded

Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256
Retrieved: 2026-09-17T08:06:28.183348+00:00

catalogued

No individual claim review recorded

Audit details

Field: facets

Source artifact SHA-256: d0e61ca27863c023adddcc225a3e4af1718f2e3fdfe3642bef89c24c93621a17

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

Primary reference; inspect retrieval status and review scope.

Release history

No supporting source is linked yet.

Read original source

Download this release (gzip)
Technical metadata and extraction receipts

Stable ID: evidence-expansion-flip2-d0e61ca2

url
https://flip.protein.properties/assets/FLIP_manuscipt.pdf
version
Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256
retrieved at
2026-09-17T08:06:28.183348+00:00
artifact sha256
d0e61ca27863c023adddcc225a3e4af1718f2e3fdfe3642bef89c24c93621a17
artifact url
https://flip.protein.properties/assets/FLIP_manuscipt.pdf
hash scope
Exact retrieved primary paper artifact bytes.
review
scope: Source identification and table transcription; no independent experimental reproduction.; method: automated-source-review
Related records

    Suggest a correction