rewirebio.iobenchmarks
Configuration

CARP-640M supervised

Entry in FLIP2, identified only by its entry label; the model or method behind it is not identified.

16 evaluations · 30 results

Overview

An explanatory profile has not yet been reviewed for this record.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Evaluations and results

16 evaluations · 30 results. Different protocols are not a single leaderboard.

Sorted by NDCG (cutoff not stated) (higher is better). The best value in each column is highlighted. Decimals are rounded for display; each value links to the printed value and its source.

Tested configurationProtocol and datasetNDCG (cutoff not stated)Spearman
CARP-640M supervisedEvaluationFLIP2 TrpB two-to-many; held-out test set · TrpB, TrpB0.996 ± 0.000 (best in column)0.509 ± 0.010
CARP-640M supervisedEvaluationFLIP2 TrpB one-to-many; held-out test set · TrpB, TrpB0.992 ± 0.002Not reported
CARP-640M supervisedEvaluationFLIP2 TrpB by-position; held-out test set · TrpB, TrpB0.983 ± 0.0030.167 ± 0.018
CARP-640M supervisedEvaluationFLIP2 hydro three-to-many; held-out test set · hydro, hydro0.982 ± 0.0020.516 ± 0.035
CARP-640M supervisedEvaluationFLIP2 NucB two-to-many; held-out test set · NucB, NucB0.970 ± 0.0010.717 ± 0.012 (best in column)
CARP-640M supervisedEvaluationFLIP2 hydro to-P0A9X9; held-out test set · hydro, hydro0.961 ± 0.0040.004 ± 0.103
CARP-640M supervisedEvaluationFLIP2 IRED two-to-many; held-out test set · IRED, IRED0.948 ± 0.0040.072 ± 0.046
CARP-640M supervisedEvaluationFLIP2 rhomax by-wild-type; held-out test set · rhomax, rhomax0.934 ± 0.029Not reported
CARP-640M supervisedEvaluationFLIP2 hydro to-P06241; held-out test set · hydro, hydro0.933 ± 0.0080.150 ± 0.046
CARP-640M supervisedEvaluationFLIP2 Amylase by-mutation; held-out test set · Amylase, Amylase0.926 ± 0.0500.551 ± 0.239
CARP-640M supervisedEvaluationFLIP2 hydro to-P01053; held-out test set · hydro, hydro0.909 ± 0.0080.049 ± 0.088
CARP-640M supervisedEvaluationFLIP2 hydro low-to-high; held-out test set · hydro, hydro0.887 ± 0.0070.188 ± 0.071
CARP-640M supervisedEvaluationFLIP2 PDZ3 single-to-double; held-out test set · PDZ3, PDZ30.882 ± 0.0150.512 ± 0.014
CARP-640M supervisedEvaluationFLIP2 Amylase one-to-many; held-out test set · Amylase, Amylase0.873 ± 0.0290.242 ± 0.153
CARP-640M supervisedEvaluationFLIP2 Amylase close-to-far; held-out test set · Amylase, Amylase0.867 ± 0.0150.081 ± 0.055
CARP-640M supervisedEvaluationFLIP2 Amylase far-to-close; held-out test set · Amylase, Amylase0.832 ± 0.0190.140 ± 0.102
All 30 result rows with coverage, uncertainty and sources
Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: CARP-640M supervisedProtocol: FLIP2 hydro to-P0A9X9; held-out test set · hydro
Dataset subset: hydro
0.961 ± 0.004 NDCG (cutoff not stated)
unitless · higher

Uncertainty: ± 0.004 (type not stated)

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M supervised · FLIP2 hydro to-P0A9X9; held-out test set · hydro

FLIP2 hydro to-P0A9X9; held-out test set

Aggregation: mean of five random-seed fits (Section 4.3)

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A13; row CARP-640M supervised; column ndcg
Configuration: CARP-640M supervisedProtocol: FLIP2 Amylase by-mutation; held-out test set · Amylase
Dataset subset: Amylase
0.926 ± 0.050 NDCG (cutoff not stated)
unitless · higher

Uncertainty: ± 0.05 (type not stated)

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M supervised · FLIP2 Amylase by-mutation; held-out test set · Amylase

FLIP2 Amylase by-mutation; held-out test set

Aggregation: mean of five random-seed fits (Section 4.3)

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A4; row CARP-640M supervised; column ndcg
Configuration: CARP-640M supervisedProtocol: FLIP2 hydro three-to-many; held-out test set · hydro
Dataset subset: hydro
0.516 ± 0.035 Spearman
unitless · higher

Uncertainty: ± 0.035 (type not stated)

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M supervised · FLIP2 hydro three-to-many; held-out test set · hydro

FLIP2 hydro three-to-many; held-out test set

Aggregation: mean of five random-seed fits (Section 4.3)

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A10; row CARP-640M supervised; column spearman
Configuration: CARP-640M supervisedProtocol: FLIP2 Amylase by-mutation; held-out test set · Amylase
Dataset subset: Amylase
0.551 ± 0.239 Spearman
unitless · higher

Uncertainty: ± 0.239 (type not stated)

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M supervised · FLIP2 Amylase by-mutation; held-out test set · Amylase

FLIP2 Amylase by-mutation; held-out test set

Aggregation: mean of five random-seed fits (Section 4.3)

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A4; row CARP-640M supervised; column spearman
Configuration: CARP-640M supervisedProtocol: FLIP2 TrpB two-to-many; held-out test set · TrpB
Dataset subset: TrpB
0.996 ± 0.000 NDCG (cutoff not stated)
unitless · higher

Uncertainty: ± 0 (type not stated)

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M supervised · FLIP2 TrpB two-to-many; held-out test set · TrpB

FLIP2 TrpB two-to-many; held-out test set

Aggregation: mean of five random-seed fits (Section 4.3)

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A8; row CARP-640M supervised; column ndcg
Configuration: CARP-640M supervisedProtocol: FLIP2 hydro to-P0A9X9; held-out test set · hydro
Dataset subset: hydro
0.004 ± 0.103 Spearman
unitless · higher

Uncertainty: ± 0.103 (type not stated)

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M supervised · FLIP2 hydro to-P0A9X9; held-out test set · hydro

FLIP2 hydro to-P0A9X9; held-out test set

Aggregation: mean of five random-seed fits (Section 4.3)

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A13; row CARP-640M supervised; column spearman
Configuration: CARP-640M supervisedProtocol: FLIP2 Amylase one-to-many; held-out test set · Amylase
Dataset subset: Amylase
0.873 ± 0.029 NDCG (cutoff not stated)
unitless · higher

Uncertainty: ± 0.029 (type not stated)

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M supervised · FLIP2 Amylase one-to-many; held-out test set · Amylase

FLIP2 Amylase one-to-many; held-out test set

Aggregation: mean of five random-seed fits (Section 4.3)

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A1; row CARP-640M supervised; column ndcg
Configuration: CARP-640M supervisedProtocol: FLIP2 Amylase far-to-close; held-out test set · Amylase
Dataset subset: Amylase
0.140 ± 0.102 Spearman
unitless · higher

Uncertainty: ± 0.102 (type not stated)

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M supervised · FLIP2 Amylase far-to-close; held-out test set · Amylase

FLIP2 Amylase far-to-close; held-out test set

Aggregation: mean of five random-seed fits (Section 4.3)

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A3; row CARP-640M supervised; column spearman
Configuration: CARP-640M supervisedProtocol: FLIP2 hydro to-P01053; held-out test set · hydro
Dataset subset: hydro
0.909 ± 0.008 NDCG (cutoff not stated)
unitless · higher

Uncertainty: ± 0.008 (type not stated)

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M supervised · FLIP2 hydro to-P01053; held-out test set · hydro

FLIP2 hydro to-P01053; held-out test set

Aggregation: mean of five random-seed fits (Section 4.3)

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A14; row CARP-640M supervised; column ndcg
Configuration: CARP-640M supervisedProtocol: FLIP2 TrpB by-position; held-out test set · TrpB
Dataset subset: TrpB
0.983 ± 0.003 NDCG (cutoff not stated)
unitless · higher

Uncertainty: ± 0.003 (type not stated)

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M supervised · FLIP2 TrpB by-position; held-out test set · TrpB

FLIP2 TrpB by-position; held-out test set

Aggregation: mean of five random-seed fits (Section 4.3)

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A9; row CARP-640M supervised; column ndcg
Configuration: CARP-640M supervisedProtocol: FLIP2 hydro low-to-high; held-out test set · hydro
Dataset subset: hydro
0.188 ± 0.071 Spearman
unitless · higher

Uncertainty: ± 0.071 (type not stated)

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M supervised · FLIP2 hydro low-to-high; held-out test set · hydro

FLIP2 hydro low-to-high; held-out test set

Aggregation: mean of five random-seed fits (Section 4.3)

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A11; row CARP-640M supervised; column spearman
Configuration: CARP-640M supervisedProtocol: FLIP2 Amylase close-to-far; held-out test set · Amylase
Dataset subset: Amylase
0.081 ± 0.055 Spearman
unitless · higher

Uncertainty: ± 0.055 (type not stated)

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M supervised · FLIP2 Amylase close-to-far; held-out test set · Amylase

FLIP2 Amylase close-to-far; held-out test set

Aggregation: mean of five random-seed fits (Section 4.3)

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A2; row CARP-640M supervised; column spearman
Configuration: CARP-640M supervisedProtocol: FLIP2 hydro to-P06241; held-out test set · hydro
Dataset subset: hydro
0.933 ± 0.008 NDCG (cutoff not stated)
unitless · higher

Uncertainty: ± 0.008 (type not stated)

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M supervised · FLIP2 hydro to-P06241; held-out test set · hydro

FLIP2 hydro to-P06241; held-out test set

Aggregation: mean of five random-seed fits (Section 4.3)

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A12; row CARP-640M supervised; column ndcg
Configuration: CARP-640M supervisedProtocol: FLIP2 IRED two-to-many; held-out test set · IRED
Dataset subset: IRED
0.948 ± 0.004 NDCG (cutoff not stated)
unitless · higher

Uncertainty: ± 0.004 (type not stated)

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M supervised · FLIP2 IRED two-to-many; held-out test set · IRED

FLIP2 IRED two-to-many; held-out test set

Aggregation: mean of five random-seed fits (Section 4.3)

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A5; row CARP-640M supervised; column ndcg
Configuration: CARP-640M supervisedProtocol: FLIP2 Amylase far-to-close; held-out test set · Amylase
Dataset subset: Amylase
0.832 ± 0.019 NDCG (cutoff not stated)
unitless · higher

Uncertainty: ± 0.019 (type not stated)

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M supervised · FLIP2 Amylase far-to-close; held-out test set · Amylase

FLIP2 Amylase far-to-close; held-out test set

Aggregation: mean of five random-seed fits (Section 4.3)

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A3; row CARP-640M supervised; column ndcg
Configuration: CARP-640M supervisedProtocol: FLIP2 TrpB two-to-many; held-out test set · TrpB
Dataset subset: TrpB
0.509 ± 0.010 Spearman
unitless · higher

Uncertainty: ± 0.01 (type not stated)

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M supervised · FLIP2 TrpB two-to-many; held-out test set · TrpB

FLIP2 TrpB two-to-many; held-out test set

Aggregation: mean of five random-seed fits (Section 4.3)

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A8; row CARP-640M supervised; column spearman
Configuration: CARP-640M supervisedProtocol: FLIP2 hydro low-to-high; held-out test set · hydro
Dataset subset: hydro
0.887 ± 0.007 NDCG (cutoff not stated)
unitless · higher

Uncertainty: ± 0.007 (type not stated)

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M supervised · FLIP2 hydro low-to-high; held-out test set · hydro

FLIP2 hydro low-to-high; held-out test set

Aggregation: mean of five random-seed fits (Section 4.3)

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A11; row CARP-640M supervised; column ndcg
Configuration: CARP-640M supervisedProtocol: FLIP2 PDZ3 single-to-double; held-out test set · PDZ3
Dataset subset: PDZ3
0.882 ± 0.015 NDCG (cutoff not stated)
unitless · higher

Uncertainty: ± 0.015 (type not stated)

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M supervised · FLIP2 PDZ3 single-to-double; held-out test set · PDZ3

FLIP2 PDZ3 single-to-double; held-out test set

Aggregation: mean of five random-seed fits (Section 4.3)

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A16; row CARP-640M supervised; column ndcg
Configuration: CARP-640M supervisedProtocol: FLIP2 hydro to-P01053; held-out test set · hydro
Dataset subset: hydro
0.049 ± 0.088 Spearman
unitless · higher

Uncertainty: ± 0.088 (type not stated)

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M supervised · FLIP2 hydro to-P01053; held-out test set · hydro

FLIP2 hydro to-P01053; held-out test set

Aggregation: mean of five random-seed fits (Section 4.3)

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A14; row CARP-640M supervised; column spearman
Configuration: CARP-640M supervisedProtocol: FLIP2 TrpB one-to-many; held-out test set · TrpB
Dataset subset: TrpB
0.992 ± 0.002 NDCG (cutoff not stated)
unitless · higher

Uncertainty: ± 0.002 (type not stated)

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M supervised · FLIP2 TrpB one-to-many; held-out test set · TrpB

FLIP2 TrpB one-to-many; held-out test set

Aggregation: mean of five random-seed fits (Section 4.3)

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A7; row CARP-640M supervised; column ndcg
Configuration: CARP-640M supervisedProtocol: FLIP2 NucB two-to-many; held-out test set · NucB
Dataset subset: NucB
0.970 ± 0.001 NDCG (cutoff not stated)
unitless · higher

Uncertainty: ± 0.001 (type not stated)

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M supervised · FLIP2 NucB two-to-many; held-out test set · NucB

FLIP2 NucB two-to-many; held-out test set

Aggregation: mean of five random-seed fits (Section 4.3)

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A6; row CARP-640M supervised; column ndcg
Configuration: CARP-640M supervisedProtocol: FLIP2 TrpB by-position; held-out test set · TrpB
Dataset subset: TrpB
0.167 ± 0.018 Spearman
unitless · higher

Uncertainty: ± 0.018 (type not stated)

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M supervised · FLIP2 TrpB by-position; held-out test set · TrpB

FLIP2 TrpB by-position; held-out test set

Aggregation: mean of five random-seed fits (Section 4.3)

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A9; row CARP-640M supervised; column spearman
Configuration: CARP-640M supervisedProtocol: FLIP2 NucB two-to-many; held-out test set · NucB
Dataset subset: NucB
0.717 ± 0.012 Spearman
unitless · higher

Uncertainty: ± 0.012 (type not stated)

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M supervised · FLIP2 NucB two-to-many; held-out test set · NucB

FLIP2 NucB two-to-many; held-out test set

Aggregation: mean of five random-seed fits (Section 4.3)

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A6; row CARP-640M supervised; column spearman
Configuration: CARP-640M supervisedProtocol: FLIP2 hydro to-P06241; held-out test set · hydro
Dataset subset: hydro
0.150 ± 0.046 Spearman
unitless · higher

Uncertainty: ± 0.046 (type not stated)

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M supervised · FLIP2 hydro to-P06241; held-out test set · hydro

FLIP2 hydro to-P06241; held-out test set

Aggregation: mean of five random-seed fits (Section 4.3)

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A12; row CARP-640M supervised; column spearman
Configuration: CARP-640M supervisedProtocol: FLIP2 PDZ3 single-to-double; held-out test set · PDZ3
Dataset subset: PDZ3
0.512 ± 0.014 Spearman
unitless · higher

Uncertainty: ± 0.014 (type not stated)

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M supervised · FLIP2 PDZ3 single-to-double; held-out test set · PDZ3

FLIP2 PDZ3 single-to-double; held-out test set

Aggregation: mean of five random-seed fits (Section 4.3)

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A16; row CARP-640M supervised; column spearman

Source checking is not independent reproduction. Release 2026-11-02-a7f03c9e55a5.

Use this configuration

How it works, versions and access

Additional methodological details, versions and access terms have not yet been extracted into a structured profile for this configuration. Consult the linked sources and evaluation records below.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-02-a7f03c9e55a5
Property and statementOriginal source and locationReview and provenance

No evidence rows match these filters. Choose another scope or clear the search.

Sources and history

Release 2026-11-02-a7f03c9e55a5 · Record review: discovered

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: acquired-configuration-511e75b9873e26bacc25

source locator
Table A1; row CARP-640M supervised; column spearman
reported configuration
CARP-640M supervised
missing metadata
checkpoint revision: reason: unreported; model family: reason: unextracted
provenance note
Exact source-reported configuration or submission label. Family membership, checkpoint identity and aliases have not been inferred.
Related records

Suggest a correction