rewire.itbenchmarks
Configuration

CARP-640M likelihood

Exact source-reported configuration or submission label. Family membership, checkpoint identity and aliases have not been inferred.

16 evaluations · 31 results

Overview

Exact source-reported configuration or submission label. Family membership, checkpoint identity and aliases have not been inferred.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Evaluations and results

16 evaluations · 31 results. Different protocols are not a single leaderboard.

Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: CARP-640M likelihoodProtocol: FLIP2 Amylase far-to-close; held-out test set · Amylase
Dataset subset: Amylase
0.919 ndcg
unitless · higher

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M likelihood · FLIP2 Amylase far-to-close; held-out test set · Amylase

FLIP2 Amylase far-to-close; held-out test set

Aggregation: reported point estimate

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A3; row CARP-640M likelihood; column ndcg
Configuration: CARP-640M likelihoodProtocol: FLIP2 IRED two-to-many; held-out test set · IRED
Dataset subset: IRED
0.144 spearman
correlation · higher

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M likelihood · FLIP2 IRED two-to-many; held-out test set · IRED

FLIP2 IRED two-to-many; held-out test set

Aggregation: reported point estimate

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A5; row CARP-640M likelihood; column spearman
Configuration: CARP-640M likelihoodProtocol: FLIP2 hydro low-to-high; held-out test set · hydro
Dataset subset: hydro
0.284 spearman
correlation · higher

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M likelihood · FLIP2 hydro low-to-high; held-out test set · hydro

FLIP2 hydro low-to-high; held-out test set

Aggregation: reported point estimate

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A11; row CARP-640M likelihood; column spearman
Configuration: CARP-640M likelihoodProtocol: FLIP2 Amylase far-to-close; held-out test set · Amylase
Dataset subset: Amylase
0.566 spearman
correlation · higher

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M likelihood · FLIP2 Amylase far-to-close; held-out test set · Amylase

FLIP2 Amylase far-to-close; held-out test set

Aggregation: reported point estimate

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A3; row CARP-640M likelihood; column spearman
Configuration: CARP-640M likelihoodProtocol: FLIP2 hydro low-to-high; held-out test set · hydro
Dataset subset: hydro
0.921 ndcg
unitless · higher

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M likelihood · FLIP2 hydro low-to-high; held-out test set · hydro

FLIP2 hydro low-to-high; held-out test set

Aggregation: reported point estimate

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A11; row CARP-640M likelihood; column ndcg
Configuration: CARP-640M likelihoodProtocol: FLIP2 NucB two-to-many; held-out test set · NucB
Dataset subset: NucB
0.188 spearman
correlation · higher

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M likelihood · FLIP2 NucB two-to-many; held-out test set · NucB

FLIP2 NucB two-to-many; held-out test set

Aggregation: reported point estimate

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A6; row CARP-640M likelihood; column spearman
Configuration: CARP-640M likelihoodProtocol: FLIP2 hydro to-P06241; held-out test set · hydro
Dataset subset: hydro
0.957 ndcg
unitless · higher

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M likelihood · FLIP2 hydro to-P06241; held-out test set · hydro

FLIP2 hydro to-P06241; held-out test set

Aggregation: reported point estimate

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A12; row CARP-640M likelihood; column ndcg
Configuration: CARP-640M likelihoodProtocol: FLIP2 Amylase by-mutation; held-out test set · Amylase
Dataset subset: Amylase
0.468 spearman
correlation · higher

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M likelihood · FLIP2 Amylase by-mutation; held-out test set · Amylase

FLIP2 Amylase by-mutation; held-out test set

Aggregation: reported point estimate

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A4; row CARP-640M likelihood; column spearman
Configuration: CARP-640M likelihoodProtocol: FLIP2 PDZ3 single-to-double; held-out test set · PDZ3
Dataset subset: PDZ3
0.863 ndcg
unitless · higher

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M likelihood · FLIP2 PDZ3 single-to-double; held-out test set · PDZ3

FLIP2 PDZ3 single-to-double; held-out test set

Aggregation: reported point estimate

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A16; row CARP-640M likelihood; column ndcg
Configuration: CARP-640M likelihoodProtocol: FLIP2 rhomax by-wild-type; held-out test set · rhomax
Dataset subset: rhomax
0.937 ndcg
unitless · higher

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M likelihood · FLIP2 rhomax by-wild-type; held-out test set · rhomax

FLIP2 rhomax by-wild-type; held-out test set

Aggregation: reported point estimate

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A15; row CARP-640M likelihood; column ndcg
Configuration: CARP-640M likelihoodProtocol: FLIP2 Amylase one-to-many; held-out test set · Amylase
Dataset subset: Amylase
0.931 ndcg
unitless · higher

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M likelihood · FLIP2 Amylase one-to-many; held-out test set · Amylase

FLIP2 Amylase one-to-many; held-out test set

Aggregation: reported point estimate

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A1; row CARP-640M likelihood; column ndcg
Configuration: CARP-640M likelihoodProtocol: FLIP2 TrpB one-to-many; held-out test set · TrpB
Dataset subset: TrpB
0.418 spearman
correlation · higher

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M likelihood · FLIP2 TrpB one-to-many; held-out test set · TrpB

FLIP2 TrpB one-to-many; held-out test set

Aggregation: reported point estimate

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A7; row CARP-640M likelihood; column spearman
Configuration: CARP-640M likelihoodProtocol: FLIP2 TrpB two-to-many; held-out test set · TrpB
Dataset subset: TrpB
0.992 ndcg
unitless · higher

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M likelihood · FLIP2 TrpB two-to-many; held-out test set · TrpB

FLIP2 TrpB two-to-many; held-out test set

Aggregation: reported point estimate

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A8; row CARP-640M likelihood; column ndcg
Configuration: CARP-640M likelihoodProtocol: FLIP2 hydro to-P0A9X9; held-out test set · hydro
Dataset subset: hydro
−0.032 spearman
correlation · higher

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M likelihood · FLIP2 hydro to-P0A9X9; held-out test set · hydro

FLIP2 hydro to-P0A9X9; held-out test set

Aggregation: reported point estimate

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A13; row CARP-640M likelihood; column spearman
Configuration: CARP-640M likelihoodProtocol: FLIP2 Amylase by-mutation; held-out test set · Amylase
Dataset subset: Amylase
0.906 ndcg
unitless · higher

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M likelihood · FLIP2 Amylase by-mutation; held-out test set · Amylase

FLIP2 Amylase by-mutation; held-out test set

Aggregation: reported point estimate

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A4; row CARP-640M likelihood; column ndcg
Configuration: CARP-640M likelihoodProtocol: FLIP2 Amylase close-to-far; held-out test set · Amylase
Dataset subset: Amylase
0.543 spearman
correlation · higher

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M likelihood · FLIP2 Amylase close-to-far; held-out test set · Amylase

FLIP2 Amylase close-to-far; held-out test set

Aggregation: reported point estimate

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A2; row CARP-640M likelihood; column spearman
Configuration: CARP-640M likelihoodProtocol: FLIP2 TrpB one-to-many; held-out test set · TrpB
Dataset subset: TrpB
0.992 ndcg
unitless · higher

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M likelihood · FLIP2 TrpB one-to-many; held-out test set · TrpB

FLIP2 TrpB one-to-many; held-out test set

Aggregation: reported point estimate

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A7; row CARP-640M likelihood; column ndcg
Configuration: CARP-640M likelihoodProtocol: FLIP2 TrpB by-position; held-out test set · TrpB
Dataset subset: TrpB
0.988 ndcg
unitless · higher

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M likelihood · FLIP2 TrpB by-position; held-out test set · TrpB

FLIP2 TrpB by-position; held-out test set

Aggregation: reported point estimate

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A9; row CARP-640M likelihood; column ndcg
Configuration: CARP-640M likelihoodProtocol: FLIP2 hydro to-P06241; held-out test set · hydro
Dataset subset: hydro
0.393 spearman
correlation · higher

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M likelihood · FLIP2 hydro to-P06241; held-out test set · hydro

FLIP2 hydro to-P06241; held-out test set

Aggregation: reported point estimate

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A12; row CARP-640M likelihood; column spearman
Configuration: CARP-640M likelihoodProtocol: FLIP2 Amylase one-to-many; held-out test set · Amylase
Dataset subset: Amylase
0.513 spearman
correlation · higher

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M likelihood · FLIP2 Amylase one-to-many; held-out test set · Amylase

FLIP2 Amylase one-to-many; held-out test set

Aggregation: reported point estimate

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A1; row CARP-640M likelihood; column spearman
Configuration: CARP-640M likelihoodProtocol: FLIP2 PDZ3 single-to-double; held-out test set · PDZ3
Dataset subset: PDZ3
0.043 spearman
correlation · higher

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M likelihood · FLIP2 PDZ3 single-to-double; held-out test set · PDZ3

FLIP2 PDZ3 single-to-double; held-out test set

Aggregation: reported point estimate

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A16; row CARP-640M likelihood; column spearman
Configuration: CARP-640M likelihoodProtocol: FLIP2 TrpB two-to-many; held-out test set · TrpB
Dataset subset: TrpB
0.417 spearman
correlation · higher

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M likelihood · FLIP2 TrpB two-to-many; held-out test set · TrpB

FLIP2 TrpB two-to-many; held-out test set

Aggregation: reported point estimate

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A8; row CARP-640M likelihood; column spearman
Configuration: CARP-640M likelihoodProtocol: FLIP2 hydro to-P01053; held-out test set · hydro
Dataset subset: hydro
0.948 ndcg
unitless · higher

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M likelihood · FLIP2 hydro to-P01053; held-out test set · hydro

FLIP2 hydro to-P01053; held-out test set

Aggregation: reported point estimate

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A14; row CARP-640M likelihood; column ndcg
Configuration: CARP-640M likelihoodProtocol: FLIP2 IRED two-to-many; held-out test set · IRED
Dataset subset: IRED
0.956 ndcg
unitless · higher

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M likelihood · FLIP2 IRED two-to-many; held-out test set · IRED

FLIP2 IRED two-to-many; held-out test set

Aggregation: reported point estimate

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A5; row CARP-640M likelihood; column ndcg
Configuration: CARP-640M likelihoodProtocol: FLIP2 NucB two-to-many; held-out test set · NucB
Dataset subset: NucB
0.889 ndcg
unitless · higher

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CARP-640M likelihood · FLIP2 NucB two-to-many; held-out test set · NucB

FLIP2 NucB two-to-many; held-out test set

Aggregation: reported point estimate

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A6; row CARP-640M likelihood; column ndcg

Source checking is not independent reproduction. Release 2026-09-29-06401fd5b220.

Use this model

How it works, versions and access
Strengths, limitations and unresolved questions

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-09-29-06401fd5b220
Property and statementOriginal source and locationReview and provenance

No evidence rows match these filters. Choose another scope or clear the search.

Sources and history

View linked audit checks and correction history

Release 2026-09-29-06401fd5b220 · Record review: discovered

1 source records and release historyDownload this release
Technical metadata and extraction receipts

Stable ID: acquired-configuration-0549c02d9e97ac8ae9a3

source locator
Table A1; row CARP-640M likelihood; column spearman
reported configuration
CARP-640M likelihood
reference kind
not_a_reference
missing metadata
checkpoint revision: unreported; model family: unextracted
Related records

Suggest a correction