Configuration

CARP-640M naive supervised

Exact source-reported configuration or submission label. Family membership, checkpoint identity and aliases have not been inferred.

16 evaluations · 32 results

Overview

Exact source-reported configuration or submission label. Family membership, checkpoint identity and aliases have not been inferred.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Evaluations and results

16 evaluations · 32 results. Different protocols are not a single leaderboard.

Filter evaluations

Tested model or methodProtocolDatasetEvaluation setupMetricEvidence origin

Applied filters: All linked evaluations

Source checking is not independent reproduction. Release 2026-09-29-06401fd5b220.

Use this model

How it works, versions and access

Strengths, limitations and unresolved questions

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-09-29-06401fd5b220
Property and statement	Original source and location	Review and provenance

No evidence rows match these filters. Choose another scope or clear the search.

All evidence (CSV)All evidence (JSONL)How to read the evidence

Sources and history

View linked audit checks and correction history

Release 2026-09-29-06401fd5b220 · Record review: discovered

1 source records and release history

FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Original source · Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256

Download this release

Technical metadata and extraction receipts

Stable ID: acquired-configuration-a0a6e3bb087d0e8b2b3e

source locator: Table A1; row CARP-640M naive supervised; column spearman
reported configuration: CARP-640M naive supervised
reference kind: not_a_reference
missing metadata: checkpoint revision: unreported; model family: unextracted

Related records

Suggest a correction

Tested configuration	Protocol and dataset	Finding	Evidence and details
Configuration: CARP-640M naive supervised	Protocol: FLIP2 Amylase far-to-close; held-out test set · Amylase Dataset subset: Amylase	0.825 ± 0.009 ndcg unitless · higher Uncertainty: printed spread: 0.009; type: unreported; value: 0.009 Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source CARP-640M naive supervised · FLIP2 Amylase far-to-close; held-out test set · Amylase FLIP2 Amylase far-to-close; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A3; row CARP-640M naive supervised; column ndcg
Configuration: CARP-640M naive supervised	Protocol: FLIP2 TrpB one-to-many; held-out test set · TrpB Dataset subset: TrpB	0.298 ± 0.217 spearman correlation · higher Uncertainty: printed spread: 0.217; type: unreported; value: 0.217 Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source CARP-640M naive supervised · FLIP2 TrpB one-to-many; held-out test set · TrpB FLIP2 TrpB one-to-many; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A7; row CARP-640M naive supervised; column spearman
Configuration: CARP-640M naive supervised	Protocol: FLIP2 TrpB two-to-many; held-out test set · TrpB Dataset subset: TrpB	0.985 ± 0.002 ndcg unitless · higher Uncertainty: printed spread: 0.002; type: unreported; value: 0.002 Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source CARP-640M naive supervised · FLIP2 TrpB two-to-many; held-out test set · TrpB FLIP2 TrpB two-to-many; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A8; row CARP-640M naive supervised; column ndcg
Configuration: CARP-640M naive supervised	Protocol: FLIP2 hydro to-P06241; held-out test set · hydro Dataset subset: hydro	0.927 ± 0.006 ndcg unitless · higher Uncertainty: printed spread: 0.006; type: unreported; value: 0.006 Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source CARP-640M naive supervised · FLIP2 hydro to-P06241; held-out test set · hydro FLIP2 hydro to-P06241; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A12; row CARP-640M naive supervised; column ndcg
Configuration: CARP-640M naive supervised	Protocol: FLIP2 TrpB one-to-many; held-out test set · TrpB Dataset subset: TrpB	0.984 ± 0.002 ndcg unitless · higher Uncertainty: printed spread: 0.002; type: unreported; value: 0.002 Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source CARP-640M naive supervised · FLIP2 TrpB one-to-many; held-out test set · TrpB FLIP2 TrpB one-to-many; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A7; row CARP-640M naive supervised; column ndcg
Configuration: CARP-640M naive supervised	Protocol: FLIP2 hydro to-P01053; held-out test set · hydro Dataset subset: hydro	0.061 ± 0.094 spearman correlation · higher Uncertainty: printed spread: 0.094; type: unreported; value: 0.094 Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source CARP-640M naive supervised · FLIP2 hydro to-P01053; held-out test set · hydro FLIP2 hydro to-P01053; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A14; row CARP-640M naive supervised; column spearman
Configuration: CARP-640M naive supervised	Protocol: FLIP2 rhomax by-wild-type; held-out test set · rhomax Dataset subset: rhomax	0.934 ± 0.009 ndcg unitless · higher Uncertainty: printed spread: 0.009; type: unreported; value: 0.009 Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source CARP-640M naive supervised · FLIP2 rhomax by-wild-type; held-out test set · rhomax FLIP2 rhomax by-wild-type; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A15; row CARP-640M naive supervised; column ndcg
Configuration: CARP-640M naive supervised	Protocol: FLIP2 PDZ3 single-to-double; held-out test set · PDZ3 Dataset subset: PDZ3	0.870 ± 0.008 ndcg unitless · higher Uncertainty: printed spread: 0.008; type: unreported; value: 0.008 Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source CARP-640M naive supervised · FLIP2 PDZ3 single-to-double; held-out test set · PDZ3 FLIP2 PDZ3 single-to-double; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A16; row CARP-640M naive supervised; column ndcg
Configuration: CARP-640M naive supervised	Protocol: FLIP2 Amylase by-mutation; held-out test set · Amylase Dataset subset: Amylase	0.109 ± 0.134 spearman correlation · higher Uncertainty: printed spread: 0.134; type: unreported; value: 0.134 Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source CARP-640M naive supervised · FLIP2 Amylase by-mutation; held-out test set · Amylase FLIP2 Amylase by-mutation; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A4; row CARP-640M naive supervised; column spearman
Configuration: CARP-640M naive supervised	Protocol: FLIP2 IRED two-to-many; held-out test set · IRED Dataset subset: IRED	0.012 ± 0.017 spearman correlation · higher Uncertainty: printed spread: 0.017; type: unreported; value: 0.017 Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source CARP-640M naive supervised · FLIP2 IRED two-to-many; held-out test set · IRED FLIP2 IRED two-to-many; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A5; row CARP-640M naive supervised; column spearman
Configuration: CARP-640M naive supervised	Protocol: FLIP2 rhomax by-wild-type; held-out test set · rhomax Dataset subset: rhomax	0.056 ± 0.125 spearman correlation · higher Uncertainty: printed spread: 0.125; type: unreported; value: 0.125 Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source CARP-640M naive supervised · FLIP2 rhomax by-wild-type; held-out test set · rhomax FLIP2 rhomax by-wild-type; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A15; row CARP-640M naive supervised; column spearman
Configuration: CARP-640M naive supervised	Protocol: FLIP2 TrpB by-position; held-out test set · TrpB Dataset subset: TrpB	−0.009 ± nan spearman correlation · higher Uncertainty: printed spread: nan; type: unreported; value: Not reported Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source CARP-640M naive supervised · FLIP2 TrpB by-position; held-out test set · TrpB FLIP2 TrpB by-position; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A9; row CARP-640M naive supervised; column spearman
Configuration: CARP-640M naive supervised	Protocol: FLIP2 Amylase one-to-many; held-out test set · Amylase Dataset subset: Amylase	0.087 ± 0.172 spearman correlation · higher Uncertainty: printed spread: 0.172; type: unreported; value: 0.172 Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source CARP-640M naive supervised · FLIP2 Amylase one-to-many; held-out test set · Amylase FLIP2 Amylase one-to-many; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A1; row CARP-640M naive supervised; column spearman
Configuration: CARP-640M naive supervised	Protocol: FLIP2 PDZ3 single-to-double; held-out test set · PDZ3 Dataset subset: PDZ3	0.464 ± 0.022 spearman correlation · higher Uncertainty: printed spread: 0.022; type: unreported; value: 0.022 Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source CARP-640M naive supervised · FLIP2 PDZ3 single-to-double; held-out test set · PDZ3 FLIP2 PDZ3 single-to-double; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A16; row CARP-640M naive supervised; column spearman
Configuration: CARP-640M naive supervised	Protocol: FLIP2 Amylase close-to-far; held-out test set · Amylase Dataset subset: Amylase	0.006 ± 0.117 spearman correlation · higher Uncertainty: printed spread: 0.117; type: unreported; value: 0.117 Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source CARP-640M naive supervised · FLIP2 Amylase close-to-far; held-out test set · Amylase FLIP2 Amylase close-to-far; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A2; row CARP-640M naive supervised; column spearman
Configuration: CARP-640M naive supervised	Protocol: FLIP2 Amylase one-to-many; held-out test set · Amylase Dataset subset: Amylase	0.863 ± 0.023 ndcg unitless · higher Uncertainty: printed spread: 0.023; type: unreported; value: 0.023 Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source CARP-640M naive supervised · FLIP2 Amylase one-to-many; held-out test set · Amylase FLIP2 Amylase one-to-many; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A1; row CARP-640M naive supervised; column ndcg
Configuration: CARP-640M naive supervised	Protocol: FLIP2 hydro low-to-high; held-out test set · hydro Dataset subset: hydro	0.188 ± 0.202 spearman correlation · higher Uncertainty: printed spread: 0.202; type: unreported; value: 0.202 Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source CARP-640M naive supervised · FLIP2 hydro low-to-high; held-out test set · hydro FLIP2 hydro low-to-high; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A11; row CARP-640M naive supervised; column spearman
Configuration: CARP-640M naive supervised	Protocol: FLIP2 Amylase by-mutation; held-out test set · Amylase Dataset subset: Amylase	0.819 ± 0.029 ndcg unitless · higher Uncertainty: printed spread: 0.029; type: unreported; value: 0.029 Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source CARP-640M naive supervised · FLIP2 Amylase by-mutation; held-out test set · Amylase FLIP2 Amylase by-mutation; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A4; row CARP-640M naive supervised; column ndcg
Configuration: CARP-640M naive supervised	Protocol: FLIP2 hydro to-P0A9X9; held-out test set · hydro Dataset subset: hydro	0.960 ± 0.002 ndcg unitless · higher Uncertainty: printed spread: 0.002; type: unreported; value: 0.002 Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source CARP-640M naive supervised · FLIP2 hydro to-P0A9X9; held-out test set · hydro FLIP2 hydro to-P0A9X9; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A13; row CARP-640M naive supervised; column ndcg
Configuration: CARP-640M naive supervised	Protocol: FLIP2 NucB two-to-many; held-out test set · NucB Dataset subset: NucB	0.704 ± 0.007 spearman correlation · higher Uncertainty: printed spread: 0.007; type: unreported; value: 0.007 Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source CARP-640M naive supervised · FLIP2 NucB two-to-many; held-out test set · NucB FLIP2 NucB two-to-many; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A6; row CARP-640M naive supervised; column spearman
Configuration: CARP-640M naive supervised	Protocol: FLIP2 TrpB by-position; held-out test set · TrpB Dataset subset: TrpB	0.975 ± 0.000 ndcg unitless · higher Uncertainty: printed spread: 0.000; type: unreported; value: 0 Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source CARP-640M naive supervised · FLIP2 TrpB by-position; held-out test set · TrpB FLIP2 TrpB by-position; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A9; row CARP-640M naive supervised; column ndcg
Configuration: CARP-640M naive supervised	Protocol: FLIP2 TrpB two-to-many; held-out test set · TrpB Dataset subset: TrpB	0.328 ± 0.095 spearman correlation · higher Uncertainty: printed spread: 0.095; type: unreported; value: 0.095 Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source CARP-640M naive supervised · FLIP2 TrpB two-to-many; held-out test set · TrpB FLIP2 TrpB two-to-many; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A8; row CARP-640M naive supervised; column spearman
Configuration: CARP-640M naive supervised	Protocol: FLIP2 hydro to-P0A9X9; held-out test set · hydro Dataset subset: hydro	−0.029 ± 0.074 spearman correlation · higher Uncertainty: printed spread: 0.074; type: unreported; value: 0.074 Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source CARP-640M naive supervised · FLIP2 hydro to-P0A9X9; held-out test set · hydro FLIP2 hydro to-P0A9X9; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A13; row CARP-640M naive supervised; column spearman
Configuration: CARP-640M naive supervised	Protocol: FLIP2 hydro three-to-many; held-out test set · hydro Dataset subset: hydro	0.984 ± 0.001 ndcg unitless · higher Uncertainty: printed spread: 0.001; type: unreported; value: 0.001 Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source CARP-640M naive supervised · FLIP2 hydro three-to-many; held-out test set · hydro FLIP2 hydro three-to-many; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A10; row CARP-640M naive supervised; column ndcg
Configuration: CARP-640M naive supervised	Protocol: FLIP2 IRED two-to-many; held-out test set · IRED Dataset subset: IRED	0.944 ± 0.001 ndcg unitless · higher Uncertainty: printed spread: 0.001; type: unreported; value: 0.001 Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source CARP-640M naive supervised · FLIP2 IRED two-to-many; held-out test set · IRED FLIP2 IRED two-to-many; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A5; row CARP-640M naive supervised; column ndcg