CARP-640M naive supervised
Entry in FLIP2, identified only by its entry label; the model or method behind it is not identified.
Overview
An explanatory profile has not yet been reviewed for this record.
Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.
Model Capabilities & Hardware Requirements
Deployment facts recorded for CARP-640M naive supervised. Fields the record does not carry are marked not recorded.
Evaluations and results
16 evaluations · 32 results. Different protocols are not a single leaderboard.
Sorted by NDCG (cutoff not stated) (higher is better). The best value in each column is highlighted. Decimals are rounded for display; each value links to the printed value and its source.
All 32 result rows with coverage, uncertainty and sources
Filter evaluations
Applied filters: All linked evaluations
| Tested configuration | Protocol and dataset | Finding | Evidence and details |
|---|---|---|---|
| Configuration: CARP-640M naive supervised | Protocol: FLIP2 Amylase far-to-close; held-out test set · Amylase Dataset subset: Amylase | 0.825 ± 0.009 NDCG (cutoff not stated) unitless · higher Uncertainty: ± 0.009 (type not stated) Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceCARP-640M naive supervised · FLIP2 Amylase far-to-close; held-out test set · Amylase FLIP2 Amylase far-to-close; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A3; row CARP-640M naive supervised; column ndcg |
| Configuration: CARP-640M naive supervised | Protocol: FLIP2 TrpB one-to-many; held-out test set · TrpB Dataset subset: TrpB | 0.298 ± 0.217 Spearman unitless · higher Uncertainty: ± 0.217 (type not stated) Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceCARP-640M naive supervised · FLIP2 TrpB one-to-many; held-out test set · TrpB FLIP2 TrpB one-to-many; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A7; row CARP-640M naive supervised; column spearman |
| Configuration: CARP-640M naive supervised | Protocol: FLIP2 TrpB two-to-many; held-out test set · TrpB Dataset subset: TrpB | 0.985 ± 0.002 NDCG (cutoff not stated) unitless · higher Uncertainty: ± 0.002 (type not stated) Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceCARP-640M naive supervised · FLIP2 TrpB two-to-many; held-out test set · TrpB FLIP2 TrpB two-to-many; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A8; row CARP-640M naive supervised; column ndcg |
| Configuration: CARP-640M naive supervised | Protocol: FLIP2 hydro to-P06241; held-out test set · hydro Dataset subset: hydro | 0.927 ± 0.006 NDCG (cutoff not stated) unitless · higher Uncertainty: ± 0.006 (type not stated) Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceCARP-640M naive supervised · FLIP2 hydro to-P06241; held-out test set · hydro FLIP2 hydro to-P06241; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A12; row CARP-640M naive supervised; column ndcg |
| Configuration: CARP-640M naive supervised | Protocol: FLIP2 TrpB one-to-many; held-out test set · TrpB Dataset subset: TrpB | 0.984 ± 0.002 NDCG (cutoff not stated) unitless · higher Uncertainty: ± 0.002 (type not stated) Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceCARP-640M naive supervised · FLIP2 TrpB one-to-many; held-out test set · TrpB FLIP2 TrpB one-to-many; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A7; row CARP-640M naive supervised; column ndcg |
| Configuration: CARP-640M naive supervised | Protocol: FLIP2 hydro to-P01053; held-out test set · hydro Dataset subset: hydro | 0.061 ± 0.094 Spearman unitless · higher Uncertainty: ± 0.094 (type not stated) Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceCARP-640M naive supervised · FLIP2 hydro to-P01053; held-out test set · hydro FLIP2 hydro to-P01053; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A14; row CARP-640M naive supervised; column spearman |
| Configuration: CARP-640M naive supervised | Protocol: FLIP2 rhomax by-wild-type; held-out test set · rhomax Dataset subset: rhomax | 0.934 ± 0.009 NDCG (cutoff not stated) unitless · higher Uncertainty: ± 0.009 (type not stated) Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceCARP-640M naive supervised · FLIP2 rhomax by-wild-type; held-out test set · rhomax FLIP2 rhomax by-wild-type; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A15; row CARP-640M naive supervised; column ndcg |
| Configuration: CARP-640M naive supervised | Protocol: FLIP2 PDZ3 single-to-double; held-out test set · PDZ3 Dataset subset: PDZ3 | 0.870 ± 0.008 NDCG (cutoff not stated) unitless · higher Uncertainty: ± 0.008 (type not stated) Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceCARP-640M naive supervised · FLIP2 PDZ3 single-to-double; held-out test set · PDZ3 FLIP2 PDZ3 single-to-double; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A16; row CARP-640M naive supervised; column ndcg |
| Configuration: CARP-640M naive supervised | Protocol: FLIP2 Amylase by-mutation; held-out test set · Amylase Dataset subset: Amylase | 0.109 ± 0.134 Spearman unitless · higher Uncertainty: ± 0.134 (type not stated) Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceCARP-640M naive supervised · FLIP2 Amylase by-mutation; held-out test set · Amylase FLIP2 Amylase by-mutation; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A4; row CARP-640M naive supervised; column spearman |
| Configuration: CARP-640M naive supervised | Protocol: FLIP2 IRED two-to-many; held-out test set · IRED Dataset subset: IRED | 0.012 ± 0.017 Spearman unitless · higher Uncertainty: ± 0.017 (type not stated) Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceCARP-640M naive supervised · FLIP2 IRED two-to-many; held-out test set · IRED FLIP2 IRED two-to-many; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A5; row CARP-640M naive supervised; column spearman |
| Configuration: CARP-640M naive supervised | Protocol: FLIP2 rhomax by-wild-type; held-out test set · rhomax Dataset subset: rhomax | 0.056 ± 0.125 Spearman unitless · higher Uncertainty: ± 0.125 (type not stated) Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceCARP-640M naive supervised · FLIP2 rhomax by-wild-type; held-out test set · rhomax FLIP2 rhomax by-wild-type; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A15; row CARP-640M naive supervised; column spearman |
| Configuration: CARP-640M naive supervised | Protocol: FLIP2 TrpB by-position; held-out test set · TrpB Dataset subset: TrpB | −0.009 ± nan Spearman unitless · higher Uncertainty: Not reported by the source: printed spread "nan" Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceCARP-640M naive supervised · FLIP2 TrpB by-position; held-out test set · TrpB FLIP2 TrpB by-position; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A9; row CARP-640M naive supervised; column spearman |
| Configuration: CARP-640M naive supervised | Protocol: FLIP2 Amylase one-to-many; held-out test set · Amylase Dataset subset: Amylase | 0.087 ± 0.172 Spearman unitless · higher Uncertainty: ± 0.172 (type not stated) Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceCARP-640M naive supervised · FLIP2 Amylase one-to-many; held-out test set · Amylase FLIP2 Amylase one-to-many; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A1; row CARP-640M naive supervised; column spearman |
| Configuration: CARP-640M naive supervised | Protocol: FLIP2 PDZ3 single-to-double; held-out test set · PDZ3 Dataset subset: PDZ3 | 0.464 ± 0.022 Spearman unitless · higher Uncertainty: ± 0.022 (type not stated) Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceCARP-640M naive supervised · FLIP2 PDZ3 single-to-double; held-out test set · PDZ3 FLIP2 PDZ3 single-to-double; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A16; row CARP-640M naive supervised; column spearman |
| Configuration: CARP-640M naive supervised | Protocol: FLIP2 Amylase close-to-far; held-out test set · Amylase Dataset subset: Amylase | 0.006 ± 0.117 Spearman unitless · higher Uncertainty: ± 0.117 (type not stated) Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceCARP-640M naive supervised · FLIP2 Amylase close-to-far; held-out test set · Amylase FLIP2 Amylase close-to-far; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A2; row CARP-640M naive supervised; column spearman |
| Configuration: CARP-640M naive supervised | Protocol: FLIP2 Amylase one-to-many; held-out test set · Amylase Dataset subset: Amylase | 0.863 ± 0.023 NDCG (cutoff not stated) unitless · higher Uncertainty: ± 0.023 (type not stated) Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceCARP-640M naive supervised · FLIP2 Amylase one-to-many; held-out test set · Amylase FLIP2 Amylase one-to-many; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A1; row CARP-640M naive supervised; column ndcg |
| Configuration: CARP-640M naive supervised | Protocol: FLIP2 hydro low-to-high; held-out test set · hydro Dataset subset: hydro | 0.188 ± 0.202 Spearman unitless · higher Uncertainty: ± 0.202 (type not stated) Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceCARP-640M naive supervised · FLIP2 hydro low-to-high; held-out test set · hydro FLIP2 hydro low-to-high; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A11; row CARP-640M naive supervised; column spearman |
| Configuration: CARP-640M naive supervised | Protocol: FLIP2 Amylase by-mutation; held-out test set · Amylase Dataset subset: Amylase | 0.819 ± 0.029 NDCG (cutoff not stated) unitless · higher Uncertainty: ± 0.029 (type not stated) Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceCARP-640M naive supervised · FLIP2 Amylase by-mutation; held-out test set · Amylase FLIP2 Amylase by-mutation; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A4; row CARP-640M naive supervised; column ndcg |
| Configuration: CARP-640M naive supervised | Protocol: FLIP2 hydro to-P0A9X9; held-out test set · hydro Dataset subset: hydro | 0.960 ± 0.002 NDCG (cutoff not stated) unitless · higher Uncertainty: ± 0.002 (type not stated) Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceCARP-640M naive supervised · FLIP2 hydro to-P0A9X9; held-out test set · hydro FLIP2 hydro to-P0A9X9; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A13; row CARP-640M naive supervised; column ndcg |
| Configuration: CARP-640M naive supervised | Protocol: FLIP2 NucB two-to-many; held-out test set · NucB Dataset subset: NucB | 0.704 ± 0.007 Spearman unitless · higher Uncertainty: ± 0.007 (type not stated) Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceCARP-640M naive supervised · FLIP2 NucB two-to-many; held-out test set · NucB FLIP2 NucB two-to-many; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A6; row CARP-640M naive supervised; column spearman |
| Configuration: CARP-640M naive supervised | Protocol: FLIP2 TrpB by-position; held-out test set · TrpB Dataset subset: TrpB | 0.975 ± 0.000 NDCG (cutoff not stated) unitless · higher Uncertainty: ± 0 (type not stated) Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceCARP-640M naive supervised · FLIP2 TrpB by-position; held-out test set · TrpB FLIP2 TrpB by-position; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A9; row CARP-640M naive supervised; column ndcg |
| Configuration: CARP-640M naive supervised | Protocol: FLIP2 TrpB two-to-many; held-out test set · TrpB Dataset subset: TrpB | 0.328 ± 0.095 Spearman unitless · higher Uncertainty: ± 0.095 (type not stated) Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceCARP-640M naive supervised · FLIP2 TrpB two-to-many; held-out test set · TrpB FLIP2 TrpB two-to-many; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A8; row CARP-640M naive supervised; column spearman |
| Configuration: CARP-640M naive supervised | Protocol: FLIP2 hydro to-P0A9X9; held-out test set · hydro Dataset subset: hydro | −0.029 ± 0.074 Spearman unitless · higher Uncertainty: ± 0.074 (type not stated) Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceCARP-640M naive supervised · FLIP2 hydro to-P0A9X9; held-out test set · hydro FLIP2 hydro to-P0A9X9; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A13; row CARP-640M naive supervised; column spearman |
| Configuration: CARP-640M naive supervised | Protocol: FLIP2 hydro three-to-many; held-out test set · hydro Dataset subset: hydro | 0.984 ± 0.001 NDCG (cutoff not stated) unitless · higher Uncertainty: ± 0.001 (type not stated) Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceCARP-640M naive supervised · FLIP2 hydro three-to-many; held-out test set · hydro FLIP2 hydro three-to-many; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A10; row CARP-640M naive supervised; column ndcg |
| Configuration: CARP-640M naive supervised | Protocol: FLIP2 IRED two-to-many; held-out test set · IRED Dataset subset: IRED | 0.944 ± 0.001 NDCG (cutoff not stated) unitless · higher Uncertainty: ± 0.001 (type not stated) Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceCARP-640M naive supervised · FLIP2 IRED two-to-many; held-out test set · IRED FLIP2 IRED two-to-many; held-out test set Aggregation: mean of five random-seed fits (Section 4.3) FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A5; row CARP-640M naive supervised; column ndcg |
Source checking is not independent reproduction. Release 2026-11-21-c8bea25e5abb.
Use this configuration
How it works, versions and access
Additional methodological details, versions and access terms have not yet been extracted into a structured profile for this configuration. Consult the linked sources and evaluation records below.
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
0 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|
No evidence rows match these filters. Choose another scope or clear the search.
Sources and history
Release 2026-11-21-c8bea25e5abb · Record review: discovered
1 source record and release history
- FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Original source · Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256
Technical metadata and record identifiers
Technical metadata for this record is tracked under stable ID acquired-configuration-a0a6e3bb087d0e8b2b3e.
Source locator: Table A1; row CARP-640M naive supervised; column spearman
Related records
- system: CARP-640M naive supervised · FLIP2 NucB two-to-many; held-out test set · NucB
- system: CARP-640M naive supervised · FLIP2 Amylase close-to-far; held-out test set · Amylase
- system: CARP-640M naive supervised · FLIP2 rhomax by-wild-type; held-out test set · rhomax
- system: CARP-640M naive supervised · FLIP2 hydro to-P06241; held-out test set · hydro
- system: CARP-640M naive supervised · FLIP2 Amylase far-to-close; held-out test set · Amylase
- system: CARP-640M naive supervised · FLIP2 Amylase by-mutation; held-out test set · Amylase
- system: CARP-640M naive supervised · FLIP2 IRED two-to-many; held-out test set · IRED
- system: CARP-640M naive supervised · FLIP2 Amylase one-to-many; held-out test set · Amylase
- system: CARP-640M naive supervised · FLIP2 hydro to-P01053; held-out test set · hydro
- system: CARP-640M naive supervised · FLIP2 hydro low-to-high; held-out test set · hydro
- system: CARP-640M naive supervised · FLIP2 TrpB by-position; held-out test set · TrpB
- system: CARP-640M naive supervised · FLIP2 PDZ3 single-to-double; held-out test set · PDZ3
- system: CARP-640M naive supervised · FLIP2 hydro three-to-many; held-out test set · hydro
- system: CARP-640M naive supervised · FLIP2 TrpB two-to-many; held-out test set · TrpB
- system: CARP-640M naive supervised · FLIP2 hydro to-P0A9X9; held-out test set · hydro
- system: CARP-640M naive supervised · FLIP2 TrpB one-to-many; held-out test set · TrpB
How to cite
CARP-640M naive supervised. Rewire biological model benchmark database, release 2026-11-21-c8bea25e5abb. https://benchmarks.rewirebio.io/database/configuration/acquired-configuration-a0a6e3bb087d0e8b2b3e/
Release 2026-11-21-c8bea25e5abb. Rankings and values change between releases, so keep the release id in the citation. Cite the original publication as well for any value you reuse: each result links its source.
The compilation and annotations made by Rewire in this release are offered under CC BY 4.0; values and text taken from cited sources stay under the terms of those sources and are not covered by this licence. Data licence