Configuration

EVmutation

EVmutation: Fitness prediction model.

Overview

An explanatory profile has not yet been reviewed for this record.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Evaluations and results

1 evaluation · 5 results. Different protocols are not a single leaderboard.

Dataset subset: ProteinGym substitution DMS assays (ProteinGym split)

Sorted by AUROC (higher is better). The best value in each column is highlighted. Decimals are rounded for display; each value links to the printed value and its source.

Tested configuration	Protocol and dataset	AUROC	MCC	NDCG at 10%	Spearman	Top 10% recall
EVmutationEvaluation	ProteinGym ZS-SUB-AUC: Zero-shot substitutions, AUC	0.716	Not reported	Not reported	Not reported	Not reported
EVmutationEvaluation	ProteinGym ZS-SUB-MCC: Zero-shot substitutions, MCC	Not reported	0.305	Not reported	Not reported	Not reported
EVmutationEvaluation	ProteinGym ZS-SUB-NDCG: Zero-shot substitutions, NDCG@10%	Not reported	Not reported	0.777	Not reported	Not reported
EVmutationEvaluation	ProteinGym ZS-SUB-RECALL: Zero-shot substitutions, top 10% recall	Not reported	Not reported	Not reported	Not reported	0.222
EVmutationEvaluation	ProteinGym ZS-SUB-SPEARMAN: Zero-shot substitutions, Spearman	Not reported	Not reported	Not reported	0.395	Not reported

All 5 result rows with coverage, uncertainty and sources

Filter evaluations

Tested model or methodProtocolDatasetEvaluation setupMetricEvidence origin

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configuration	Protocol and dataset	Finding	Evidence and details
Configuration: EVmutation	Task: ProteinGym ZS-SUB-AUC: Zero-shot substitutions, AUC Dataset subset: ProteinGym substitution DMS assays (ProteinGym split)	0.716 AUROC unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source EVmutation on ProteinGym ZS-SUB-AUC: Zero-shot substitutions, AUC Zero-shot scoring of substitution assays, averaged over assays with the correction the paper describes. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 2, row(EVmutation), column(Zero-shot substitutions, AUC)
Configuration: EVmutation	Task: ProteinGym ZS-SUB-MCC: Zero-shot substitutions, MCC Dataset subset: ProteinGym substitution DMS assays (ProteinGym split)	0.305 MCC unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source EVmutation on ProteinGym ZS-SUB-MCC: Zero-shot substitutions, MCC Zero-shot scoring of substitution assays, averaged over assays with the correction the paper describes. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 2, row(EVmutation), column(Zero-shot substitutions, MCC)
Configuration: EVmutation	Task: ProteinGym ZS-SUB-NDCG: Zero-shot substitutions, NDCG@10% Dataset subset: ProteinGym substitution DMS assays (ProteinGym split)	0.777 NDCG at 10% unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source EVmutation on ProteinGym ZS-SUB-NDCG: Zero-shot substitutions, NDCG@10% Zero-shot scoring of substitution assays, averaged over assays with the correction the paper describes. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 2, row(EVmutation), column(Zero-shot substitutions, NDCG@10%)
Configuration: EVmutation	Task: ProteinGym ZS-SUB-RECALL: Zero-shot substitutions, top 10% recall Dataset subset: ProteinGym substitution DMS assays (ProteinGym split)	0.222 Top 10% recall fraction · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source EVmutation on ProteinGym ZS-SUB-RECALL: Zero-shot substitutions, top 10% recall Zero-shot scoring of substitution assays, averaged over assays with the correction the paper describes. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 2, row(EVmutation), column(Zero-shot substitutions, top 10% recall)
Configuration: EVmutation	Task: ProteinGym ZS-SUB-SPEARMAN: Zero-shot substitutions, Spearman Dataset subset: ProteinGym substitution DMS assays (ProteinGym split)	0.395 Spearman unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source EVmutation on ProteinGym ZS-SUB-SPEARMAN: Zero-shot substitutions, Spearman Zero-shot scoring of substitution assays, averaged over assays with the correction the paper describes. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 2, row(EVmutation), column(Zero-shot substitutions, Spearman)

Source checking is not independent reproduction. Release 2026-11-02-a7f03c9e55a5.

Use this configuration

How it works, versions and access

Additional methodological details, versions and access terms have not yet been extracted into a structured profile for this configuration. Consult the linked sources and evaluation records below.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-02-a7f03c9e55a5
Property and statement	Original source and location	Review and provenance

No evidence rows match these filters. Choose another scope or clear the search.

How to read the evidence

Sources and history

Release 2026-11-02-a7f03c9e55a5 · Record review: source checked

1 source record and release history

ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Original source · Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256

Download this release (gzip)

Technical metadata and extraction receipts

Stable ID: proteingym-method-evmutation

areas: proteins-complexes
source locator: Table 2, row(EVmutation)
missing metadata: checkpoint revision: reason: unreported; parameters: reason: unextracted
provenance note: Fitness prediction model evaluated by the ProteinGym authors under their harness.

Related records

Suggest a correction