Configuration

PoET (200M) [ProteinGym 144fe22b snapshot]

PoET (200M), from the ProteinGym reference scores at commit 144fe22b.

Overview

An explanatory profile has not yet been reviewed for this record.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Evaluations and results

4 evaluations · 21 results. Different protocols are not a single leaderboard.

Sorted by AUROC (ProteinGym clinical indels, zero-shot, Average_AUC over proteins) (higher is better). The best value in each column is highlighted. Decimals are rounded for display; each value links to the printed value and its source.

Tested configuration	Protocol and dataset	AUROC (ProteinGym clinical indels, zero-shot, Average_AUC over proteins)	AUROC (ProteinGym clinical substitutions, zero-shot, Average_AUC over proteins)	Spearman	Spearman (ProteinGym zero-shot DMS substitutions, Activity assays: mean over proteins of assay-level Spearman)	Spearman (ProteinGym zero-shot DMS substitutions, Binding assays: mean over proteins of assay-level Spearman)	Spearman (ProteinGym zero-shot DMS substitutions, Expression assays: mean over proteins of assay-level Spearman)	Spearman (ProteinGym zero-shot DMS substitutions, High MSA depth proteins: mean over proteins of assay-level Spearman)	Spearman (ProteinGym zero-shot DMS substitutions, Human proteins: mean over proteins of assay-level Spearman)	Spearman (ProteinGym zero-shot DMS substitutions, Low MSA depth proteins: mean over proteins of assay-level Spearman)	Spearman (ProteinGym zero-shot DMS substitutions, mean over selection types of the per-type mean over proteins of assay-level Spearman (all 217 assays))	Spearman (ProteinGym zero-shot DMS substitutions, Medium MSA depth proteins: mean over proteins of assay-level Spearman)	Spearman (ProteinGym zero-shot DMS substitutions, Organismal fitness assays: mean over proteins of assay-level Spearman)	Spearman (ProteinGym zero-shot DMS substitutions, Other eukaryote proteins: mean over proteins of assay-level Spearman)	Spearman (ProteinGym zero-shot DMS substitutions, Prokaryote proteins: mean over proteins of assay-level Spearman)	Spearman (ProteinGym zero-shot DMS substitutions, Stability assays: mean over proteins of assay-level Spearman)	Spearman (ProteinGym zero-shot DMS substitutions, variants with 1 substitution: mean over protein and selection-type groups of assay-level Spearman)	Spearman (ProteinGym zero-shot DMS substitutions, variants with 2 substitutions: mean over protein and selection-type groups of assay-level Spearman)	Spearman (ProteinGym zero-shot DMS substitutions, variants with 3 substitutions: mean over protein and selection-type groups of assay-level Spearman)	Spearman (ProteinGym zero-shot DMS substitutions, variants with 4 substitutions: mean over protein and selection-type groups of assay-level Spearman)	Spearman (ProteinGym zero-shot DMS substitutions, variants with 5 or more substitutions: mean over protein and selection-type groups of assay-level Spearman)	Spearman (ProteinGym zero-shot DMS substitutions, Virus proteins: mean over proteins of assay-level Spearman)
PoET (200M) [ProteinGym 144fe22b snapshot]Evaluation	ProteinGym clinical indels, zero-shot, average AUC (commit 144fe22), ProteinGym clinical indel benchmark at commit 144fe22	0.935	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported
PoET (200M) [ProteinGym 144fe22b snapshot]Evaluation	ProteinGym AMFR official zero-shot Spearman snapshot, ProteinGym AMFR 4G3O official snapshot cohort	Not reported	Not reported	0.272	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported
PoET (200M) [ProteinGym 144fe22b snapshot]Evaluation	ProteinGym clinical substitutions, zero-shot, average AUC (commit 144fe22), ProteinGym clinical substitution benchmark at commit 144fe22	Not reported	0.92	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported	Not reported
PoET (200M) [ProteinGym 144fe22b snapshot]Evaluation	ProteinGym v1.3 zero-shot DMS substitutions, ProteinGym DMS substitution assays at commit 144fe22 (217 assays)	Not reported	Not reported	Not reported	0.494	0.396	0.466	0.51	0.482	0.478	0.47	0.478	0.475	0.541	0.464	0.519	0.466	0.299	0.419	0.395	0.418	0.491

All 21 result rows with coverage, uncertainty and sources

Filter evaluations

Tested model or methodProtocolDatasetEvaluation setupMetricEvidence origin

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configuration	Protocol and dataset	Finding	Evidence and details
Configuration: PoET (200M) [ProteinGym 144fe22b snapshot]	Protocol: ProteinGym AMFR official zero-shot Spearman snapshot Dataset subset: ProteinGym AMFR 4G3O official snapshot cohort	0.272 Spearman unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Evaluation origin not reported · Source checked Methods, coverage and source PoET (200M) AMFR official snapshot Not reported Aggregation: Not reported ProteinGym AMFR assay-level Spearman comparison · DMS_substitutions_Spearman_DMS_level.csv line 15, DMS ID=AMFR_HUMAN_Tsuboyama_2023_4G3O, column=PoET (200M)
Configuration: PoET (200M) [ProteinGym 144fe22b snapshot]	Protocol: ProteinGym clinical indels, zero-shot, average AUC (commit 144fe22) Dataset subset: ProteinGym clinical indel benchmark at commit 144fe22	0.935 AUROC (ProteinGym clinical indels, zero-shot, Average_AUC over proteins) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Evaluation origin not reported · Source checked Methods, coverage and source PoET (200M): ProteinGym clinical indels, zero-shot, average AUC (commit 144fe22) ProteinGym clinical indels, zero-shot, average AUC (commit 144fe22) Aggregation: Not reported ProteinGym clinical zero-shot indels AUC summary at commit 144fe22 · benchmarks/clinical_zero_shot/indels/AUC/Summary_performance_clinical_indels_AUC.csv line 2, row 'PoET (200M)', column 'Average_AUC'
Configuration: PoET (200M) [ProteinGym 144fe22b snapshot]	Protocol: ProteinGym clinical substitutions, zero-shot, average AUC (commit 144fe22) Dataset subset: ProteinGym clinical substitution benchmark at commit 144fe22	0.92 AUROC (ProteinGym clinical substitutions, zero-shot, Average_AUC over proteins) unitless · higher Uncertainty: ± 0.0 (type not stated). Labelled a bootstrap standard error. The script that wrote the clinical summary was not read; in the DMS script the same column is the standard error of the difference from the top model, and the top row here prints 0.0, which suggests the same construction. Not verified for this file. Coverage: Not reported scored / Not reported eligible	Evaluation origin not reported · Source checked Methods, coverage and source PoET (200M): ProteinGym clinical substitutions, zero-shot, average AUC (commit 144fe22) ProteinGym clinical substitutions, zero-shot, average AUC (commit 144fe22) Aggregation: Not reported ProteinGym clinical zero-shot substitutions AUC summary at commit 144fe22 · benchmarks/clinical_zero_shot/substitutions/AUC/Summary_performance_clinical_substitutions_AUC.csv line 2, row 'PoET (200M)', column 'Average_AUC'
Configuration: PoET (200M) [ProteinGym 144fe22b snapshot]	Protocol: ProteinGym v1.3 zero-shot DMS substitutions Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)	0.47 Spearman (ProteinGym zero-shot DMS substitutions, mean over selection types of the per-type mean over proteins of assay-level Spearman (all 217 assays)) unitless · higher Uncertainty: SE 0.007. From compute_bootstrap_standard_error_functional_categories in performance_DMS_benchmarks.py at 144fe22 (default 10,000 resamples, lines 95-111 and 310-315); not an absolute standard error of the model's own average. Coverage: Not reported scored / Not reported eligible	Evaluation origin not reported · Source checked Methods, coverage and source PoET (200M): ProteinGym zero-shot DMS substitutions summary (144fe22) ProteinGym zero-shot DMS substitutions, Spearman summary Aggregation: Not reported ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 13, row 'PoET (200M)', column 'Average_Spearman'
Configuration: PoET (200M) [ProteinGym 144fe22b snapshot]	Protocol: ProteinGym v1.3 zero-shot DMS substitutions Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)	0.466 Spearman (ProteinGym zero-shot DMS substitutions, variants with 1 substitution: mean over protein and selection-type groups of assay-level Spearman) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Evaluation origin not reported · Source checked Methods, coverage and source PoET (200M): ProteinGym zero-shot DMS substitutions summary (144fe22) ProteinGym zero-shot DMS substitutions, Spearman summary Aggregation: Not reported ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 13, row 'PoET (200M)', column 'Depth_1'
Configuration: PoET (200M) [ProteinGym 144fe22b snapshot]	Protocol: ProteinGym v1.3 zero-shot DMS substitutions Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)	0.299 Spearman (ProteinGym zero-shot DMS substitutions, variants with 2 substitutions: mean over protein and selection-type groups of assay-level Spearman) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Evaluation origin not reported · Source checked Methods, coverage and source PoET (200M): ProteinGym zero-shot DMS substitutions summary (144fe22) ProteinGym zero-shot DMS substitutions, Spearman summary Aggregation: Not reported ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 13, row 'PoET (200M)', column 'Depth_2'
Configuration: PoET (200M) [ProteinGym 144fe22b snapshot]	Protocol: ProteinGym v1.3 zero-shot DMS substitutions Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)	0.419 Spearman (ProteinGym zero-shot DMS substitutions, variants with 3 substitutions: mean over protein and selection-type groups of assay-level Spearman) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Evaluation origin not reported · Source checked Methods, coverage and source PoET (200M): ProteinGym zero-shot DMS substitutions summary (144fe22) ProteinGym zero-shot DMS substitutions, Spearman summary Aggregation: Not reported ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 13, row 'PoET (200M)', column 'Depth_3'
Configuration: PoET (200M) [ProteinGym 144fe22b snapshot]	Protocol: ProteinGym v1.3 zero-shot DMS substitutions Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)	0.395 Spearman (ProteinGym zero-shot DMS substitutions, variants with 4 substitutions: mean over protein and selection-type groups of assay-level Spearman) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Evaluation origin not reported · Source checked Methods, coverage and source PoET (200M): ProteinGym zero-shot DMS substitutions summary (144fe22) ProteinGym zero-shot DMS substitutions, Spearman summary Aggregation: Not reported ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 13, row 'PoET (200M)', column 'Depth_4'
Configuration: PoET (200M) [ProteinGym 144fe22b snapshot]	Protocol: ProteinGym v1.3 zero-shot DMS substitutions Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)	0.418 Spearman (ProteinGym zero-shot DMS substitutions, variants with 5 or more substitutions: mean over protein and selection-type groups of assay-level Spearman) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Evaluation origin not reported · Source checked Methods, coverage and source PoET (200M): ProteinGym zero-shot DMS substitutions summary (144fe22) ProteinGym zero-shot DMS substitutions, Spearman summary Aggregation: Not reported ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 13, row 'PoET (200M)', column 'Depth_5+'
Configuration: PoET (200M) [ProteinGym 144fe22b snapshot]	Protocol: ProteinGym v1.3 zero-shot DMS substitutions Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)	0.494 Spearman (ProteinGym zero-shot DMS substitutions, Activity assays: mean over proteins of assay-level Spearman) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Evaluation origin not reported · Source checked Methods, coverage and source PoET (200M): ProteinGym zero-shot DMS substitutions summary (144fe22) ProteinGym zero-shot DMS substitutions, Spearman summary Aggregation: Not reported ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 13, row 'PoET (200M)', column 'Function_Activity'
Configuration: PoET (200M) [ProteinGym 144fe22b snapshot]	Protocol: ProteinGym v1.3 zero-shot DMS substitutions Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)	0.396 Spearman (ProteinGym zero-shot DMS substitutions, Binding assays: mean over proteins of assay-level Spearman) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Evaluation origin not reported · Source checked Methods, coverage and source PoET (200M): ProteinGym zero-shot DMS substitutions summary (144fe22) ProteinGym zero-shot DMS substitutions, Spearman summary Aggregation: Not reported ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 13, row 'PoET (200M)', column 'Function_Binding'
Configuration: PoET (200M) [ProteinGym 144fe22b snapshot]	Protocol: ProteinGym v1.3 zero-shot DMS substitutions Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)	0.466 Spearman (ProteinGym zero-shot DMS substitutions, Expression assays: mean over proteins of assay-level Spearman) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Evaluation origin not reported · Source checked Methods, coverage and source PoET (200M): ProteinGym zero-shot DMS substitutions summary (144fe22) ProteinGym zero-shot DMS substitutions, Spearman summary Aggregation: Not reported ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 13, row 'PoET (200M)', column 'Function_Expression'
Configuration: PoET (200M) [ProteinGym 144fe22b snapshot]	Protocol: ProteinGym v1.3 zero-shot DMS substitutions Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)	0.475 Spearman (ProteinGym zero-shot DMS substitutions, Organismal fitness assays: mean over proteins of assay-level Spearman) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Evaluation origin not reported · Source checked Methods, coverage and source PoET (200M): ProteinGym zero-shot DMS substitutions summary (144fe22) ProteinGym zero-shot DMS substitutions, Spearman summary Aggregation: Not reported ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 13, row 'PoET (200M)', column 'Function_OrganismalFitness'
Configuration: PoET (200M) [ProteinGym 144fe22b snapshot]	Protocol: ProteinGym v1.3 zero-shot DMS substitutions Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)	0.519 Spearman (ProteinGym zero-shot DMS substitutions, Stability assays: mean over proteins of assay-level Spearman) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Evaluation origin not reported · Source checked Methods, coverage and source PoET (200M): ProteinGym zero-shot DMS substitutions summary (144fe22) ProteinGym zero-shot DMS substitutions, Spearman summary Aggregation: Not reported ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 13, row 'PoET (200M)', column 'Function_Stability'
Configuration: PoET (200M) [ProteinGym 144fe22b snapshot]	Protocol: ProteinGym v1.3 zero-shot DMS substitutions Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)	0.51 Spearman (ProteinGym zero-shot DMS substitutions, High MSA depth proteins: mean over proteins of assay-level Spearman) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Evaluation origin not reported · Source checked Methods, coverage and source PoET (200M): ProteinGym zero-shot DMS substitutions summary (144fe22) ProteinGym zero-shot DMS substitutions, Spearman summary Aggregation: Not reported ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 13, row 'PoET (200M)', column 'High_MSA_depth'
Configuration: PoET (200M) [ProteinGym 144fe22b snapshot]	Protocol: ProteinGym v1.3 zero-shot DMS substitutions Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)	0.478 Spearman (ProteinGym zero-shot DMS substitutions, Low MSA depth proteins: mean over proteins of assay-level Spearman) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Evaluation origin not reported · Source checked Methods, coverage and source PoET (200M): ProteinGym zero-shot DMS substitutions summary (144fe22) ProteinGym zero-shot DMS substitutions, Spearman summary Aggregation: Not reported ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 13, row 'PoET (200M)', column 'Low_MSA_depth'
Configuration: PoET (200M) [ProteinGym 144fe22b snapshot]	Protocol: ProteinGym v1.3 zero-shot DMS substitutions Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)	0.478 Spearman (ProteinGym zero-shot DMS substitutions, Medium MSA depth proteins: mean over proteins of assay-level Spearman) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Evaluation origin not reported · Source checked Methods, coverage and source PoET (200M): ProteinGym zero-shot DMS substitutions summary (144fe22) ProteinGym zero-shot DMS substitutions, Spearman summary Aggregation: Not reported ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 13, row 'PoET (200M)', column 'Medium_MSA_depth'
Configuration: PoET (200M) [ProteinGym 144fe22b snapshot]	Protocol: ProteinGym v1.3 zero-shot DMS substitutions Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)	0.482 Spearman (ProteinGym zero-shot DMS substitutions, Human proteins: mean over proteins of assay-level Spearman) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Evaluation origin not reported · Source checked Methods, coverage and source PoET (200M): ProteinGym zero-shot DMS substitutions summary (144fe22) ProteinGym zero-shot DMS substitutions, Spearman summary Aggregation: Not reported ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 13, row 'PoET (200M)', column 'Taxa_Human'
Configuration: PoET (200M) [ProteinGym 144fe22b snapshot]	Protocol: ProteinGym v1.3 zero-shot DMS substitutions Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)	0.541 Spearman (ProteinGym zero-shot DMS substitutions, Other eukaryote proteins: mean over proteins of assay-level Spearman) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Evaluation origin not reported · Source checked Methods, coverage and source PoET (200M): ProteinGym zero-shot DMS substitutions summary (144fe22) ProteinGym zero-shot DMS substitutions, Spearman summary Aggregation: Not reported ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 13, row 'PoET (200M)', column 'Taxa_Other_Eukaryote'
Configuration: PoET (200M) [ProteinGym 144fe22b snapshot]	Protocol: ProteinGym v1.3 zero-shot DMS substitutions Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)	0.464 Spearman (ProteinGym zero-shot DMS substitutions, Prokaryote proteins: mean over proteins of assay-level Spearman) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Evaluation origin not reported · Source checked Methods, coverage and source PoET (200M): ProteinGym zero-shot DMS substitutions summary (144fe22) ProteinGym zero-shot DMS substitutions, Spearman summary Aggregation: Not reported ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 13, row 'PoET (200M)', column 'Taxa_Prokaryote'
Configuration: PoET (200M) [ProteinGym 144fe22b snapshot]	Protocol: ProteinGym v1.3 zero-shot DMS substitutions Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)	0.491 Spearman (ProteinGym zero-shot DMS substitutions, Virus proteins: mean over proteins of assay-level Spearman) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Evaluation origin not reported · Source checked Methods, coverage and source PoET (200M): ProteinGym zero-shot DMS substitutions summary (144fe22) ProteinGym zero-shot DMS substitutions, Spearman summary Aggregation: Not reported ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 13, row 'PoET (200M)', column 'Taxa_Virus'

Source checking is not independent reproduction. Release 2026-10-22-1b7cf027e4f6.

Use this configuration

How it works, versions and access

Related profile: PoET. This page retains the exact record and its evaluation context.

Strengths, limitations and unresolved questions

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

2 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-10-22-1b7cf027e4f6
Property and statement	Original source and location	Review and provenance
Facets: method types 1 values foundation_model Individual claims	ProteinGym AMFR assay-level Spearman comparison Original source ↗ Proposer's report, ProteinGym AMFR: protein language and structure-conditioned models fit foundation_model Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c Retrieved: 2026-09-30	conflicting claim ["automated-source-review"] · 2026-10-12 Audit details Correct the method type from none to foundation_model (use-case baseline review 2026-10-12, table 2). Not source-checked in the review; this comparison has no baseline row. Evidence from docs/reviews/use-cases/baselines-2026-10-12.md. Independent review 2026-10-12: approved. See docs/reviews/2026-10-12-method-type-corrections.md. Conflicting source claim: `"[\"foundation_model\"]"`. Claim record status: source_checked. Field: `facets.method_types` Claim: metadata-correction-tags-20261012-fc436586ba95fdef6d73 Source artifact SHA-256: `f432423b87f79ac9778dfac86e3d95be041d246bc618dc0a406b35b0b7466437` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Relationship: configuration of uc20260930-model-poet Individual claims	ProteinGym AMFR assay-level Spearman comparison Original source ↗ Pinned ProteinGym Spearman CSV header: PoET (200M) Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c Retrieved: 2026-09-30	source checked ["automated-source-review"] · 2026-09-30T21:40:59.576893+00:00 Audit details Field: `links:configuration_of:uc20260930-model-poet` Claim: uc20260930-config-family-918b23835b89a12c Source artifact SHA-256: `f432423b87f79ac9778dfac86e3d95be041d246bc618dc0a406b35b0b7466437` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact

How to read the evidence

Sources and history

Release 2026-10-22-1b7cf027e4f6 · Record review: source checked

1 source record and release history

ProteinGym AMFR assay-level Spearman comparison · Original source · 144fe22b07dfaeec2b366f2346203a9838a55b4c

Download this release (gzip)

Technical metadata and extraction receipts

Stable ID: uc20260930-proteingym-amfr-config-poet-200m

areas: proteins-complexes
method types: foundation_model
source locator: See linked evaluation and result locators
missing metadata: checkpoint hash: reason: unextracted
review: method: automated-source-review; reviewer: codex; reviewed at: 2026-09-30T21:40:59.576893+00:00; scope: Primary-source transcription and catalogue applicability audit; not human scientific review or independent experimental reproduction.; reviewer note: role: experimental use-case curation
reported name: PoET (200M)
version: 144fe22b07dfaeec2b366f2346203a9838a55b4c
provenance note: Exact official CSV source-label configuration; checkpoint and per-assay scoring details are not inferred from similarly named methods.

Related records

configuration of: PoET
subject: PoET (200M) [ProteinGym 144fe22b snapshot]: facets.method_types
subject: PoET (200M) [ProteinGym 144fe22b snapshot] family identity
system: PoET (200M) AMFR official snapshot
system: PoET (200M): ProteinGym clinical indels, zero-shot, average AUC (commit 144fe22)
system: PoET (200M): ProteinGym clinical substitutions, zero-shot, average AUC (commit 144fe22)
system: PoET (200M): ProteinGym zero-shot DMS substitutions summary (144fe22)

Suggest a correction