| Configuration: AIDO Protein-RAG (16B) [ProteinGym 144fe22b snapshot] | Protocol: ProteinGym AMFR official zero-shot Spearman snapshot Dataset subset: ProteinGym AMFR 4G3O official snapshot cohort | 0.445 spearman_rho correlation · higher Uncertainty: type: unreported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceAIDO Protein-RAG (16B) AMFR official snapshot Not reported Aggregation: Not reported ProteinGym AMFR assay-level Spearman comparison · DMS_substitutions_Spearman_DMS_level.csv line 15, DMS ID=AMFR_HUMAN_Tsuboyama_2023_4G3O, column=AIDO Protein-RAG (16B) |
|---|
| Configuration: CARP (38M) [ProteinGym 144fe22b snapshot] | Protocol: ProteinGym AMFR official zero-shot Spearman snapshot Dataset subset: ProteinGym AMFR 4G3O official snapshot cohort | -0.185 spearman_rho correlation · higher Uncertainty: type: unreported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceCARP (38M) AMFR official snapshot Not reported Aggregation: Not reported ProteinGym AMFR assay-level Spearman comparison · DMS_substitutions_Spearman_DMS_level.csv line 15, DMS ID=AMFR_HUMAN_Tsuboyama_2023_4G3O, column=CARP (38M) |
|---|
| Configuration: CARP (600K) [ProteinGym 144fe22b snapshot] | Protocol: ProteinGym AMFR official zero-shot Spearman snapshot Dataset subset: ProteinGym AMFR 4G3O official snapshot cohort | -0.194 spearman_rho correlation · higher Uncertainty: type: unreported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceCARP (600K) AMFR official snapshot Not reported Aggregation: Not reported ProteinGym AMFR assay-level Spearman comparison · DMS_substitutions_Spearman_DMS_level.csv line 15, DMS ID=AMFR_HUMAN_Tsuboyama_2023_4G3O, column=CARP (600K) |
|---|
| Configuration: CARP (640M) [ProteinGym 144fe22b snapshot] | Protocol: ProteinGym AMFR official zero-shot Spearman snapshot Dataset subset: ProteinGym AMFR 4G3O official snapshot cohort | 0.165 spearman_rho correlation · higher Uncertainty: type: unreported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceCARP (640M) AMFR official snapshot Not reported Aggregation: Not reported ProteinGym AMFR assay-level Spearman comparison · DMS_substitutions_Spearman_DMS_level.csv line 15, DMS ID=AMFR_HUMAN_Tsuboyama_2023_4G3O, column=CARP (640M) |
|---|
| Configuration: CARP (76M) [ProteinGym 144fe22b snapshot] | Protocol: ProteinGym AMFR official zero-shot Spearman snapshot Dataset subset: ProteinGym AMFR 4G3O official snapshot cohort | 0.114 spearman_rho correlation · higher Uncertainty: type: unreported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceCARP (76M) AMFR official snapshot Not reported Aggregation: Not reported ProteinGym AMFR assay-level Spearman comparison · DMS_substitutions_Spearman_DMS_level.csv line 15, DMS ID=AMFR_HUMAN_Tsuboyama_2023_4G3O, column=CARP (76M) |
|---|
| Configuration: DeepSequence (ensemble) [ProteinGym 144fe22b snapshot] | Protocol: ProteinGym AMFR official zero-shot Spearman snapshot Dataset subset: ProteinGym AMFR 4G3O official snapshot cohort | 0.407 spearman_rho correlation · higher Uncertainty: type: unreported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceDeepSequence (ensemble) AMFR official snapshot Not reported Aggregation: Not reported ProteinGym AMFR assay-level Spearman comparison · DMS_substitutions_Spearman_DMS_level.csv line 15, DMS ID=AMFR_HUMAN_Tsuboyama_2023_4G3O, column=DeepSequence (ensemble) |
|---|
| Configuration: DeepSequence (single) [ProteinGym 144fe22b snapshot] | Protocol: ProteinGym AMFR official zero-shot Spearman snapshot Dataset subset: ProteinGym AMFR 4G3O official snapshot cohort | 0.419 spearman_rho correlation · higher Uncertainty: type: unreported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceDeepSequence (single) AMFR official snapshot Not reported Aggregation: Not reported ProteinGym AMFR assay-level Spearman comparison · DMS_substitutions_Spearman_DMS_level.csv line 15, DMS ID=AMFR_HUMAN_Tsuboyama_2023_4G3O, column=DeepSequence (single) |
|---|
| Configuration: ESCOTT [ProteinGym 144fe22b snapshot] | Protocol: ProteinGym AMFR official zero-shot Spearman snapshot Dataset subset: ProteinGym AMFR 4G3O official snapshot cohort | 0.41 spearman_rho correlation · higher Uncertainty: type: unreported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceESCOTT AMFR official snapshot Not reported Aggregation: Not reported ProteinGym AMFR assay-level Spearman comparison · DMS_substitutions_Spearman_DMS_level.csv line 15, DMS ID=AMFR_HUMAN_Tsuboyama_2023_4G3O, column=ESCOTT |
|---|
| Configuration: ESM-1b [ProteinGym 144fe22b snapshot] | Protocol: ProteinGym AMFR official zero-shot Spearman snapshot Dataset subset: ProteinGym AMFR 4G3O official snapshot cohort | 0.374 spearman_rho correlation · higher Uncertainty: type: unreported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceESM-1b AMFR official snapshot Not reported Aggregation: Not reported ProteinGym AMFR assay-level Spearman comparison · DMS_substitutions_Spearman_DMS_level.csv line 15, DMS ID=AMFR_HUMAN_Tsuboyama_2023_4G3O, column=ESM-1b |
|---|
| Configuration: ESM-1v (ensemble) [ProteinGym 144fe22b snapshot] | Protocol: ProteinGym AMFR official zero-shot Spearman snapshot Dataset subset: ProteinGym AMFR 4G3O official snapshot cohort | 0.423 spearman_rho correlation · higher Uncertainty: type: unreported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceESM-1v (ensemble) AMFR official snapshot Not reported Aggregation: Not reported ProteinGym AMFR assay-level Spearman comparison · DMS_substitutions_Spearman_DMS_level.csv line 15, DMS ID=AMFR_HUMAN_Tsuboyama_2023_4G3O, column=ESM-1v (ensemble) |
|---|
| Configuration: ESM-1v (single) [ProteinGym 144fe22b snapshot] | Protocol: ProteinGym AMFR official zero-shot Spearman snapshot Dataset subset: ProteinGym AMFR 4G3O official snapshot cohort | 0.07 spearman_rho correlation · higher Uncertainty: type: unreported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceESM-1v (single) AMFR official snapshot Not reported Aggregation: Not reported ProteinGym AMFR assay-level Spearman comparison · DMS_substitutions_Spearman_DMS_level.csv line 15, DMS ID=AMFR_HUMAN_Tsuboyama_2023_4G3O, column=ESM-1v (single) |
|---|
| Configuration: ESM-C (300M) [ProteinGym 144fe22b snapshot] | Protocol: ProteinGym AMFR official zero-shot Spearman snapshot Dataset subset: ProteinGym AMFR 4G3O official snapshot cohort | 0.364 spearman_rho correlation · higher Uncertainty: type: unreported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceESM-C (300M) AMFR official snapshot Not reported Aggregation: Not reported ProteinGym AMFR assay-level Spearman comparison · DMS_substitutions_Spearman_DMS_level.csv line 15, DMS ID=AMFR_HUMAN_Tsuboyama_2023_4G3O, column=ESM-C (300M) |
|---|
| Configuration: ESM-C (600M) [ProteinGym 144fe22b snapshot] | Protocol: ProteinGym AMFR official zero-shot Spearman snapshot Dataset subset: ProteinGym AMFR 4G3O official snapshot cohort | 0.262 spearman_rho correlation · higher Uncertainty: type: unreported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceESM-C (600M) AMFR official snapshot Not reported Aggregation: Not reported ProteinGym AMFR assay-level Spearman comparison · DMS_substitutions_Spearman_DMS_level.csv line 15, DMS ID=AMFR_HUMAN_Tsuboyama_2023_4G3O, column=ESM-C (600M) |
|---|
| Configuration: ESM-IF1 [ProteinGym 144fe22b snapshot] | Protocol: ProteinGym AMFR official zero-shot Spearman snapshot Dataset subset: ProteinGym AMFR 4G3O official snapshot cohort | 0.433 spearman_rho correlation · higher Uncertainty: type: unreported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceESM-IF1 AMFR official snapshot Not reported Aggregation: Not reported ProteinGym AMFR assay-level Spearman comparison · DMS_substitutions_Spearman_DMS_level.csv line 15, DMS ID=AMFR_HUMAN_Tsuboyama_2023_4G3O, column=ESM-IF1 |
|---|
| Configuration: ESM2 (150M) [ProteinGym 144fe22b snapshot] | Protocol: ProteinGym AMFR official zero-shot Spearman snapshot Dataset subset: ProteinGym AMFR 4G3O official snapshot cohort | 0.321 spearman_rho correlation · higher Uncertainty: type: unreported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceESM2 (150M) AMFR official snapshot Not reported Aggregation: Not reported ProteinGym AMFR assay-level Spearman comparison · DMS_substitutions_Spearman_DMS_level.csv line 15, DMS ID=AMFR_HUMAN_Tsuboyama_2023_4G3O, column=ESM2 (150M) |
|---|
| Configuration: ESM2 (15B) [ProteinGym 144fe22b snapshot] | Protocol: ProteinGym AMFR official zero-shot Spearman snapshot Dataset subset: ProteinGym AMFR 4G3O official snapshot cohort | 0.26 spearman_rho correlation · higher Uncertainty: type: unreported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceESM2 (15B) AMFR official snapshot Not reported Aggregation: Not reported ProteinGym AMFR assay-level Spearman comparison · DMS_substitutions_Spearman_DMS_level.csv line 15, DMS ID=AMFR_HUMAN_Tsuboyama_2023_4G3O, column=ESM2 (15B) |
|---|
| Configuration: ESM2 (35M) [ProteinGym 144fe22b snapshot] | Protocol: ProteinGym AMFR official zero-shot Spearman snapshot Dataset subset: ProteinGym AMFR 4G3O official snapshot cohort | 0.286 spearman_rho correlation · higher Uncertainty: type: unreported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceESM2 (35M) AMFR official snapshot Not reported Aggregation: Not reported ProteinGym AMFR assay-level Spearman comparison · DMS_substitutions_Spearman_DMS_level.csv line 15, DMS ID=AMFR_HUMAN_Tsuboyama_2023_4G3O, column=ESM2 (35M) |
|---|
| Configuration: ESM2 (3B) [ProteinGym 144fe22b snapshot] | Protocol: ProteinGym AMFR official zero-shot Spearman snapshot Dataset subset: ProteinGym AMFR 4G3O official snapshot cohort | 0.297 spearman_rho correlation · higher Uncertainty: type: unreported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceESM2 (3B) AMFR official snapshot Not reported Aggregation: Not reported ProteinGym AMFR assay-level Spearman comparison · DMS_substitutions_Spearman_DMS_level.csv line 15, DMS ID=AMFR_HUMAN_Tsuboyama_2023_4G3O, column=ESM2 (3B) |
|---|
| Configuration: ESM2 (650M) [ProteinGym 144fe22b snapshot] | Protocol: ProteinGym AMFR official zero-shot Spearman snapshot Dataset subset: ProteinGym AMFR 4G3O official snapshot cohort | 0.261 spearman_rho correlation · higher Uncertainty: type: unreported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceESM2 (650M) AMFR official snapshot Not reported Aggregation: Not reported ProteinGym AMFR assay-level Spearman comparison · DMS_substitutions_Spearman_DMS_level.csv line 15, DMS ID=AMFR_HUMAN_Tsuboyama_2023_4G3O, column=ESM2 (650M) |
|---|
| Configuration: ESM2 (8M) [ProteinGym 144fe22b snapshot] | Protocol: ProteinGym AMFR official zero-shot Spearman snapshot Dataset subset: ProteinGym AMFR 4G3O official snapshot cohort | -0.209 spearman_rho correlation · higher Uncertainty: type: unreported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceESM2 (8M) AMFR official snapshot Not reported Aggregation: Not reported ProteinGym AMFR assay-level Spearman comparison · DMS_substitutions_Spearman_DMS_level.csv line 15, DMS ID=AMFR_HUMAN_Tsuboyama_2023_4G3O, column=ESM2 (8M) |
|---|
| Configuration: ESM3 open (1.4B) [ProteinGym 144fe22b snapshot] | Protocol: ProteinGym AMFR official zero-shot Spearman snapshot Dataset subset: ProteinGym AMFR 4G3O official snapshot cohort | 0.29 spearman_rho correlation · higher Uncertainty: type: unreported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceESM3 open (1.4B) AMFR official snapshot Not reported Aggregation: Not reported ProteinGym AMFR assay-level Spearman comparison · DMS_substitutions_Spearman_DMS_level.csv line 15, DMS ID=AMFR_HUMAN_Tsuboyama_2023_4G3O, column=ESM3 open (1.4B) |
|---|
| Configuration: EVE (ensemble) [ProteinGym 144fe22b snapshot] | Protocol: ProteinGym AMFR official zero-shot Spearman snapshot Dataset subset: ProteinGym AMFR 4G3O official snapshot cohort | 0.398 spearman_rho correlation · higher Uncertainty: type: unreported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceEVE (ensemble) AMFR official snapshot Not reported Aggregation: Not reported ProteinGym AMFR assay-level Spearman comparison · DMS_substitutions_Spearman_DMS_level.csv line 15, DMS ID=AMFR_HUMAN_Tsuboyama_2023_4G3O, column=EVE (ensemble) |
|---|
| Configuration: EVE (single) [ProteinGym 144fe22b snapshot] | Protocol: ProteinGym AMFR official zero-shot Spearman snapshot Dataset subset: ProteinGym AMFR 4G3O official snapshot cohort | 0.386 spearman_rho correlation · higher Uncertainty: type: unreported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceEVE (single) AMFR official snapshot Not reported Aggregation: Not reported ProteinGym AMFR assay-level Spearman comparison · DMS_substitutions_Spearman_DMS_level.csv line 15, DMS ID=AMFR_HUMAN_Tsuboyama_2023_4G3O, column=EVE (single) |
|---|
| Configuration: EVmutation [ProteinGym 144fe22b snapshot] | Protocol: ProteinGym AMFR official zero-shot Spearman snapshot Dataset subset: ProteinGym AMFR 4G3O official snapshot cohort | 0.418 spearman_rho correlation · higher Uncertainty: type: unreported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceEVmutation AMFR official snapshot Not reported Aggregation: Not reported ProteinGym AMFR assay-level Spearman comparison · DMS_substitutions_Spearman_DMS_level.csv line 15, DMS ID=AMFR_HUMAN_Tsuboyama_2023_4G3O, column=EVmutation |
|---|
| Configuration: GEMME [ProteinGym 144fe22b snapshot] | Protocol: ProteinGym AMFR official zero-shot Spearman snapshot Dataset subset: ProteinGym AMFR 4G3O official snapshot cohort | 0.396 spearman_rho correlation · higher Uncertainty: type: unreported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceGEMME AMFR official snapshot Not reported Aggregation: Not reported ProteinGym AMFR assay-level Spearman comparison · DMS_substitutions_Spearman_DMS_level.csv line 15, DMS ID=AMFR_HUMAN_Tsuboyama_2023_4G3O, column=GEMME |
|---|