| Configuration: HMM | Task: ProteinGym ZS-INDEL-AUC: Zero-shot indels, all assays, AUC Dataset subset: ProteinGym indel DMS assays (ProteinGym split) | 0.744 AUROC unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceHMM on ProteinGym ZS-INDEL-AUC: Zero-shot indels, all assays, AUC Zero-shot scoring of insertion and deletion assays, split by how the test sequences were generated. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 4, row(HMM), column(Zero-shot indels, all assays, AUC) |
|---|
| Configuration: HMM | Task: ProteinGym ZS-INDEL-SPEARMAN-ALL: Zero-shot indels, all assays, Spearman Dataset subset: ProteinGym indel DMS assays (ProteinGym split) | 0.389 Spearman unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceHMM on ProteinGym ZS-INDEL-SPEARMAN-ALL: Zero-shot indels, all assays, Spearman Zero-shot scoring of insertion and deletion assays, split by how the test sequences were generated. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 4, row(HMM), column(Zero-shot indels, all assays, Spearman) |
|---|
| Configuration: HMM | Task: ProteinGym ZS-INDEL-SPEARMAN-DESIGNED: Zero-shot indels, designed or natural assays, Spearman Dataset subset: ProteinGym indel DMS assays (ProteinGym split) | 0.518 Spearman unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceHMM on ProteinGym ZS-INDEL-SPEARMAN-DESIGNED: Zero-shot indels, designed or natural assays, Spearman Zero-shot scoring of insertion and deletion assays, split by how the test sequences were generated. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 4, row(HMM), column(Zero-shot indels, designed or natural assays, Spearman) |
|---|
| Configuration: HMM | Task: ProteinGym ZS-INDEL-SPEARMAN-LIBRARY: Zero-shot indels, library assays, Spearman Dataset subset: ProteinGym indel DMS assays (ProteinGym split) | 0.373 Spearman unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceHMM on ProteinGym ZS-INDEL-SPEARMAN-LIBRARY: Zero-shot indels, library assays, Spearman Zero-shot scoring of insertion and deletion assays, split by how the test sequences were generated. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 4, row(HMM), column(Zero-shot indels, library assays, Spearman) |
|---|
| Configuration: ProGen2 M | Task: ProteinGym ZS-INDEL-AUC: Zero-shot indels, all assays, AUC Dataset subset: ProteinGym indel DMS assays (ProteinGym split) | 0.776 AUROC unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceProGen2 M on ProteinGym ZS-INDEL-AUC: Zero-shot indels, all assays, AUC Zero-shot scoring of insertion and deletion assays, split by how the test sequences were generated. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 4, row(models ProGen2 M), column(Zero-shot indels, all assays, AUC) |
|---|
| Configuration: ProGen2 M | Task: ProteinGym ZS-INDEL-SPEARMAN-ALL: Zero-shot indels, all assays, Spearman Dataset subset: ProteinGym indel DMS assays (ProteinGym split) | 0.465 Spearman unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceProGen2 M on ProteinGym ZS-INDEL-SPEARMAN-ALL: Zero-shot indels, all assays, Spearman Zero-shot scoring of insertion and deletion assays, split by how the test sequences were generated. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 4, row(models ProGen2 M), column(Zero-shot indels, all assays, Spearman) |
|---|
| Configuration: ProGen2 M | Task: ProteinGym ZS-INDEL-SPEARMAN-DESIGNED: Zero-shot indels, designed or natural assays, Spearman Dataset subset: ProteinGym indel DMS assays (ProteinGym split) | 0.205 Spearman unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceProGen2 M on ProteinGym ZS-INDEL-SPEARMAN-DESIGNED: Zero-shot indels, designed or natural assays, Spearman Zero-shot scoring of insertion and deletion assays, split by how the test sequences were generated. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 4, row(models ProGen2 M), column(Zero-shot indels, designed or natural assays, Spearman) |
|---|
| Configuration: ProGen2 M | Task: ProteinGym ZS-INDEL-SPEARMAN-LIBRARY: Zero-shot indels, library assays, Spearman Dataset subset: ProteinGym indel DMS assays (ProteinGym split) | 0.472 Spearman unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceProGen2 M on ProteinGym ZS-INDEL-SPEARMAN-LIBRARY: Zero-shot indels, library assays, Spearman Zero-shot scoring of insertion and deletion assays, split by how the test sequences were generated. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 4, row(models ProGen2 M), column(Zero-shot indels, library assays, Spearman) |
|---|
| Configuration: ProtGPT2 | Task: ProteinGym ZS-INDEL-AUC: Zero-shot indels, all assays, AUC Dataset subset: ProteinGym indel DMS assays (ProteinGym split) | 0.62 AUROC unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceProtGPT2 on ProteinGym ZS-INDEL-AUC: Zero-shot indels, all assays, AUC Zero-shot scoring of insertion and deletion assays, split by how the test sequences were generated. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 4, row(language ProtGPT2), column(Zero-shot indels, all assays, AUC) |
|---|
| Configuration: ProtGPT2 | Task: ProteinGym ZS-INDEL-SPEARMAN-ALL: Zero-shot indels, all assays, Spearman Dataset subset: ProteinGym indel DMS assays (ProteinGym split) | 0.191 Spearman unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceProtGPT2 on ProteinGym ZS-INDEL-SPEARMAN-ALL: Zero-shot indels, all assays, Spearman Zero-shot scoring of insertion and deletion assays, split by how the test sequences were generated. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 4, row(language ProtGPT2), column(Zero-shot indels, all assays, Spearman) |
|---|
| Configuration: ProtGPT2 | Task: ProteinGym ZS-INDEL-SPEARMAN-DESIGNED: Zero-shot indels, designed or natural assays, Spearman Dataset subset: ProteinGym indel DMS assays (ProteinGym split) | 0.128 Spearman unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceProtGPT2 on ProteinGym ZS-INDEL-SPEARMAN-DESIGNED: Zero-shot indels, designed or natural assays, Spearman Zero-shot scoring of insertion and deletion assays, split by how the test sequences were generated. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 4, row(language ProtGPT2), column(Zero-shot indels, designed or natural assays, Spearman) |
|---|
| Configuration: ProtGPT2 | Task: ProteinGym ZS-INDEL-SPEARMAN-LIBRARY: Zero-shot indels, library assays, Spearman Dataset subset: ProteinGym indel DMS assays (ProteinGym split) | 0.185 Spearman unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceProtGPT2 on ProteinGym ZS-INDEL-SPEARMAN-LIBRARY: Zero-shot indels, library assays, Spearman Zero-shot scoring of insertion and deletion assays, split by how the test sequences were generated. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 4, row(language ProtGPT2), column(Zero-shot indels, library assays, Spearman) |
|---|
| Configuration: PROVEAN | Task: ProteinGym ZS-INDEL-AUC: Zero-shot indels, all assays, AUC Dataset subset: ProteinGym indel DMS assays (ProteinGym split) | 0.725 AUROC unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcePROVEAN on ProteinGym ZS-INDEL-AUC: Zero-shot indels, all assays, AUC Zero-shot scoring of insertion and deletion assays, split by how the test sequences were generated. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 4, row(PROVEAN), column(Zero-shot indels, all assays, AUC) |
|---|
| Configuration: PROVEAN | Task: ProteinGym ZS-INDEL-SPEARMAN-ALL: Zero-shot indels, all assays, Spearman Dataset subset: ProteinGym indel DMS assays (ProteinGym split) | 0.347 Spearman unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcePROVEAN on ProteinGym ZS-INDEL-SPEARMAN-ALL: Zero-shot indels, all assays, Spearman Zero-shot scoring of insertion and deletion assays, split by how the test sequences were generated. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 4, row(PROVEAN), column(Zero-shot indels, all assays, Spearman) |
|---|
| Configuration: PROVEAN | Task: ProteinGym ZS-INDEL-SPEARMAN-DESIGNED: Zero-shot indels, designed or natural assays, Spearman Dataset subset: ProteinGym indel DMS assays (ProteinGym split) | 0.585 Spearman unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcePROVEAN on ProteinGym ZS-INDEL-SPEARMAN-DESIGNED: Zero-shot indels, designed or natural assays, Spearman Zero-shot scoring of insertion and deletion assays, split by how the test sequences were generated. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 4, row(PROVEAN), column(Zero-shot indels, designed or natural assays, Spearman) |
|---|
| Configuration: PROVEAN | Task: ProteinGym ZS-INDEL-SPEARMAN-LIBRARY: Zero-shot indels, library assays, Spearman Dataset subset: ProteinGym indel DMS assays (ProteinGym split) | 0.306 Spearman unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcePROVEAN on ProteinGym ZS-INDEL-SPEARMAN-LIBRARY: Zero-shot indels, library assays, Spearman Zero-shot scoring of insertion and deletion assays, split by how the test sequences were generated. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 4, row(PROVEAN), column(Zero-shot indels, library assays, Spearman) |
|---|
| Configuration: RITA L | Task: ProteinGym ZS-INDEL-AUC: Zero-shot indels, all assays, AUC Dataset subset: ProteinGym indel DMS assays (ProteinGym split) | 0.773 AUROC unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceRITA L on ProteinGym ZS-INDEL-AUC: Zero-shot indels, all assays, AUC Zero-shot scoring of insertion and deletion assays, split by how the test sequences were generated. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 4, row(Protein RITA L), column(Zero-shot indels, all assays, AUC) |
|---|
| Configuration: RITA L | Task: ProteinGym ZS-INDEL-SPEARMAN-ALL: Zero-shot indels, all assays, Spearman Dataset subset: ProteinGym indel DMS assays (ProteinGym split) | 0.457 Spearman unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceRITA L on ProteinGym ZS-INDEL-SPEARMAN-ALL: Zero-shot indels, all assays, Spearman Zero-shot scoring of insertion and deletion assays, split by how the test sequences were generated. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 4, row(Protein RITA L), column(Zero-shot indels, all assays, Spearman) |
|---|
| Configuration: RITA L | Task: ProteinGym ZS-INDEL-SPEARMAN-DESIGNED: Zero-shot indels, designed or natural assays, Spearman Dataset subset: ProteinGym indel DMS assays (ProteinGym split) | 0.519 Spearman unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceRITA L on ProteinGym ZS-INDEL-SPEARMAN-DESIGNED: Zero-shot indels, designed or natural assays, Spearman Zero-shot scoring of insertion and deletion assays, split by how the test sequences were generated. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 4, row(Protein RITA L), column(Zero-shot indels, designed or natural assays, Spearman) |
|---|
| Configuration: RITA L | Task: ProteinGym ZS-INDEL-SPEARMAN-LIBRARY: Zero-shot indels, library assays, Spearman Dataset subset: ProteinGym indel DMS assays (ProteinGym split) | 0.443 Spearman unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceRITA L on ProteinGym ZS-INDEL-SPEARMAN-LIBRARY: Zero-shot indels, library assays, Spearman Zero-shot scoring of insertion and deletion assays, split by how the test sequences were generated. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 4, row(Protein RITA L), column(Zero-shot indels, library assays, Spearman) |
|---|
| Configuration: TranceptEVE M | Task: ProteinGym ZS-INDEL-AUC: Zero-shot indels, all assays, AUC Dataset subset: ProteinGym indel DMS assays (ProteinGym split) | 0.754 AUROC unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceTranceptEVE M on ProteinGym ZS-INDEL-AUC: Zero-shot indels, all assays, AUC Zero-shot scoring of insertion and deletion assays, split by how the test sequences were generated. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 4, row(TranceptEVE M), column(Zero-shot indels, all assays, AUC) |
|---|
| Configuration: TranceptEVE M | Task: ProteinGym ZS-INDEL-SPEARMAN-ALL: Zero-shot indels, all assays, Spearman Dataset subset: ProteinGym indel DMS assays (ProteinGym split) | 0.424 Spearman unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceTranceptEVE M on ProteinGym ZS-INDEL-SPEARMAN-ALL: Zero-shot indels, all assays, Spearman Zero-shot scoring of insertion and deletion assays, split by how the test sequences were generated. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 4, row(TranceptEVE M), column(Zero-shot indels, all assays, Spearman) |
|---|
| Configuration: TranceptEVE M | Task: ProteinGym ZS-INDEL-SPEARMAN-DESIGNED: Zero-shot indels, designed or natural assays, Spearman Dataset subset: ProteinGym indel DMS assays (ProteinGym split) | 0.587 Spearman unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceTranceptEVE M on ProteinGym ZS-INDEL-SPEARMAN-DESIGNED: Zero-shot indels, designed or natural assays, Spearman Zero-shot scoring of insertion and deletion assays, split by how the test sequences were generated. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 4, row(TranceptEVE M), column(Zero-shot indels, designed or natural assays, Spearman) |
|---|
| Configuration: TranceptEVE M | Task: ProteinGym ZS-INDEL-SPEARMAN-LIBRARY: Zero-shot indels, library assays, Spearman Dataset subset: ProteinGym indel DMS assays (ProteinGym split) | 0.426 Spearman unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceTranceptEVE M on ProteinGym ZS-INDEL-SPEARMAN-LIBRARY: Zero-shot indels, library assays, Spearman Zero-shot scoring of insertion and deletion assays, split by how the test sequences were generated. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 4, row(TranceptEVE M), column(Zero-shot indels, library assays, Spearman) |
|---|
| Configuration: Tranception L | Task: ProteinGym ZS-INDEL-AUC: Zero-shot indels, all assays, AUC Dataset subset: ProteinGym indel DMS assays (ProteinGym split) | 0.741 AUROC unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceTranception L on ProteinGym ZS-INDEL-AUC: Zero-shot indels, all assays, AUC Zero-shot scoring of insertion and deletion assays, split by how the test sequences were generated. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 4, row(Tranception L), column(Zero-shot indels, all assays, AUC) |
|---|