rewirebio.iobenchmarks
Model

RITA

Suite of autoregressive generative transformer models for protein sequences, up to 1.2 billion parameters trained on UniRef-100, scored in ProteinGym as a zero-shot single-sequence substitution baseline.

12 evaluations · 80 results1 configuration with further results

Overview

An explanatory profile has not yet been reviewed for this record.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Evaluations and results

12 evaluations · 80 results. Different protocols are not a single leaderboard.

Sorted by AUROC (ProteinGym clinical indels, zero-shot, Average_AUC over proteins) (higher is better). The best value in each column is highlighted. Decimals are rounded for display; each value links to the printed value and its source.

Tested configurationProtocol and datasetAUROC (ProteinGym clinical indels, zero-shot, Average_AUC over proteins)SpearmanSpearman (ProteinGym zero-shot DMS substitutions, Activity assays: mean over proteins of assay-level Spearman)Spearman (ProteinGym zero-shot DMS substitutions, Binding assays: mean over proteins of assay-level Spearman)Spearman (ProteinGym zero-shot DMS substitutions, Expression assays: mean over proteins of assay-level Spearman)Spearman (ProteinGym zero-shot DMS substitutions, High MSA depth proteins: mean over proteins of assay-level Spearman)Spearman (ProteinGym zero-shot DMS substitutions, Human proteins: mean over proteins of assay-level Spearman)Spearman (ProteinGym zero-shot DMS substitutions, Low MSA depth proteins: mean over proteins of assay-level Spearman)Spearman (ProteinGym zero-shot DMS substitutions, mean over selection types of the per-type mean over proteins of assay-level Spearman (all 217 assays))Spearman (ProteinGym zero-shot DMS substitutions, Medium MSA depth proteins: mean over proteins of assay-level Spearman)Spearman (ProteinGym zero-shot DMS substitutions, Organismal fitness assays: mean over proteins of assay-level Spearman)Spearman (ProteinGym zero-shot DMS substitutions, Other eukaryote proteins: mean over proteins of assay-level Spearman)Spearman (ProteinGym zero-shot DMS substitutions, Prokaryote proteins: mean over proteins of assay-level Spearman)Spearman (ProteinGym zero-shot DMS substitutions, Stability assays: mean over proteins of assay-level Spearman)Spearman (ProteinGym zero-shot DMS substitutions, variants with 1 substitution: mean over protein and selection-type groups of assay-level Spearman)Spearman (ProteinGym zero-shot DMS substitutions, variants with 2 substitutions: mean over protein and selection-type groups of assay-level Spearman)Spearman (ProteinGym zero-shot DMS substitutions, variants with 3 substitutions: mean over protein and selection-type groups of assay-level Spearman)Spearman (ProteinGym zero-shot DMS substitutions, variants with 4 substitutions: mean over protein and selection-type groups of assay-level Spearman)Spearman (ProteinGym zero-shot DMS substitutions, variants with 5 or more substitutions: mean over protein and selection-type groups of assay-level Spearman)Spearman (ProteinGym zero-shot DMS substitutions, Virus proteins: mean over proteins of assay-level Spearman)
RITA L [ProteinGym 144fe22b snapshot]EvaluationProteinGym clinical indels, zero-shot, average AUC (commit 144fe22), ProteinGym clinical indel benchmark at commit 144fe220.922 (best in column)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
RITA XL [ProteinGym 144fe22b snapshot]EvaluationProteinGym clinical indels, zero-shot, average AUC (commit 144fe22), ProteinGym clinical indel benchmark at commit 144fe220.916Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
RITA M [ProteinGym 144fe22b snapshot]EvaluationProteinGym clinical indels, zero-shot, average AUC (commit 144fe22), ProteinGym clinical indel benchmark at commit 144fe220.892Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
RITA S [ProteinGym 144fe22b snapshot]EvaluationProteinGym clinical indels, zero-shot, average AUC (commit 144fe22), ProteinGym clinical indel benchmark at commit 144fe220.784Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
RITA L [ProteinGym 144fe22b snapshot]EvaluationProteinGym AMFR official zero-shot Spearman snapshot, ProteinGym AMFR 4G3O official snapshot cohortNot reported-0.051Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
RITA M [ProteinGym 144fe22b snapshot]EvaluationProteinGym AMFR official zero-shot Spearman snapshot, ProteinGym AMFR 4G3O official snapshot cohortNot reported-0.218Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
RITA S [ProteinGym 144fe22b snapshot]EvaluationProteinGym AMFR official zero-shot Spearman snapshot, ProteinGym AMFR 4G3O official snapshot cohortNot reported-0.052Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
RITA XL [ProteinGym 144fe22b snapshot]EvaluationProteinGym AMFR official zero-shot Spearman snapshot, ProteinGym AMFR 4G3O official snapshot cohortNot reported-0.038 (best in column)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
RITA L [ProteinGym 144fe22b snapshot]EvaluationProteinGym v1.3 zero-shot DMS substitutions, ProteinGym DMS substitution assays at commit 144fe22 (217 assays)Not reportedNot reported0.3590.290.42 (best in column)0.4020.396 (best in column)0.301 (best in column)0.3660.3790.3780.399 (best in column)0.3150.3830.3490.1390.1430.1490.210.384
RITA M [ProteinGym 144fe22b snapshot]EvaluationProteinGym v1.3 zero-shot DMS substitutions, ProteinGym DMS substitution assays at commit 144fe22 (217 assays)Not reportedNot reported0.3520.2730.4050.390.3790.2860.350.3590.3740.3670.3020.3480.3380.1150.1410.162 (best in column)0.2220.375
RITA S [ProteinGym 144fe22b snapshot]EvaluationProteinGym v1.3 zero-shot DMS substitutions, ProteinGym DMS substitution assays at commit 144fe22 (217 assays)Not reportedNot reported0.2940.2750.3360.3320.3310.2490.3050.3050.3290.2990.2380.2890.2870.1140.1040.1220.190.344
RITA XL [ProteinGym 144fe22b snapshot]EvaluationProteinGym v1.3 zero-shot DMS substitutions, ProteinGym DMS substitution assays at commit 144fe22 (217 assays)Not reportedNot reported0.366 (best in column)0.302 (best in column)0.4140.412 (best in column)0.396 (best in column)0.30.373 (best in column)0.39 (best in column)0.384 (best in column)0.399 (best in column)0.346 (best in column)0.398 (best in column)0.357 (best in column)0.141 (best in column)0.148 (best in column)0.160.233 (best in column)0.394 (best in column)
All 80 result rows with coverage, uncertainty and sources
Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: RITA L [ProteinGym 144fe22b snapshot]Protocol: ProteinGym AMFR official zero-shot Spearman snapshot
Dataset subset: ProteinGym AMFR 4G3O official snapshot cohort
-0.051 Spearman
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

RITA L AMFR official snapshot

Not reported

Aggregation: Not reported

ProteinGym AMFR assay-level Spearman comparison · DMS_substitutions_Spearman_DMS_level.csv line 15, DMS ID=AMFR_HUMAN_Tsuboyama_2023_4G3O, column=RITA L
Configuration: RITA M [ProteinGym 144fe22b snapshot]Protocol: ProteinGym AMFR official zero-shot Spearman snapshot
Dataset subset: ProteinGym AMFR 4G3O official snapshot cohort
-0.218 Spearman
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

RITA M AMFR official snapshot

Not reported

Aggregation: Not reported

ProteinGym AMFR assay-level Spearman comparison · DMS_substitutions_Spearman_DMS_level.csv line 15, DMS ID=AMFR_HUMAN_Tsuboyama_2023_4G3O, column=RITA M
Configuration: RITA S [ProteinGym 144fe22b snapshot]Protocol: ProteinGym AMFR official zero-shot Spearman snapshot
Dataset subset: ProteinGym AMFR 4G3O official snapshot cohort
-0.052 Spearman
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

RITA S AMFR official snapshot

Not reported

Aggregation: Not reported

ProteinGym AMFR assay-level Spearman comparison · DMS_substitutions_Spearman_DMS_level.csv line 15, DMS ID=AMFR_HUMAN_Tsuboyama_2023_4G3O, column=RITA S
Configuration: RITA XL [ProteinGym 144fe22b snapshot]Protocol: ProteinGym AMFR official zero-shot Spearman snapshot
Dataset subset: ProteinGym AMFR 4G3O official snapshot cohort
-0.038 Spearman
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

RITA XL AMFR official snapshot

Not reported

Aggregation: Not reported

ProteinGym AMFR assay-level Spearman comparison · DMS_substitutions_Spearman_DMS_level.csv line 15, DMS ID=AMFR_HUMAN_Tsuboyama_2023_4G3O, column=RITA XL
Configuration: RITA L [ProteinGym 144fe22b snapshot]Protocol: ProteinGym clinical indels, zero-shot, average AUC (commit 144fe22)
Dataset subset: ProteinGym clinical indel benchmark at commit 144fe22
0.922 AUROC (ProteinGym clinical indels, zero-shot, Average_AUC over proteins)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

RITA L: ProteinGym clinical indels, zero-shot, average AUC (commit 144fe22)

ProteinGym clinical indels, zero-shot, average AUC (commit 144fe22)

Aggregation: Not reported

ProteinGym clinical zero-shot indels AUC summary at commit 144fe22 · benchmarks/clinical_zero_shot/indels/AUC/Summary_performance_clinical_indels_AUC.csv line 4, row 'RITA L', column 'Average_AUC'
Configuration: RITA M [ProteinGym 144fe22b snapshot]Protocol: ProteinGym clinical indels, zero-shot, average AUC (commit 144fe22)
Dataset subset: ProteinGym clinical indel benchmark at commit 144fe22
0.892 AUROC (ProteinGym clinical indels, zero-shot, Average_AUC over proteins)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

RITA M: ProteinGym clinical indels, zero-shot, average AUC (commit 144fe22)

ProteinGym clinical indels, zero-shot, average AUC (commit 144fe22)

Aggregation: Not reported

ProteinGym clinical zero-shot indels AUC summary at commit 144fe22 · benchmarks/clinical_zero_shot/indels/AUC/Summary_performance_clinical_indels_AUC.csv line 6, row 'RITA M', column 'Average_AUC'
Configuration: RITA S [ProteinGym 144fe22b snapshot]Protocol: ProteinGym clinical indels, zero-shot, average AUC (commit 144fe22)
Dataset subset: ProteinGym clinical indel benchmark at commit 144fe22
0.784 AUROC (ProteinGym clinical indels, zero-shot, Average_AUC over proteins)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

RITA S: ProteinGym clinical indels, zero-shot, average AUC (commit 144fe22)

ProteinGym clinical indels, zero-shot, average AUC (commit 144fe22)

Aggregation: Not reported

ProteinGym clinical zero-shot indels AUC summary at commit 144fe22 · benchmarks/clinical_zero_shot/indels/AUC/Summary_performance_clinical_indels_AUC.csv line 15, row 'RITA S', column 'Average_AUC'
Configuration: RITA XL [ProteinGym 144fe22b snapshot]Protocol: ProteinGym clinical indels, zero-shot, average AUC (commit 144fe22)
Dataset subset: ProteinGym clinical indel benchmark at commit 144fe22
0.916 AUROC (ProteinGym clinical indels, zero-shot, Average_AUC over proteins)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

RITA XL: ProteinGym clinical indels, zero-shot, average AUC (commit 144fe22)

ProteinGym clinical indels, zero-shot, average AUC (commit 144fe22)

Aggregation: Not reported

ProteinGym clinical zero-shot indels AUC summary at commit 144fe22 · benchmarks/clinical_zero_shot/indels/AUC/Summary_performance_clinical_indels_AUC.csv line 5, row 'RITA XL', column 'Average_AUC'
Configuration: RITA L [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.366 Spearman (ProteinGym zero-shot DMS substitutions, mean over selection types of the per-type mean over proteins of assay-level Spearman (all 217 assays))
unitless · higher

Uncertainty: SE 0.009. From compute_bootstrap_standard_error_functional_categories in performance_DMS_benchmarks.py at 144fe22 (default 10,000 resamples, lines 95-111 and 310-315); not an absolute standard error of the model's own average.

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

RITA L: ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 74, row 'RITA L', column 'Average_Spearman'
Configuration: RITA L [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.349 Spearman (ProteinGym zero-shot DMS substitutions, variants with 1 substitution: mean over protein and selection-type groups of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

RITA L: ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 74, row 'RITA L', column 'Depth_1'
Configuration: RITA L [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.139 Spearman (ProteinGym zero-shot DMS substitutions, variants with 2 substitutions: mean over protein and selection-type groups of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

RITA L: ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 74, row 'RITA L', column 'Depth_2'
Configuration: RITA L [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.143 Spearman (ProteinGym zero-shot DMS substitutions, variants with 3 substitutions: mean over protein and selection-type groups of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

RITA L: ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 74, row 'RITA L', column 'Depth_3'
Configuration: RITA L [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.149 Spearman (ProteinGym zero-shot DMS substitutions, variants with 4 substitutions: mean over protein and selection-type groups of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

RITA L: ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 74, row 'RITA L', column 'Depth_4'
Configuration: RITA L [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.21 Spearman (ProteinGym zero-shot DMS substitutions, variants with 5 or more substitutions: mean over protein and selection-type groups of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

RITA L: ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 74, row 'RITA L', column 'Depth_5+'
Configuration: RITA L [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.359 Spearman (ProteinGym zero-shot DMS substitutions, Activity assays: mean over proteins of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

RITA L: ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 74, row 'RITA L', column 'Function_Activity'
Configuration: RITA L [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.29 Spearman (ProteinGym zero-shot DMS substitutions, Binding assays: mean over proteins of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

RITA L: ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 74, row 'RITA L', column 'Function_Binding'
Configuration: RITA L [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.42 Spearman (ProteinGym zero-shot DMS substitutions, Expression assays: mean over proteins of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

RITA L: ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 74, row 'RITA L', column 'Function_Expression'
Configuration: RITA L [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.378 Spearman (ProteinGym zero-shot DMS substitutions, Organismal fitness assays: mean over proteins of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

RITA L: ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 74, row 'RITA L', column 'Function_OrganismalFitness'
Configuration: RITA L [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.383 Spearman (ProteinGym zero-shot DMS substitutions, Stability assays: mean over proteins of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

RITA L: ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 74, row 'RITA L', column 'Function_Stability'
Configuration: RITA L [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.402 Spearman (ProteinGym zero-shot DMS substitutions, High MSA depth proteins: mean over proteins of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

RITA L: ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 74, row 'RITA L', column 'High_MSA_depth'
Configuration: RITA L [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.301 Spearman (ProteinGym zero-shot DMS substitutions, Low MSA depth proteins: mean over proteins of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

RITA L: ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 74, row 'RITA L', column 'Low_MSA_depth'
Configuration: RITA L [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.379 Spearman (ProteinGym zero-shot DMS substitutions, Medium MSA depth proteins: mean over proteins of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

RITA L: ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 74, row 'RITA L', column 'Medium_MSA_depth'
Configuration: RITA L [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.396 Spearman (ProteinGym zero-shot DMS substitutions, Human proteins: mean over proteins of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

RITA L: ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 74, row 'RITA L', column 'Taxa_Human'
Configuration: RITA L [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.399 Spearman (ProteinGym zero-shot DMS substitutions, Other eukaryote proteins: mean over proteins of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

RITA L: ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 74, row 'RITA L', column 'Taxa_Other_Eukaryote'
Configuration: RITA L [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.315 Spearman (ProteinGym zero-shot DMS substitutions, Prokaryote proteins: mean over proteins of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

RITA L: ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 74, row 'RITA L', column 'Taxa_Prokaryote'

Source checking is not independent reproduction. Release 2026-10-22-1b7cf027e4f6.

Further results on linked records

One linked record has results that are not included above, because no reviewed claim yet ties the link to this model. Each record keeps its own settings and evaluations, and its scores are on its own page.

Use this model

How it works, versions and access

Versions and evaluated configurations

Strengths, limitations and unresolved questions

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

3 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-10-22-1b7cf027e4f6
Property and statementOriginal source and locationReview and provenance
Description
Suite of autoregressive generative transformer models for protein sequences, up to 1.2 billion parameters trained on UniRef-100, scored in ProteinGym as a zero-shot single-sequence substitution baseline.
Individual claims
Abstract: RITA: a Study on Scaling Up Generative Protein Sequence Models

Original source ↗

uc20260930-source-proteingym-amfr-spearman: Benchmark CSV header (model scored in the zero-shot DMS substitution benchmark); run-doc-proteingym-readme-md-144fe22b: README 'Leaderboard' baseline table (model name, input modalities, reference); qa-descriptions-20261010-source-rita: abstract

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: arXiv API entry for 2205.05789v2 (title and abstract)
Retrieved: 2026-10-10T06:44:38Z

source checked

["automated-source-review","ai-assisted-source-review"] · 2026-10-10

Audit details

Description written from the cited source text; provenance text was generic and is kept here as previous_value. Independent review 2026-10-10: every stated fact is supported by the cited text.

Field: description

Claim: metadata-correction-47136ee23f5fe22dab2f

Source artifact SHA-256: 5251a8da98fb5a9811e27a81f8581fc415038b4a8b8bc9be9f951c8a903ce90e

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Description
Suite of autoregressive generative transformer models for protein sequences, up to 1.2 billion parameters trained on UniRef-100, scored in ProteinGym as a zero-shot single-sequence substitution baseline.
Individual claims
OATML-Markslab/ProteinGym / README.md

Original source ↗

uc20260930-source-proteingym-amfr-spearman: Benchmark CSV header (model scored in the zero-shot DMS substitution benchmark); run-doc-proteingym-readme-md-144fe22b: README 'Leaderboard' baseline table (model name, input modalities, reference); qa-descriptions-20261010-source-rita: abstract

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c
Retrieved: 2026-09-17T09:32:03.517591+00:00

source checked

["automated-source-review","ai-assisted-source-review"] · 2026-10-10

Audit details

Description written from the cited source text; provenance text was generic and is kept here as previous_value. Independent review 2026-10-10: every stated fact is supported by the cited text.

Field: description

Claim: metadata-correction-47136ee23f5fe22dab2f

Source artifact SHA-256: 321487a8de52c6cfa647a658f61150dd72e0acb0125470524fb94d1f8b23321a

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Description
Suite of autoregressive generative transformer models for protein sequences, up to 1.2 billion parameters trained on UniRef-100, scored in ProteinGym as a zero-shot single-sequence substitution baseline.
Individual claims
ProteinGym AMFR assay-level Spearman comparison

Original source ↗

uc20260930-source-proteingym-amfr-spearman: Benchmark CSV header (model scored in the zero-shot DMS substitution benchmark); run-doc-proteingym-readme-md-144fe22b: README 'Leaderboard' baseline table (model name, input modalities, reference); qa-descriptions-20261010-source-rita: abstract

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c
Retrieved: 2026-09-30

source checked

["automated-source-review","ai-assisted-source-review"] · 2026-10-10

Audit details

Description written from the cited source text; provenance text was generic and is kept here as previous_value. Independent review 2026-10-10: every stated fact is supported by the cited text.

Field: description

Claim: metadata-correction-47136ee23f5fe22dab2f

Source artifact SHA-256: f432423b87f79ac9778dfac86e3d95be041d246bc618dc0a406b35b0b7466437

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Sources and history

Release 2026-10-22-1b7cf027e4f6 · Record review: source checked

3 source records and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: uc20260930-model-rita

areas
proteins-complexes
source locator
Pinned ProteinGym Spearman CSV header: RITA S
review
method: automated-source-review; reviewer: codex; reviewed at: 2026-09-30T21:40:59.576893+00:00; scope: Primary-source transcription and catalogue applicability audit; not human scientific review or independent experimental reproduction.; reviewer note: role: experimental use-case curation
entity level
family
identity scope
Family/method identity only; no undocumented checkpoint equivalence.
Related records

Suggest a correction