rewirebio.iobenchmarks
Model

xTrimoPGLM

Family of protein language models, scaled up to 100 billion parameters, pretrained jointly with autoencoding and autoregressive objectives for protein understanding and generation; ProteinGym scores several sizes as zero-shot single-sequence substitution baselines.

14 evaluations · 133 results

Overview

An explanatory profile has not yet been reviewed for this record.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Evaluations and results

14 evaluations · 133 results. Different protocols are not a single leaderboard.

Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: xTrimoPGLM-100B-int4 [ProteinGym 144fe22b snapshot]Protocol: ProteinGym AMFR official zero-shot Spearman snapshot
Dataset subset: ProteinGym AMFR 4G3O official snapshot cohort
0.262 Spearman
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

xTrimoPGLM-100B-int4 AMFR official snapshot

Not reported

Aggregation: Not reported

ProteinGym AMFR assay-level Spearman comparison · DMS_substitutions_Spearman_DMS_level.csv line 15, DMS ID=AMFR_HUMAN_Tsuboyama_2023_4G3O, column=xTrimoPGLM-100B-int4
Configuration: xTrimoPGLM-10B-MLM [ProteinGym 144fe22b snapshot]Protocol: ProteinGym AMFR official zero-shot Spearman snapshot
Dataset subset: ProteinGym AMFR 4G3O official snapshot cohort
0.253 Spearman
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

xTrimoPGLM-10B-MLM AMFR official snapshot

Not reported

Aggregation: Not reported

ProteinGym AMFR assay-level Spearman comparison · DMS_substitutions_Spearman_DMS_level.csv line 15, DMS ID=AMFR_HUMAN_Tsuboyama_2023_4G3O, column=xTrimoPGLM-10B-MLM
Configuration: xTrimoPGLM-1B-CLM [ProteinGym 144fe22b snapshot]Protocol: ProteinGym AMFR official zero-shot Spearman snapshot
Dataset subset: ProteinGym AMFR 4G3O official snapshot cohort
-0.064 Spearman
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

xTrimoPGLM-1B-CLM AMFR official snapshot

Not reported

Aggregation: Not reported

ProteinGym AMFR assay-level Spearman comparison · DMS_substitutions_Spearman_DMS_level.csv line 15, DMS ID=AMFR_HUMAN_Tsuboyama_2023_4G3O, column=xTrimoPGLM-1B-CLM
Configuration: xTrimoPGLM-1B-MLM [ProteinGym 144fe22b snapshot]Protocol: ProteinGym AMFR official zero-shot Spearman snapshot
Dataset subset: ProteinGym AMFR 4G3O official snapshot cohort
0.205 Spearman
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

xTrimoPGLM-1B-MLM AMFR official snapshot

Not reported

Aggregation: Not reported

ProteinGym AMFR assay-level Spearman comparison · DMS_substitutions_Spearman_DMS_level.csv line 15, DMS ID=AMFR_HUMAN_Tsuboyama_2023_4G3O, column=xTrimoPGLM-1B-MLM
Configuration: xTrimoPGLM-3B-CLM [ProteinGym 144fe22b snapshot]Protocol: ProteinGym AMFR official zero-shot Spearman snapshot
Dataset subset: ProteinGym AMFR 4G3O official snapshot cohort
-0.224 Spearman
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

xTrimoPGLM-3B-CLM AMFR official snapshot

Not reported

Aggregation: Not reported

ProteinGym AMFR assay-level Spearman comparison · DMS_substitutions_Spearman_DMS_level.csv line 15, DMS ID=AMFR_HUMAN_Tsuboyama_2023_4G3O, column=xTrimoPGLM-3B-CLM
Configuration: xTrimoPGLM-3B-MLM [ProteinGym 144fe22b snapshot]Protocol: ProteinGym AMFR official zero-shot Spearman snapshot
Dataset subset: ProteinGym AMFR 4G3O official snapshot cohort
0.247 Spearman
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

xTrimoPGLM-3B-MLM AMFR official snapshot

Not reported

Aggregation: Not reported

ProteinGym AMFR assay-level Spearman comparison · DMS_substitutions_Spearman_DMS_level.csv line 15, DMS ID=AMFR_HUMAN_Tsuboyama_2023_4G3O, column=xTrimoPGLM-3B-MLM
Configuration: xTrimoPGLM-7B-CLM [ProteinGym 144fe22b snapshot]Protocol: ProteinGym AMFR official zero-shot Spearman snapshot
Dataset subset: ProteinGym AMFR 4G3O official snapshot cohort
-0.144 Spearman
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

xTrimoPGLM-7B-CLM AMFR official snapshot

Not reported

Aggregation: Not reported

ProteinGym AMFR assay-level Spearman comparison · DMS_substitutions_Spearman_DMS_level.csv line 15, DMS ID=AMFR_HUMAN_Tsuboyama_2023_4G3O, column=xTrimoPGLM-7B-CLM
Configuration: xTrimoPGLM-100B-int4 [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.364 Spearman (ProteinGym zero-shot DMS substitutions, mean over selection types of the per-type mean over proteins of assay-level Spearman (all 217 assays))
unitless · higher

Uncertainty: SE 0.01. From compute_bootstrap_standard_error_functional_categories in performance_DMS_benchmarks.py at 144fe22 (default 10,000 resamples, lines 95-111 and 310-315); not an absolute standard error of the model's own average.

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

xTrimoPGLM-100B-int4: ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 75, row 'xTrimoPGLM-100B-int4', column 'Average_Spearman'
Configuration: xTrimoPGLM-100B-int4 [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.355 Spearman (ProteinGym zero-shot DMS substitutions, variants with 1 substitution: mean over protein and selection-type groups of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

xTrimoPGLM-100B-int4: ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 75, row 'xTrimoPGLM-100B-int4', column 'Depth_1'
Configuration: xTrimoPGLM-100B-int4 [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.177 Spearman (ProteinGym zero-shot DMS substitutions, variants with 2 substitutions: mean over protein and selection-type groups of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

xTrimoPGLM-100B-int4: ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 75, row 'xTrimoPGLM-100B-int4', column 'Depth_2'
Configuration: xTrimoPGLM-100B-int4 [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.276 Spearman (ProteinGym zero-shot DMS substitutions, variants with 3 substitutions: mean over protein and selection-type groups of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

xTrimoPGLM-100B-int4: ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 75, row 'xTrimoPGLM-100B-int4', column 'Depth_3'
Configuration: xTrimoPGLM-100B-int4 [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.232 Spearman (ProteinGym zero-shot DMS substitutions, variants with 4 substitutions: mean over protein and selection-type groups of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

xTrimoPGLM-100B-int4: ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 75, row 'xTrimoPGLM-100B-int4', column 'Depth_4'
Configuration: xTrimoPGLM-100B-int4 [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.313 Spearman (ProteinGym zero-shot DMS substitutions, variants with 5 or more substitutions: mean over protein and selection-type groups of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

xTrimoPGLM-100B-int4: ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 75, row 'xTrimoPGLM-100B-int4', column 'Depth_5+'
Configuration: xTrimoPGLM-100B-int4 [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.378 Spearman (ProteinGym zero-shot DMS substitutions, Activity assays: mean over proteins of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

xTrimoPGLM-100B-int4: ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 75, row 'xTrimoPGLM-100B-int4', column 'Function_Activity'
Configuration: xTrimoPGLM-100B-int4 [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.259 Spearman (ProteinGym zero-shot DMS substitutions, Binding assays: mean over proteins of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

xTrimoPGLM-100B-int4: ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 75, row 'xTrimoPGLM-100B-int4', column 'Function_Binding'
Configuration: xTrimoPGLM-100B-int4 [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.38 Spearman (ProteinGym zero-shot DMS substitutions, Expression assays: mean over proteins of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

xTrimoPGLM-100B-int4: ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 75, row 'xTrimoPGLM-100B-int4', column 'Function_Expression'
Configuration: xTrimoPGLM-100B-int4 [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.355 Spearman (ProteinGym zero-shot DMS substitutions, Organismal fitness assays: mean over proteins of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

xTrimoPGLM-100B-int4: ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 75, row 'xTrimoPGLM-100B-int4', column 'Function_OrganismalFitness'
Configuration: xTrimoPGLM-100B-int4 [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.45 Spearman (ProteinGym zero-shot DMS substitutions, Stability assays: mean over proteins of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

xTrimoPGLM-100B-int4: ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 75, row 'xTrimoPGLM-100B-int4', column 'Function_Stability'
Configuration: xTrimoPGLM-100B-int4 [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.43 Spearman (ProteinGym zero-shot DMS substitutions, High MSA depth proteins: mean over proteins of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

xTrimoPGLM-100B-int4: ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 75, row 'xTrimoPGLM-100B-int4', column 'High_MSA_depth'
Configuration: xTrimoPGLM-100B-int4 [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.314 Spearman (ProteinGym zero-shot DMS substitutions, Low MSA depth proteins: mean over proteins of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

xTrimoPGLM-100B-int4: ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 75, row 'xTrimoPGLM-100B-int4', column 'Low_MSA_depth'
Configuration: xTrimoPGLM-100B-int4 [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.391 Spearman (ProteinGym zero-shot DMS substitutions, Medium MSA depth proteins: mean over proteins of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

xTrimoPGLM-100B-int4: ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 75, row 'xTrimoPGLM-100B-int4', column 'Medium_MSA_depth'
Configuration: xTrimoPGLM-100B-int4 [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.363 Spearman (ProteinGym zero-shot DMS substitutions, Human proteins: mean over proteins of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

xTrimoPGLM-100B-int4: ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 75, row 'xTrimoPGLM-100B-int4', column 'Taxa_Human'
Configuration: xTrimoPGLM-100B-int4 [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.45 Spearman (ProteinGym zero-shot DMS substitutions, Other eukaryote proteins: mean over proteins of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

xTrimoPGLM-100B-int4: ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 75, row 'xTrimoPGLM-100B-int4', column 'Taxa_Other_Eukaryote'
Configuration: xTrimoPGLM-100B-int4 [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.422 Spearman (ProteinGym zero-shot DMS substitutions, Prokaryote proteins: mean over proteins of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

xTrimoPGLM-100B-int4: ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 75, row 'xTrimoPGLM-100B-int4', column 'Taxa_Prokaryote'
Configuration: xTrimoPGLM-100B-int4 [ProteinGym 144fe22b snapshot]Protocol: ProteinGym v1.3 zero-shot DMS substitutions
Dataset subset: ProteinGym DMS substitution assays at commit 144fe22 (217 assays)
0.36 Spearman (ProteinGym zero-shot DMS substitutions, Virus proteins: mean over proteins of assay-level Spearman)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Evaluation origin not reported · Source checked
Methods, coverage and source

xTrimoPGLM-100B-int4: ProteinGym zero-shot DMS substitutions summary (144fe22)

ProteinGym zero-shot DMS substitutions, Spearman summary

Aggregation: Not reported

ProteinGym zero-shot DMS substitutions Spearman summary at commit 144fe22 · benchmarks/DMS_zero_shot/substitutions/Spearman/Summary_performance_DMS_substitutions_Spearman.csv line 75, row 'xTrimoPGLM-100B-int4', column 'Taxa_Virus'

Source checking is not independent reproduction. Release 2026-10-22-1b7cf027e4f6.

Use this model

How it works, versions and access

Versions and evaluated configurations

Strengths, limitations and unresolved questions

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

3 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-10-22-1b7cf027e4f6
Property and statementOriginal source and locationReview and provenance
Description
Family of protein language models, scaled up to 100 billion parameters, pretrained jointly with autoencoding and autoregressive objectives for protein understanding and generation; ProteinGym scores several sizes as zero-shot single-sequence substitution baselines.
Individual claims
Abstract: xTrimoPGLM: unified 100-billion-parameter pretrained transformer for deciphering the language of proteins

Original source ↗

uc20260930-source-proteingym-amfr-spearman: Benchmark CSV header (model scored in the zero-shot DMS substitution benchmark); run-doc-proteingym-readme-md-144fe22b: README 'Leaderboard' baseline table (model name, input modalities, reference); qa-descriptions-20261010-source-xtrimopglm: abstract

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Europe PMC core record MED/40181110 (title and abstract), Nature methods 2025
Retrieved: 2026-10-10T06:44:12Z

source checked

["automated-source-review","ai-assisted-source-review"] · 2026-10-10

Audit details

Description written from the cited source text; provenance text was generic and is kept here as previous_value. Independent review 2026-10-10: corrected. The record's locator is the xTrimoPGLM-1B-MLM column and ProteinGym scores seven xTrimoPGLM checkpoints from 1B to 100B-int4; the description no longer calls the family a 100-billion-parameter model.

Field: description

Claim: metadata-correction-ea93ee446262ea488a8b

Source artifact SHA-256: ba6635bd9dfe9b86a579b0b4fa319c776b69e6fe110039ee66a1c889e454e581

Hash scope: SHA-256 of one retrieval of a Europe PMC REST search response. The response is not byte-stable: on 2026-10-10 a second retrieval of 10 of these 31 records differed only in JSON key order and parsed to identical content. The title and abstractText fields are the evidence.

Inspected artifact

Description
Family of protein language models, scaled up to 100 billion parameters, pretrained jointly with autoencoding and autoregressive objectives for protein understanding and generation; ProteinGym scores several sizes as zero-shot single-sequence substitution baselines.
Individual claims
OATML-Markslab/ProteinGym / README.md

Original source ↗

uc20260930-source-proteingym-amfr-spearman: Benchmark CSV header (model scored in the zero-shot DMS substitution benchmark); run-doc-proteingym-readme-md-144fe22b: README 'Leaderboard' baseline table (model name, input modalities, reference); qa-descriptions-20261010-source-xtrimopglm: abstract

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Git commit 144fe22b07dfaeec2b366f2346203a9838a55b4c
Retrieved: 2026-09-17T09:32:03.517591+00:00

source checked

["automated-source-review","ai-assisted-source-review"] · 2026-10-10

Audit details

Description written from the cited source text; provenance text was generic and is kept here as previous_value. Independent review 2026-10-10: corrected. The record's locator is the xTrimoPGLM-1B-MLM column and ProteinGym scores seven xTrimoPGLM checkpoints from 1B to 100B-int4; the description no longer calls the family a 100-billion-parameter model.

Field: description

Claim: metadata-correction-ea93ee446262ea488a8b

Source artifact SHA-256: 321487a8de52c6cfa647a658f61150dd72e0acb0125470524fb94d1f8b23321a

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Description
Family of protein language models, scaled up to 100 billion parameters, pretrained jointly with autoencoding and autoregressive objectives for protein understanding and generation; ProteinGym scores several sizes as zero-shot single-sequence substitution baselines.
Individual claims
ProteinGym AMFR assay-level Spearman comparison

Original source ↗

uc20260930-source-proteingym-amfr-spearman: Benchmark CSV header (model scored in the zero-shot DMS substitution benchmark); run-doc-proteingym-readme-md-144fe22b: README 'Leaderboard' baseline table (model name, input modalities, reference); qa-descriptions-20261010-source-xtrimopglm: abstract

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c
Retrieved: 2026-09-30

source checked

["automated-source-review","ai-assisted-source-review"] · 2026-10-10

Audit details

Description written from the cited source text; provenance text was generic and is kept here as previous_value. Independent review 2026-10-10: corrected. The record's locator is the xTrimoPGLM-1B-MLM column and ProteinGym scores seven xTrimoPGLM checkpoints from 1B to 100B-int4; the description no longer calls the family a 100-billion-parameter model.

Field: description

Claim: metadata-correction-ea93ee446262ea488a8b

Source artifact SHA-256: f432423b87f79ac9778dfac86e3d95be041d246bc618dc0a406b35b0b7466437

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Sources and history

Release 2026-10-22-1b7cf027e4f6 · Record review: source checked

3 source records and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: uc20260930-model-xtrimopglm

areas
proteins-complexes
source locator
Pinned ProteinGym Spearman CSV header: xTrimoPGLM-1B-MLM
review
method: automated-source-review; reviewer: codex; reviewed at: 2026-09-30T21:40:59.576893+00:00; scope: Primary-source transcription and catalogue applicability audit; not human scientific review or independent experimental reproduction.; reviewer note: role: experimental use-case curation
entity level
family
identity scope
Family/method identity only; no undocumented checkpoint equivalence.
Related records

Suggest a correction