Benchmark

CASP

CASP assesses structure-prediction methods through blind predictions and category-specific evaluation.

Sources

casp official source · Protein Structure Prediction Center homepage: Welcome; assessment and archived-data description

90 evaluations · 270 results

Overview

Datasets

Experiment-specific targets, submissions and numerical assessment files are archived by the Prediction Center.

Sources

casp official source · Protein Structure Prediction Center homepage: Welcome; assessment and archived-data description

Metrics

CASP16 monomer assessment combines standardized GDT_HA, QSE, reLLG_const, SphGr, CAD_AA, GDC_SC, AL0_P, lDDT and MolProbity measures. These scores apply to its defined evaluation units; other CASP categories use different protocols.

Sources

casp16 primary benchmark evidence · Monomer assessment: scoring formula and Methods

Allowed inputs

Sequence and target information issued for the selected experiment.

Sources

casp official source · Protein Structure Prediction Center homepage: Welcome; assessment and archived-data description

Evaluation procedure diagram

How it worksEvaluation procedure

Conceptual procedure. Task variants and protocol versions retain their separate scoring conditions.

Sources (2)

casp official source; casp16 primary benchmark evidence · Protein Structure Prediction Center homepage: Welcome; assessment and archived-data description; Monomer assessment: scoring formula and Methods

Source reviewed · Automated source review, 2026-09-16. All specifications and missing details

Results

Each comparison retains its reviewed evaluation scope, dataset and metric. Results are shown without a pooled ranking.

Evaluation scope and datasetMetric and reported setup

CASP16 protein domain; first submitted model; T1201-D1 · CASP16 T1201-D1: GDT_TS (source entries 1–80 of 90)

GDT_TS (score_0_100) · Higher values are better.

CASP16 protein domain; first submitted model; T1201-D1 · CASP16 T1201-D1 · CASP16 T1201-D1

Evidence origin: Independent external evaluation.

CASP: CASP16, snapshot 2026-09-19 · line 8286; Model=T1201TS191_1-D1; column GDT_TS through line 8649; Model=T1201TS269_1-D1; column GDT_TS

Missing source cells and quarantined conflicts are recorded in acquisition and audit tables. Per-result scoring denominators may be unreported.

Comparison details and limitations

Complete selected source table is retained across source-order panels. These point estimates do not establish statistical significance or a universal ranking.

Source-specific evaluation. No equivalence to other releases, protocols or model families is inferred.
Exact source-defined evaluation scope; reported scores are not rewire reproductions.

Automated source review: 2026-09-19. Numerical source review does not establish independent reproduction.

Dots show point estimates. Whiskers show only explicitly defined uncertainty (standard deviation, standard error or a labelled interval); their definitions remain in Table. Unresolved uncertainty is not plotted. Differences do not establish statistical significance.

Find a tested model or method

Showing 12 of 80 matching rows.

Zoom to observed range

Tested configuration

0255075100

Reported score

Methods and evaluation design

Procedure, tasks and evaluated configurations

How it works

Evaluation methodology

CASP evaluates predictions against experimentally determined structures withheld at submission time. Its independent assessors define evaluation units and category-specific scores. In CASP16 monomer assessment, controlled MSA inputs and automated ColabFold references help distinguish pipeline contributions from differences in information supplied.

Sources

casp16 primary benchmark evidence · CASP16 monomer assessment: Evaluation of Model 6, model sampling and head-to-head comparisons; Methods

Evaluation design

Benchmarks bring together tasks and protocols. A task describes the biological question; a protocol defines a particular test.

Protocols

CASP16 protein domain; first submitted model; T1201-D1 · CASP16 T1201-D1

These source-backed links do not make different protocols or scores interchangeable.

Baseline coverage

Reference methods help show what a model adds beyond simple controls. We track a null control and a conventional method for each protocol.

0 of 2 active baseline roles have published Rewire measurements in this release. Measurements on a selected protocol do not establish coverage of an entire suite.

Baseline status by linked protocol

CASP16 protein domain; first submitted model; T1201-D1 · CASP16 T1201-D1 · 0/2 roles measured

Protocol coverage CSV · Model evaluation matrix · Source table · Release and checksums

Coverage is derived from release 2026-09-29-06401fd5b220. Source citations describe the original records; they do not validate an unreviewed baseline proposal. No results have been generated by this audit.

Run this benchmark

Choose a concrete protocol before running an evaluation. Its inputs, split and scoring rules determine which results can be compared.

CASP16 protein domain; first submitted model; T1201-D1 · CASP16 T1201-D1

Run this benchmark

The official Prediction Center identifies CASP as a series of structure-prediction experiments. A reproducible run requires an edition, target set, category and associated assessment software; the general landing page is not a local run recipe.

A maintained rewire runner has not been verified for this benchmark. Check data access, weights, licences, dependencies and hardware in the linked official documentation; requirements have not been fully extracted.

casp official run documentation · Prediction Center official landing page and experiment navigation

Strengths, limitations and unresolved questions

Strengths and limitations

Strengths supported by sources

Archived targets, submissions and assessment files support round-specific comparisons.
Sources
casp official source · Protein Structure Prediction Center homepage: Welcome; assessment and archived-data description

Limitations and conditions

CASP rounds and categories differ in targets, allowed information and scoring. Domain-level, whole-complex and nucleic-acid results cannot be pooled as interchangeable observations.
Sources
casp16 primary benchmark evidence · CASP16 monomer assessment: Evaluation of Model 6, model sampling and head-to-head comparisons; Methods

Profile review details

Primary paper and/or task implementation reviewed for the explicitly cited methodology claims. Scope-limited absence is recorded only after the documented source search; no model runs or independent reproduction.

Stable record: discovery-benchmark-casp

Specifications

Inputs, training, access and other details

Explanatory profile: source reviewed · Automated source review, 2026-09-16. Review applies to the cited claims; unresolved fields are listed below. Numerical results retain their own review status.

Data, procedure and scoring
Property	Description and evidence
Datasets	Experiment-specific targets, submissions and numerical assessment files are archived by the Prediction Center. Sources casp official source · Protein Structure Prediction Center homepage: Welcome; assessment and archived-data description
Splits	Blind prediction tasks are organized by assessment edition and category. Sources casp official source · Protein Structure Prediction Center homepage: Welcome; assessment and archived-data description
Metrics	CASP16 monomer assessment combines standardized GDT_HA, QSE, reLLG_const, SphGr, CAD_AA, GDC_SC, AL0_P, lDDT and MolProbity measures. These scores apply to its defined evaluation units; other CASP categories use different protocols. Sources casp16 primary benchmark evidence · Monomer assessment: scoring formula and Methods
Baselines	CASP16 monomer assessment uses ColabFold as an automated reference, includes MassiveFold sampling, and compares models constrained to the same ColabFold MSAs to separate input improvements from prediction-network changes. Sources casp16 primary benchmark evidence · CASP16 monomer assessment: Evaluation of Model 6, model sampling and head-to-head comparisons; Methods
Leakage controls	The blind-target setting is explicit; exact training-cutoff enforcement and template restrictions depend on the category. Sources casp official source · Protein Structure Prediction Center homepage: Welcome; assessment and archived-data description
Uncertainty	CASP16 monomer head-to-head comparisons use 1,000 bootstrap samples of evaluation units. This protocol is category- and round-specific; it is not a confidence interval for every CASP result. Sources casp16 primary benchmark evidence · CASP16 monomer assessment: Evaluation of Model 6, model sampling and head-to-head comparisons; Methods
Entity type	Community protein-structure prediction experiment. Sources casp official source · Protein Structure Prediction Center homepage: Welcome; assessment and archived-data description
Organisms	Target-dependent proteins and complexes. Sources casp official source · Protein Structure Prediction Center homepage: Welcome; assessment and archived-data description
Assays	Experiment-specific experimentally determined structures. Sources casp official source · Protein Structure Prediction Center homepage: Welcome; assessment and archived-data description
Allowed inputs	Sequence and target information issued for the selected experiment. Sources casp official source · Protein Structure Prediction Center homepage: Welcome; assessment and archived-data description
Adaptation	Prediction and assessment phases are separated; rules vary by target category and experiment. Sources casp official source · Protein Structure Prediction Center homepage: Welcome; assessment and archived-data description

Applicable tests and references

Applicability is distinct from a completed evaluation.

ColabFold · Proposed association
OpenFold · Proposed association

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Papers and result coverage

Last literature check: 2026-09-17. Dated primary-source discovery and protocol/table screening. Source checking does not mean experimental reproduction. Only separately extracted and independently reviewed numeric batches are publishable.

Paper or primary resource	Version	Reference
CASP16 Protein Monomer Structure Prediction Assessment	Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256	Read source

Historical gaps recorded on 2026-09-17

The catalogue now holds 270 result rows for this benchmark. A note below about pending extraction describes the state on 2026-09-17 and may since have been answered by a later batch. The result rows and their sources are the current record.

complete comparable numeric result batch: Specific candidate tables and protocol boundaries are documented; no graph values or incomplete winner-only selection are converted into publishable rows.

Search and extraction details

primary protocol reviewed

Searches

CASP16 assessment protein structure prediction 2025 PMC12750037

Evidence locations

CASP16 monomer assessment §2.4 Figures 4A–B; §2.6 Figure 6; Data Availability

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

21 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-09-29-06401fd5b220
Property and statement	Original source and location	Review and provenance
Diagram caption Conceptual procedure. Task variants and protocol versions retain their separate scoring conditions. Individual claims	casp official source Original source ↗ Protein Structure Prediction Center homepage: Welcome; assessment and archived-data description; Monomer assessment: scoring formula and Methods Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: Retrieved website snapshot sha256:de391b68636462ddb78d0659d8784128909d23e9c015832cca94d883f404a3f7 Retrieved: 2026-09-16T10:31:54.981498+00:00	source checked automated source review · 2026-09-16 Audit details Primary paper and/or task implementation reviewed for the explicitly cited methodology claims. Scope-limited absence is recorded only after the documented source search; no model runs or independent reproduction. Field: `attributes.profile.diagram.caption` Source artifact SHA-256: `de391b68636462ddb78d0659d8784128909d23e9c015832cca94d883f404a3f7` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Diagram caption Conceptual procedure. Task variants and protocol versions retain their separate scoring conditions. Individual claims	casp16 primary benchmark evidence Original source ↗ Protein Structure Prediction Center homepage: Welcome; assessment and archived-data description; Monomer assessment: scoring formula and Methods Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: PMC12750037 Retrieved: 2026-09-16T21:11:45.148220+00:00	source checked automated source review · 2026-09-16 Audit details Primary paper and/or task implementation reviewed for the explicitly cited methodology claims. Scope-limited absence is recorded only after the documented source search; no model runs or independent reproduction. Field: `attributes.profile.diagram.caption` Source artifact SHA-256: `32ef3bdfac658a0191e2939699b68e23dcaf465568c5d1c9f75743e886bd76cc` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Diagram steps Allowed inputs: Sequence and target information issued for the selected experiment. Splits: Blind prediction tasks are organized by assessment edition and category. Metrics: CASP16 monomer assessment combines standardized GDT_HA, QSE, reLLG_const, SphGr, CAD_AA, GDC_SC, AL0_P, lDDT and MolProbity measures. These scores apply to its defined evaluation units; other CASP categories use different protocols. Individual claims	casp official source Original source ↗ Protein Structure Prediction Center homepage: Welcome; assessment and archived-data description; Monomer assessment: scoring formula and Methods Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: Retrieved website snapshot sha256:de391b68636462ddb78d0659d8784128909d23e9c015832cca94d883f404a3f7 Retrieved: 2026-09-16T10:31:54.981498+00:00	source checked automated source review · 2026-09-16 Audit details Primary paper and/or task implementation reviewed for the explicitly cited methodology claims. Scope-limited absence is recorded only after the documented source search; no model runs or independent reproduction. Field: `attributes.profile.diagram.steps` Source artifact SHA-256: `de391b68636462ddb78d0659d8784128909d23e9c015832cca94d883f404a3f7` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Diagram steps Allowed inputs: Sequence and target information issued for the selected experiment. Splits: Blind prediction tasks are organized by assessment edition and category. Metrics: CASP16 monomer assessment combines standardized GDT_HA, QSE, reLLG_const, SphGr, CAD_AA, GDC_SC, AL0_P, lDDT and MolProbity measures. These scores apply to its defined evaluation units; other CASP categories use different protocols. Individual claims	casp16 primary benchmark evidence Original source ↗ Protein Structure Prediction Center homepage: Welcome; assessment and archived-data description; Monomer assessment: scoring formula and Methods Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: PMC12750037 Retrieved: 2026-09-16T21:11:45.148220+00:00	source checked automated source review · 2026-09-16 Audit details Primary paper and/or task implementation reviewed for the explicitly cited methodology claims. Scope-limited absence is recorded only after the documented source search; no model runs or independent reproduction. Field: `attributes.profile.diagram.steps` Source artifact SHA-256: `32ef3bdfac658a0191e2939699b68e23dcaf465568c5d1c9f75743e886bd76cc` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Diagram title Evaluation procedure Individual claims	casp official source Original source ↗ Protein Structure Prediction Center homepage: Welcome; assessment and archived-data description; Monomer assessment: scoring formula and Methods Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: Retrieved website snapshot sha256:de391b68636462ddb78d0659d8784128909d23e9c015832cca94d883f404a3f7 Retrieved: 2026-09-16T10:31:54.981498+00:00	source checked automated source review · 2026-09-16 Audit details Primary paper and/or task implementation reviewed for the explicitly cited methodology claims. Scope-limited absence is recorded only after the documented source search; no model runs or independent reproduction. Field: `attributes.profile.diagram.title` Source artifact SHA-256: `de391b68636462ddb78d0659d8784128909d23e9c015832cca94d883f404a3f7` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Diagram title Evaluation procedure Individual claims	casp16 primary benchmark evidence Original source ↗ Protein Structure Prediction Center homepage: Welcome; assessment and archived-data description; Monomer assessment: scoring formula and Methods Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: PMC12750037 Retrieved: 2026-09-16T21:11:45.148220+00:00	source checked automated source review · 2026-09-16 Audit details Primary paper and/or task implementation reviewed for the explicitly cited methodology claims. Scope-limited absence is recorded only after the documented source search; no model runs or independent reproduction. Field: `attributes.profile.diagram.title` Source artifact SHA-256: `32ef3bdfac658a0191e2939699b68e23dcaf465568c5d1c9f75743e886bd76cc` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Datasets Experiment-specific targets, submissions and numerical assessment files are archived by the Prediction Center. Individual claims	casp official source Original source ↗ Protein Structure Prediction Center homepage: Welcome; assessment and archived-data description Version: Retrieved website snapshot sha256:de391b68636462ddb78d0659d8784128909d23e9c015832cca94d883f404a3f7 Retrieved: 2026-09-16T10:31:54.981498+00:00	source checked automated source review · 2026-09-16 Audit details Primary paper and/or task implementation reviewed for the explicitly cited methodology claims. Scope-limited absence is recorded only after the documented source search; no model runs or independent reproduction. Field: `attributes.profile.facts.0.value` Source artifact SHA-256: `de391b68636462ddb78d0659d8784128909d23e9c015832cca94d883f404a3f7` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Splits Blind prediction tasks are organized by assessment edition and category. Individual claims	casp official source Original source ↗ Protein Structure Prediction Center homepage: Welcome; assessment and archived-data description Version: Retrieved website snapshot sha256:de391b68636462ddb78d0659d8784128909d23e9c015832cca94d883f404a3f7 Retrieved: 2026-09-16T10:31:54.981498+00:00	source checked automated source review · 2026-09-16 Audit details Primary paper and/or task implementation reviewed for the explicitly cited methodology claims. Scope-limited absence is recorded only after the documented source search; no model runs or independent reproduction. Field: `attributes.profile.facts.1.value` Source artifact SHA-256: `de391b68636462ddb78d0659d8784128909d23e9c015832cca94d883f404a3f7` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Adaptation Prediction and assessment phases are separated; rules vary by target category and experiment. Individual claims	casp official source Original source ↗ Protein Structure Prediction Center homepage: Welcome; assessment and archived-data description Version: Retrieved website snapshot sha256:de391b68636462ddb78d0659d8784128909d23e9c015832cca94d883f404a3f7 Retrieved: 2026-09-16T10:31:54.981498+00:00	source checked automated source review · 2026-09-16 Audit details Primary paper and/or task implementation reviewed for the explicitly cited methodology claims. Scope-limited absence is recorded only after the documented source search; no model runs or independent reproduction. Field: `attributes.profile.facts.10.value` Source artifact SHA-256: `de391b68636462ddb78d0659d8784128909d23e9c015832cca94d883f404a3f7` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Metrics CASP16 monomer assessment combines standardized GDT_HA, QSE, reLLG_const, SphGr, CAD_AA, GDC_SC, AL0_P, lDDT and MolProbity measures. These scores apply to its defined evaluation units; other CASP categories use different protocols. Individual claims	casp16 primary benchmark evidence Original source ↗ Monomer assessment: scoring formula and Methods Version: PMC12750037 Retrieved: 2026-09-16T21:11:45.148220+00:00	source checked automated source review · 2026-09-16 Audit details Primary paper and/or task implementation reviewed for the explicitly cited methodology claims. Scope-limited absence is recorded only after the documented source search; no model runs or independent reproduction. Field: `attributes.profile.facts.2.value` Source artifact SHA-256: `32ef3bdfac658a0191e2939699b68e23dcaf465568c5d1c9f75743e886bd76cc` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact

All evidence (CSV)All evidence (JSONL)How to read the evidence

Sources and history

View linked audit checks and correction history

Release 2026-09-29-06401fd5b220 · Record review: discovered

5 source records and release history

casp official source · Original source · Not reported
CASP16 Protein Monomer Structure Prediction Assessment · Original source · Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256
casp official source · Original source · Retrieved website snapshot sha256:de391b68636462ddb78d0659d8784128909d23e9c015832cca94d883f404a3f7
casp official run documentation · Original source · Official documentation snapshot 2026-09-17; mutable website
casp16 primary benchmark evidence · Original source · PMC12750037

Download this release

Technical metadata and extraction receipts

Stable ID: discovery-benchmark-casp

areas: protein-structure
entity level: challenge
scope note: Specialist molecular or omics evaluation; protocol details require review before numerical comparison.
task: Community protein structure assessment
version: Not reported
benchmark research: review date: 2026-09-17; status: primary_protocol_reviewed; primary sources: evidence-expansion-casp16-32ef3bdf; inspected locators: CASP16 monomer assessment §2.4 Figures 4A–B; §2.6 Figure 6; Data Availability; searched queries: CASP16 assessment protein structure prediction 2025 PMC12750037; gaps: complete comparable numeric result batch: Specific candidate tables and protocol boundaries are documented; no graph values or incomplete winner-only selection are converted into publishable rows.; claim scope: Dated primary-source discovery and protocol/table screening. Source checking does not mean experimental reproduction. Only separately extracted and independently reviewed numeric batches are publishable.
historical missing metadata: dataset release: unextracted; metric implementation: unextracted; split manifest: unextracted; version: unextracted
metadata review scope: historical_missing_metadata preserves the original discovery state. Current descriptive evidence and missingness are recorded in profile.facts; numerical-result review is separate.
entity classification: review date: 2026-09-17; rationale: The cited profile describes an organized challenge with category- or round-specific evaluation rules; retain it as a top-level benchmark, without conflating different editions or protocols.; source ids: evidence-benchmark-casp-snapshot; source locator: Protein Structure Prediction Center homepage: Welcome; assessment and archived-data description; ambiguities: None recorded
run documentation: record id: discovery-benchmark-casp; source ids: run-doc-casp-official-20260917; status: official_documentation_linked; summary: The official Prediction Center identifies CASP as a series of structure-prediction experiments. A reproducible run requires an edition, target set, category and associated assessment software; the general landing page is not a local run recipe.; source locator: Prediction Center official landing page and experiment navigation

Related records

part of: CASP16 protein domain; first submitted model; T1201-D1 · CASP16 T1201-D1
applicable to: ColabFold
applicable to: OpenFold

Suggest a correction