rewirebio.iobenchmarks
Protocol

Predictive-class counts for monomeric predictions, all structures in the class (Table 1, column 'No.')

Monomer predictions were compared with the experimental structure by RMSD and LDDT and assigned to one of four predictive classes: accurate prediction (RMSD <= 3.0 Angstrom and LDDT >= 0.7), correct with domain movement (RMSD > 3.0 Angstrom and LDDT >= 0.7), incorrect prediction (RMSD > 3.0 Angstrom and LDDT < 0.7) and special cases (LDDT < 0.7 and RMSD < 3.0 Angstrom). This protocol counts, for each class, all structures in the class.

3 evaluations · 12 results

Overview

An explanatory profile has not yet been reviewed for this record.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

3 recorded evaluations, 12 metric rows. A comparison chart has not yet been validated for these results. The table retains the individual findings and their sources.

View coverage and remaining gaps across all benchmarks

Results

Results are available, but no reviewed comparison panel is linked in this release.

All evaluations

3 evaluations · 12 results. Different protocols are not a single leaderboard.

Protocol: Predictive-class counts for monomeric predictions, all structures in the class (Table 1, column 'No.') · Dataset: 1666 non-redundant monomeric PDB structures (2022-2024)

In source order. Decimals are rounded for display; each value links to the printed value and its source.

Tested configurationCount (Accurate prediction (RMSD <= 3.0 Angstrom and LDDT >= 0.7); all structures in the class)Count (Domain movement (RMSD > 3.0 Angstrom and LDDT >= 0.7 (correct folds, different domain arrangement)); all structures in the class)Count (Incorrect prediction (RMSD > 3.0 Angstrom and LDDT < 0.7); all structures in the class)Count (Special cases (LDDT < 0.7 and RMSD < 3.0 Angstrom); all structures in the class)
AlphaFold2 (AlphaFold2 v2.2.3 installed locally; five models per sequence)Evaluation106938620011
AlphaFold3 (AlphaFold3 accessed as a web service)Evaluation107638819111
ESMFold (ESMFold installed locally from its GitHub repository)Evaluation83243039113
All 12 result rows with coverage, uncertainty and sources
Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: AlphaFold2 (AlphaFold2 v2.2.3 installed locally; five models per sequence)Protocol: Predictive-class counts for monomeric predictions, all structures in the class (Table 1, column 'No.')
Dataset: 1666 non-redundant monomeric PDB structures (2022-2024)
1070 Count (Accurate prediction (RMSD <= 3.0 Angstrom and LDDT >= 0.7); all structures in the class)
count · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

AlphaFold2 monomeric predictive-class counts, all structures in the class (Table 1)

lit-structure-20261011-afesmfold-protocol-1-no

Aggregation: Not reported

Comparative evaluation of the prediction accuracy of AlphaFold and ESMFold for monomeric and dimeric proteins · Table 1, row 'AlphaFold2' / 'Accurate prediction', column 'No.'
Configuration: AlphaFold2 (AlphaFold2 v2.2.3 installed locally; five models per sequence)Protocol: Predictive-class counts for monomeric predictions, all structures in the class (Table 1, column 'No.')
Dataset: 1666 non-redundant monomeric PDB structures (2022-2024)
386 Count (Domain movement (RMSD > 3.0 Angstrom and LDDT >= 0.7 (correct folds, different domain arrangement)); all structures in the class)
count · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

AlphaFold2 monomeric predictive-class counts, all structures in the class (Table 1)

lit-structure-20261011-afesmfold-protocol-1-no

Aggregation: Not reported

Comparative evaluation of the prediction accuracy of AlphaFold and ESMFold for monomeric and dimeric proteins · Table 1, row 'AlphaFold2' / 'Domain movement', column 'No.'
Configuration: AlphaFold2 (AlphaFold2 v2.2.3 installed locally; five models per sequence)Protocol: Predictive-class counts for monomeric predictions, all structures in the class (Table 1, column 'No.')
Dataset: 1666 non-redundant monomeric PDB structures (2022-2024)
200 Count (Incorrect prediction (RMSD > 3.0 Angstrom and LDDT < 0.7); all structures in the class)
count · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

AlphaFold2 monomeric predictive-class counts, all structures in the class (Table 1)

lit-structure-20261011-afesmfold-protocol-1-no

Aggregation: Not reported

Comparative evaluation of the prediction accuracy of AlphaFold and ESMFold for monomeric and dimeric proteins · Table 1, row 'AlphaFold2' / 'Incorrect prediction', column 'No.'
Configuration: AlphaFold2 (AlphaFold2 v2.2.3 installed locally; five models per sequence)Protocol: Predictive-class counts for monomeric predictions, all structures in the class (Table 1, column 'No.')
Dataset: 1666 non-redundant monomeric PDB structures (2022-2024)
11 Count (Special cases (LDDT < 0.7 and RMSD < 3.0 Angstrom); all structures in the class)
count · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

AlphaFold2 monomeric predictive-class counts, all structures in the class (Table 1)

lit-structure-20261011-afesmfold-protocol-1-no

Aggregation: Not reported

Comparative evaluation of the prediction accuracy of AlphaFold and ESMFold for monomeric and dimeric proteins · Table 1, row 'AlphaFold2' / 'Special cases', column 'No.'
Configuration: AlphaFold3 (AlphaFold3 accessed as a web service)Protocol: Predictive-class counts for monomeric predictions, all structures in the class (Table 1, column 'No.')
Dataset: 1666 non-redundant monomeric PDB structures (2022-2024)
1080 Count (Accurate prediction (RMSD <= 3.0 Angstrom and LDDT >= 0.7); all structures in the class)
count · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

AlphaFold3 monomeric predictive-class counts, all structures in the class (Table 1)

lit-structure-20261011-afesmfold-protocol-1-no

Aggregation: Not reported

Comparative evaluation of the prediction accuracy of AlphaFold and ESMFold for monomeric and dimeric proteins · Table 1, row 'AlphaFold3' / 'Accurate prediction', column 'No.'
Configuration: AlphaFold3 (AlphaFold3 accessed as a web service)Protocol: Predictive-class counts for monomeric predictions, all structures in the class (Table 1, column 'No.')
Dataset: 1666 non-redundant monomeric PDB structures (2022-2024)
388 Count (Domain movement (RMSD > 3.0 Angstrom and LDDT >= 0.7 (correct folds, different domain arrangement)); all structures in the class)
count · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

AlphaFold3 monomeric predictive-class counts, all structures in the class (Table 1)

lit-structure-20261011-afesmfold-protocol-1-no

Aggregation: Not reported

Comparative evaluation of the prediction accuracy of AlphaFold and ESMFold for monomeric and dimeric proteins · Table 1, row 'AlphaFold3' / 'Domain movement', column 'No.'
Configuration: AlphaFold3 (AlphaFold3 accessed as a web service)Protocol: Predictive-class counts for monomeric predictions, all structures in the class (Table 1, column 'No.')
Dataset: 1666 non-redundant monomeric PDB structures (2022-2024)
191 Count (Incorrect prediction (RMSD > 3.0 Angstrom and LDDT < 0.7); all structures in the class)
count · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

AlphaFold3 monomeric predictive-class counts, all structures in the class (Table 1)

lit-structure-20261011-afesmfold-protocol-1-no

Aggregation: Not reported

Comparative evaluation of the prediction accuracy of AlphaFold and ESMFold for monomeric and dimeric proteins · Table 1, row 'AlphaFold3' / 'Incorrect prediction', column 'No.'
Configuration: AlphaFold3 (AlphaFold3 accessed as a web service)Protocol: Predictive-class counts for monomeric predictions, all structures in the class (Table 1, column 'No.')
Dataset: 1666 non-redundant monomeric PDB structures (2022-2024)
11 Count (Special cases (LDDT < 0.7 and RMSD < 3.0 Angstrom); all structures in the class)
count · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

AlphaFold3 monomeric predictive-class counts, all structures in the class (Table 1)

lit-structure-20261011-afesmfold-protocol-1-no

Aggregation: Not reported

Comparative evaluation of the prediction accuracy of AlphaFold and ESMFold for monomeric and dimeric proteins · Table 1, row 'AlphaFold3' / 'Special cases', column 'No.'
Configuration: ESMFold (ESMFold installed locally from its GitHub repository)Protocol: Predictive-class counts for monomeric predictions, all structures in the class (Table 1, column 'No.')
Dataset: 1666 non-redundant monomeric PDB structures (2022-2024)
832 Count (Accurate prediction (RMSD <= 3.0 Angstrom and LDDT >= 0.7); all structures in the class)
count · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

ESMFold monomeric predictive-class counts, all structures in the class (Table 1)

lit-structure-20261011-afesmfold-protocol-1-no

Aggregation: Not reported

Comparative evaluation of the prediction accuracy of AlphaFold and ESMFold for monomeric and dimeric proteins · Table 1, row 'ESMFold' / 'Accurate prediction', column 'No.'
Configuration: ESMFold (ESMFold installed locally from its GitHub repository)Protocol: Predictive-class counts for monomeric predictions, all structures in the class (Table 1, column 'No.')
Dataset: 1666 non-redundant monomeric PDB structures (2022-2024)
430 Count (Domain movement (RMSD > 3.0 Angstrom and LDDT >= 0.7 (correct folds, different domain arrangement)); all structures in the class)
count · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

ESMFold monomeric predictive-class counts, all structures in the class (Table 1)

lit-structure-20261011-afesmfold-protocol-1-no

Aggregation: Not reported

Comparative evaluation of the prediction accuracy of AlphaFold and ESMFold for monomeric and dimeric proteins · Table 1, row 'ESMFold' / 'Domain movement', column 'No.'
Configuration: ESMFold (ESMFold installed locally from its GitHub repository)Protocol: Predictive-class counts for monomeric predictions, all structures in the class (Table 1, column 'No.')
Dataset: 1666 non-redundant monomeric PDB structures (2022-2024)
391 Count (Incorrect prediction (RMSD > 3.0 Angstrom and LDDT < 0.7); all structures in the class)
count · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

ESMFold monomeric predictive-class counts, all structures in the class (Table 1)

lit-structure-20261011-afesmfold-protocol-1-no

Aggregation: Not reported

Comparative evaluation of the prediction accuracy of AlphaFold and ESMFold for monomeric and dimeric proteins · Table 1, row 'ESMFold' / 'Incorrect prediction', column 'No.'
Configuration: ESMFold (ESMFold installed locally from its GitHub repository)Protocol: Predictive-class counts for monomeric predictions, all structures in the class (Table 1, column 'No.')
Dataset: 1666 non-redundant monomeric PDB structures (2022-2024)
13 Count (Special cases (LDDT < 0.7 and RMSD < 3.0 Angstrom); all structures in the class)
count · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

ESMFold monomeric predictive-class counts, all structures in the class (Table 1)

lit-structure-20261011-afesmfold-protocol-1-no

Aggregation: Not reported

Comparative evaluation of the prediction accuracy of AlphaFold and ESMFold for monomeric and dimeric proteins · Table 1, row 'ESMFold' / 'Special cases', column 'No.'

Source checking is not independent reproduction. Release 2026-10-22-1b7cf027e4f6.

Methods and evaluation design

Procedure, tasks and evaluated configurations

Recorded evaluations

Each evaluation records what was tested and under which conditions.

Baseline coverage

Reference methods help show what a model adds beyond simple controls. We track a null control and a conventional method for each protocol.

0 of 2 active baseline roles have published Rewire measurements in this release. Measurements on a selected protocol do not establish coverage of an entire suite.

No execution recipe linked to this protocol. Recipe availability does not establish a completed evaluation.

External evaluations
3

Literature evidence is not a Rewire measurement. Executed but unpublished runs and private review status are not included.

Null control

Proposed control: requires review

Protocol-specific valid geometric or structural control

Protocol-specific applicability, permitted inputs, access, split, evaluator and execution requirements need review before implementation or execution.

This is a suggested selection rule, not a validated method or a measured score.

Conventional reference

Proposed control: requires review

Upstream conventional structural reference with matched templates and cutoffs

Protocol-specific applicability, permitted inputs, access, split, evaluator and execution requirements need review before implementation or execution.

This is a suggested selection rule, not a validated method or a measured score.

Protocol coverage CSV (gzip) · Model evaluation matrix (gzip) · Source table (gzip) · Release and checksums (gzip)

Coverage is derived from release 2026-10-22-1b7cf027e4f6. Source citations describe the original records; they do not validate an unreviewed baseline proposal. No results have been generated by this audit.

Run instructions

No runnable recipe has been reviewed for this protocol. Dataset access, model requirements, licences and compute requirements must be checked against its sources before execution.

Strengths, limitations and unresolved questions

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-10-22-1b7cf027e4f6
Property and statementOriginal source and locationReview and provenance

No evidence rows match these filters. Choose another scope or clear the search.

Sources and history

Release 2026-10-22-1b7cf027e4f6 · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: lit-structure-20261011-afesmfold-protocol-1-no

areas
protein-structure; proteins-complexes
contexts
research
protocol
Monomer predictions were compared with the experimental structure by RMSD and LDDT and assigned to one of four predictive classes: accurate prediction (RMSD <= 3.0 Angstrom and LDDT >= 0.7), correct with domain movement (RMSD > 3.0 Angstrom and LDDT >= 0.7), incorrect prediction (RMSD > 3.0 Angstrom and LDDT < 0.7) and special cases (LDDT < 0.7 and RMSD < 3.0 Angstrom).
metric
count
metric direction
unknown
unit
count
unit detail
predicted structures
metric qualifier
all structures in the class
version
As published 2026
source locator
Table 1, column 'No.'; Materials and methods (classification thresholds)
limitations
Counts per class, not a single accuracy score.; Template quality is defined in the text as sequence identity multiplied by query coverage.
Related records

Suggest a correction