rewirebio.iobenchmarks
Configuration

ProteinMPNN grouped (HyInv report)

ProteinMPNN with grouped autoregressive decoding at temperature 0.1.

40 evaluations · 40 results

Overview

An explanatory profile has not yet been reviewed for this record.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Model Capabilities & Hardware Requirements

Deployment facts recorded for ProteinMPNN grouped (HyInv report). Fields the record does not carry are marked not recorded.

ParametersNot recorded
Minimum VRAMNot recorded
Inference LatencyNot recorded
Context WindowNot recorded
AccessNot recorded
LicenseNot recorded

Evaluated Checkpoint: Released weights at the published setting, as run in the HyInv technical report; no checkpoint revision printed

Evaluations and results

40 evaluations · 40 results. Different protocols are not a single leaderboard.

Sorted by lDDT (CA-only lDDT-style score without superposition, over all CA pairs below 15 Angstrom in the native structure, as the fraction whose distance error is below 0.5, 1, 2 and 4 Angstrom averaged over the four thresholds with the pairs pooled over the whole design; between 0 and 1) (higher is better). The best value in each column is highlighted. Decimals are rounded for display; each value links to the printed value and its source.

Tested configurationProtocol and datasetlDDT (CA-only lDDT-style score without superposition, over all CA pairs below 15 Angstrom in the native structure, as the fraction whose distance error is below 0.5, 1, 2 and 4 Angstrom averaged over the four thresholds with the pairs pooled over the whole design; between 0 and 1)Plddt (ESMFold2 mean per-residue confidence over valid sites on a scale from 0 to 100, averaged over the designs of a target and then over targets; from a second fold of the same sequences with the confidence head on)Scrmsd (CA RMSD between the ESMFold2 prediction of a design and the native backbone at valid sites after optimal Kabsch superposition with the residue correspondence fixed by position, averaged over the designs of a target and then over targets)Sctm (Mean TM-score of the predicted structure to the native backbone, averaged over the designs of a target and then over targets (macro-average); computed on the CA trace at valid sites, normalised by the native length and clipped at one; ESMFold2 as the structure predictor, which is also the reinforcement-learning reward of HyInv)Sctm difference (HyInv default minus the baseline, paired by chain on the same panel with shared folding randomness, printed in units of 10^-3 scTM with a 95% percentile interval; ESMFold2 as the structure predictor; the reference system is the HyInv default setting; the baseline is ProteinMPNN grouped)Sequence recovery (Fraction of valid sites at which the design carries the native residue, averaged over the designs of a target and then over targets; descriptive in this report, with weight zero in HyInv's reward and no role in checkpoint selection)Runtime (Median wall-clock time of one design request on one NVIDIA H20, 128 candidates per request with a maximum candidate batch of 32 unless the request is the 10,000-design library; the timed region excludes model loading, CUDA graph capture and kernel compilation; the backbone length is named per result; the request is 128 designs for a 402-residue backbone)Sctm (Mean TM-score of the predicted structure to the native backbone, averaged over the designs of a target and then over targets; Boltz2 as the structure predictor, with the alignment built from the designed sequence by MMseqs2 against UniRef50; RecentPDB only)Sctm (Mean TM-score of the predicted structure to the native backbone, averaged over the designs of a target and then over targets; Protenix2 as the structure predictor, with the alignment built from the designed sequence by MMseqs2 against UniRef50; RecentPDB only)Sctm difference (HyInv default minus the baseline, paired by chain on RecentPDB with shared folding randomness, printed in units of 10^-3 scTM with a 95% percentile interval; Boltz2 as the structure predictor; the reference system is the HyInv default setting; the baseline is ProteinMPNN grouped)Sctm difference (HyInv default minus the baseline, paired by chain on RecentPDB with shared folding randomness, printed in units of 10^-3 scTM with a 95% percentile interval; Protenix2 as the structure predictor; the reference system is the HyInv default setting; the baseline is ProteinMPNN grouped)Sequence diversity (Mean pairwise normalised Hamming distance between the K designs of a chain over valid sites, then a macro-average over targets; counted at valid sites for every method, because baseline sequences carry X at invalid sites and counting those as identical would lower their diversity)
ProteinMPNN grouped (HyInv report)EvaluationCA-lDDT of designed sequences under ESMFold2 (HyInv report), TS50 (50 chains)0.902 (best in column)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ProteinMPNN grouped (HyInv report)EvaluationCA-lDDT of designed sequences under ESMFold2 (HyInv report), TS500 (500 chains)0.897Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ProteinMPNN grouped (HyInv report)EvaluationCA-lDDT of designed sequences under ESMFold2 (HyInv report), RecentPDB (121 chains from 111 recent PDB entries)0.867Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ProteinMPNN grouped (HyInv report)EvaluationCA-lDDT of designed sequences under ESMFold2 (HyInv report), CATH4.2 test (1,120 chains)0.863Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ProteinMPNN grouped (HyInv report)EvaluationCA-lDDT of designed sequences under ESMFold2 (HyInv report), CATH4.3 test (1,882 chains)0.86Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ProteinMPNN grouped (HyInv report)EvaluationLatency of a design request on one NVIDIA H20 (HyInv report), Timing backbones for the HyInv inference-time measurementsNot reportedNot reportedNot reportedNot reportedNot reportedNot reported7,667 msNot reportedNot reportedNot reportedNot reportedNot reported
ProteinMPNN grouped (HyInv report)EvaluationpLDDT of ESMFold2 predictions of designed sequences (HyInv report), CATH4.2 test (1,120 chains)Not reported81.5Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ProteinMPNN grouped (HyInv report)EvaluationpLDDT of ESMFold2 predictions of designed sequences (HyInv report), CATH4.3 test (1,882 chains)Not reported81.3Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ProteinMPNN grouped (HyInv report)EvaluationpLDDT of ESMFold2 predictions of designed sequences (HyInv report), RecentPDB (121 chains from 111 recent PDB entries)Not reported84.4Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ProteinMPNN grouped (HyInv report)EvaluationpLDDT of ESMFold2 predictions of designed sequences (HyInv report), TS50 (50 chains)Not reported85.6Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ProteinMPNN grouped (HyInv report)EvaluationpLDDT of ESMFold2 predictions of designed sequences (HyInv report), TS500 (500 chains)Not reported90.2 (best in column)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ProteinMPNN grouped (HyInv report)EvaluationSelf-consistency RMSD of designed sequences under ESMFold2 (HyInv report), CATH4.2 test (1,120 chains)Not reportedNot reported3.98Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ProteinMPNN grouped (HyInv report)EvaluationSelf-consistency RMSD of designed sequences under ESMFold2 (HyInv report), CATH4.3 test (1,882 chains)Not reportedNot reported4.18Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ProteinMPNN grouped (HyInv report)EvaluationSelf-consistency RMSD of designed sequences under ESMFold2 (HyInv report), RecentPDB (121 chains from 111 recent PDB entries)Not reportedNot reported4.67Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ProteinMPNN grouped (HyInv report)EvaluationSelf-consistency RMSD of designed sequences under ESMFold2 (HyInv report), TS50 (50 chains)Not reportedNot reported2.29 (best in column)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ProteinMPNN grouped (HyInv report)EvaluationSelf-consistency RMSD of designed sequences under ESMFold2 (HyInv report), TS500 (500 chains)Not reportedNot reported4.04Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ProteinMPNN grouped (HyInv report)EvaluationscTM of designed sequences under Boltz2 (HyInv report), RecentPDB (121 chains from 111 recent PDB entries)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.86Not reportedNot reportedNot reportedNot reported
ProteinMPNN grouped (HyInv report)EvaluationPaired scTM difference from HyInv under Boltz2 (HyInv report), RecentPDB (121 chains from 111 recent PDB entries)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported+13.6 [3.5, 25.1]Not reportedNot reported
ProteinMPNN grouped (HyInv report)EvaluationPaired scTM difference from HyInv under ESMFold2 (HyInv report), CATH4.2 test (1,120 chains)Not reportedNot reportedNot reportedNot reported+11.6 [1.4, 25.9]Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ProteinMPNN grouped (HyInv report)EvaluationPaired scTM difference from HyInv under ESMFold2 (HyInv report), CATH4.3 test (1,882 chains)Not reportedNot reportedNot reportedNot reported+13.2 [2.5, 25.5]Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ProteinMPNN grouped (HyInv report)EvaluationPaired scTM difference from HyInv under ESMFold2 (HyInv report), RecentPDB (121 chains from 111 recent PDB entries)Not reportedNot reportedNot reportedNot reported+17.8 [4.7, 32.5] (best in column)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ProteinMPNN grouped (HyInv report)EvaluationPaired scTM difference from HyInv under ESMFold2 (HyInv report), TS50 (50 chains)Not reportedNot reportedNot reportedNot reported+4.5 [−17.9, 26.7]Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ProteinMPNN grouped (HyInv report)EvaluationPaired scTM difference from HyInv under ESMFold2 (HyInv report), TS500 (500 chains)Not reportedNot reportedNot reportedNot reported+4.3 [0.0, 8.4]Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ProteinMPNN grouped (HyInv report)EvaluationPaired scTM difference from HyInv under Protenix2 (HyInv report), RecentPDB (121 chains from 111 recent PDB entries)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported+14.4 [3.8, 26.3]Not reported
ProteinMPNN grouped (HyInv report)EvaluationscTM of designed sequences under ESMFold2 (HyInv report), CATH4.2 test (1,120 chains)Not reportedNot reportedNot reported0.844Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ProteinMPNN grouped (HyInv report)EvaluationscTM of designed sequences under ESMFold2 (HyInv report), CATH4.3 test (1,882 chains)Not reportedNot reportedNot reported0.827Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ProteinMPNN grouped (HyInv report)EvaluationscTM of designed sequences under ESMFold2 (HyInv report), RecentPDB (121 chains from 111 recent PDB entries)Not reportedNot reportedNot reported0.843Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ProteinMPNN grouped (HyInv report)EvaluationscTM of designed sequences under ESMFold2 (HyInv report), TS50 (50 chains)Not reportedNot reportedNot reported0.916 (best in column)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ProteinMPNN grouped (HyInv report)EvaluationscTM of designed sequences under ESMFold2 (HyInv report), TS500 (500 chains)Not reportedNot reportedNot reported0.894Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
ProteinMPNN grouped (HyInv report)EvaluationscTM of designed sequences under Protenix2 (HyInv report), RecentPDB (121 chains from 111 recent PDB entries)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.864Not reportedNot reportedNot reported
ProteinMPNN grouped (HyInv report)EvaluationSequence diversity of a design set (HyInv report), CATH4.2 test (1,120 chains)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.311
ProteinMPNN grouped (HyInv report)EvaluationSequence diversity of a design set (HyInv report), CATH4.3 test (1,882 chains)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.313
ProteinMPNN grouped (HyInv report)EvaluationSequence diversity of a design set (HyInv report), RecentPDB (121 chains from 111 recent PDB entries)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.299
ProteinMPNN grouped (HyInv report)EvaluationSequence diversity of a design set (HyInv report), TS50 (50 chains)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.278
ProteinMPNN grouped (HyInv report)EvaluationSequence diversity of a design set (HyInv report), TS500 (500 chains)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.262
ProteinMPNN grouped (HyInv report)EvaluationNative sequence recovery of designed sequences (HyInv report), CATH4.2 test (1,120 chains)Not reportedNot reportedNot reportedNot reportedNot reported0.398Not reportedNot reportedNot reportedNot reportedNot reportedNot reported
ProteinMPNN grouped (HyInv report)EvaluationNative sequence recovery of designed sequences (HyInv report), CATH4.3 test (1,882 chains)Not reportedNot reportedNot reportedNot reportedNot reported0.388Not reportedNot reportedNot reportedNot reportedNot reportedNot reported
ProteinMPNN grouped (HyInv report)EvaluationNative sequence recovery of designed sequences (HyInv report), RecentPDB (121 chains from 111 recent PDB entries)Not reportedNot reportedNot reportedNot reportedNot reported0.428Not reportedNot reportedNot reportedNot reportedNot reportedNot reported
ProteinMPNN grouped (HyInv report)EvaluationNative sequence recovery of designed sequences (HyInv report), TS50 (50 chains)Not reportedNot reportedNot reportedNot reportedNot reported0.443Not reportedNot reportedNot reportedNot reportedNot reportedNot reported
ProteinMPNN grouped (HyInv report)EvaluationNative sequence recovery of designed sequences (HyInv report), TS500 (500 chains)Not reportedNot reportedNot reportedNot reportedNot reported0.467 (best in column)Not reportedNot reportedNot reportedNot reportedNot reportedNot reported
All 40 result rows with coverage, uncertainty and sources
Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: ProteinMPNN grouped (HyInv report)Protocol: Latency of a design request on one NVIDIA H20 (HyInv report)
Dataset: Timing backbones for the HyInv inference-time measurements
7,667 ms Runtime (Median wall-clock time of one design request on one NVIDIA H20, 128 candidates per request with a maximum candidate batch of 32 unless the request is the 10,000-design library; the timed region excludes model loading, CUDA graph capture and kernel compilation; the backbone length is named per result; the request is 128 designs for a 402-residue backbone)
millisecond · lower

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

Latency of a design request for proteinmpnn-grouped on one NVIDIA H20 (HyInv report)

hyinv-20261106-protocol-design-latency-h20

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 4a, bar 'ProteinMPNN grouped', printed label (page 5 of 21)
Configuration: ProteinMPNN grouped (HyInv report)Protocol: CA-lDDT of designed sequences under ESMFold2 (HyInv report)
Dataset: CATH4.2 test (1,120 chains)
0.863 lDDT (CA-only lDDT-style score without superposition, over all CA pairs below 15 Angstrom in the native structure, as the fraction whose distance error is below 0.5, 1, 2 and 4 Angstrom averaged over the four thresholds with the pairs pooled over the whole design; between 0 and 1)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ProteinMPNN grouped on CATH4.2 test (CA-lDDT of designed sequences under ESMFold2, HyInv report)

hyinv-20261106-protocol-lddt-esmfold2

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 15, 'CA-lDDT' block, row 'ProteinMPNN grouped', column 'CATH4.2 test' (page 17 of 21)
Configuration: ProteinMPNN grouped (HyInv report)Protocol: CA-lDDT of designed sequences under ESMFold2 (HyInv report)
Dataset: CATH4.3 test (1,882 chains)
0.86 lDDT (CA-only lDDT-style score without superposition, over all CA pairs below 15 Angstrom in the native structure, as the fraction whose distance error is below 0.5, 1, 2 and 4 Angstrom averaged over the four thresholds with the pairs pooled over the whole design; between 0 and 1)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ProteinMPNN grouped on CATH4.3 test (CA-lDDT of designed sequences under ESMFold2, HyInv report)

hyinv-20261106-protocol-lddt-esmfold2

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 15, 'CA-lDDT' block, row 'ProteinMPNN grouped', column 'CATH4.3 test' (page 17 of 21)
Configuration: ProteinMPNN grouped (HyInv report)Protocol: CA-lDDT of designed sequences under ESMFold2 (HyInv report)
Dataset: RecentPDB (121 chains from 111 recent PDB entries)
0.867 lDDT (CA-only lDDT-style score without superposition, over all CA pairs below 15 Angstrom in the native structure, as the fraction whose distance error is below 0.5, 1, 2 and 4 Angstrom averaged over the four thresholds with the pairs pooled over the whole design; between 0 and 1)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ProteinMPNN grouped on RecentPDB (CA-lDDT of designed sequences under ESMFold2, HyInv report)

hyinv-20261106-protocol-lddt-esmfold2

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 15, 'CA-lDDT' block, row 'ProteinMPNN grouped', column 'RecentPDB' (page 17 of 21)
Configuration: ProteinMPNN grouped (HyInv report)Protocol: CA-lDDT of designed sequences under ESMFold2 (HyInv report)
Dataset: TS50 (50 chains)
0.902 lDDT (CA-only lDDT-style score without superposition, over all CA pairs below 15 Angstrom in the native structure, as the fraction whose distance error is below 0.5, 1, 2 and 4 Angstrom averaged over the four thresholds with the pairs pooled over the whole design; between 0 and 1)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ProteinMPNN grouped on TS50 (CA-lDDT of designed sequences under ESMFold2, HyInv report)

hyinv-20261106-protocol-lddt-esmfold2

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 15, 'CA-lDDT' block, row 'ProteinMPNN grouped', column 'TS50' (page 17 of 21)
Configuration: ProteinMPNN grouped (HyInv report)Protocol: CA-lDDT of designed sequences under ESMFold2 (HyInv report)
Dataset: TS500 (500 chains)
0.897 lDDT (CA-only lDDT-style score without superposition, over all CA pairs below 15 Angstrom in the native structure, as the fraction whose distance error is below 0.5, 1, 2 and 4 Angstrom averaged over the four thresholds with the pairs pooled over the whole design; between 0 and 1)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ProteinMPNN grouped on TS500 (CA-lDDT of designed sequences under ESMFold2, HyInv report)

hyinv-20261106-protocol-lddt-esmfold2

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 15, 'CA-lDDT' block, row 'ProteinMPNN grouped', column 'TS500' (page 17 of 21)
Configuration: ProteinMPNN grouped (HyInv report)Protocol: pLDDT of ESMFold2 predictions of designed sequences (HyInv report)
Dataset: CATH4.2 test (1,120 chains)
81.5 Plddt (ESMFold2 mean per-residue confidence over valid sites on a scale from 0 to 100, averaged over the designs of a target and then over targets; from a second fold of the same sequences with the confidence head on)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ProteinMPNN grouped on CATH4.2 test (pLDDT of ESMFold2 predictions of designed sequences, HyInv report)

hyinv-20261106-protocol-plddt-esmfold2

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 15, 'pLDDT' block, row 'ProteinMPNN grouped', column 'CATH4.2 test' (page 17 of 21)
Configuration: ProteinMPNN grouped (HyInv report)Protocol: pLDDT of ESMFold2 predictions of designed sequences (HyInv report)
Dataset: CATH4.3 test (1,882 chains)
81.3 Plddt (ESMFold2 mean per-residue confidence over valid sites on a scale from 0 to 100, averaged over the designs of a target and then over targets; from a second fold of the same sequences with the confidence head on)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ProteinMPNN grouped on CATH4.3 test (pLDDT of ESMFold2 predictions of designed sequences, HyInv report)

hyinv-20261106-protocol-plddt-esmfold2

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 15, 'pLDDT' block, row 'ProteinMPNN grouped', column 'CATH4.3 test' (page 17 of 21)
Configuration: ProteinMPNN grouped (HyInv report)Protocol: pLDDT of ESMFold2 predictions of designed sequences (HyInv report)
Dataset: RecentPDB (121 chains from 111 recent PDB entries)
84.4 Plddt (ESMFold2 mean per-residue confidence over valid sites on a scale from 0 to 100, averaged over the designs of a target and then over targets; from a second fold of the same sequences with the confidence head on)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ProteinMPNN grouped on RecentPDB (pLDDT of ESMFold2 predictions of designed sequences, HyInv report)

hyinv-20261106-protocol-plddt-esmfold2

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 15, 'pLDDT' block, row 'ProteinMPNN grouped', column 'RecentPDB' (page 17 of 21)
Configuration: ProteinMPNN grouped (HyInv report)Protocol: pLDDT of ESMFold2 predictions of designed sequences (HyInv report)
Dataset: TS50 (50 chains)
85.6 Plddt (ESMFold2 mean per-residue confidence over valid sites on a scale from 0 to 100, averaged over the designs of a target and then over targets; from a second fold of the same sequences with the confidence head on)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ProteinMPNN grouped on TS50 (pLDDT of ESMFold2 predictions of designed sequences, HyInv report)

hyinv-20261106-protocol-plddt-esmfold2

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 15, 'pLDDT' block, row 'ProteinMPNN grouped', column 'TS50' (page 17 of 21)
Configuration: ProteinMPNN grouped (HyInv report)Protocol: pLDDT of ESMFold2 predictions of designed sequences (HyInv report)
Dataset: TS500 (500 chains)
90.2 Plddt (ESMFold2 mean per-residue confidence over valid sites on a scale from 0 to 100, averaged over the designs of a target and then over targets; from a second fold of the same sequences with the confidence head on)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ProteinMPNN grouped on TS500 (pLDDT of ESMFold2 predictions of designed sequences, HyInv report)

hyinv-20261106-protocol-plddt-esmfold2

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 15, 'pLDDT' block, row 'ProteinMPNN grouped', column 'TS500' (page 17 of 21)
Configuration: ProteinMPNN grouped (HyInv report)Protocol: Self-consistency RMSD of designed sequences under ESMFold2 (HyInv report)
Dataset: CATH4.2 test (1,120 chains)
3.98 Scrmsd (CA RMSD between the ESMFold2 prediction of a design and the native backbone at valid sites after optimal Kabsch superposition with the residue correspondence fixed by position, averaged over the designs of a target and then over targets)
angstrom · lower

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ProteinMPNN grouped on CATH4.2 test (Self-consistency RMSD of designed sequences under ESMFold2, HyInv report)

hyinv-20261106-protocol-scrmsd-esmfold2

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 15, 'scRMSD' block, row 'ProteinMPNN grouped', column 'CATH4.2 test' (page 17 of 21)
Configuration: ProteinMPNN grouped (HyInv report)Protocol: Self-consistency RMSD of designed sequences under ESMFold2 (HyInv report)
Dataset: CATH4.3 test (1,882 chains)
4.18 Scrmsd (CA RMSD between the ESMFold2 prediction of a design and the native backbone at valid sites after optimal Kabsch superposition with the residue correspondence fixed by position, averaged over the designs of a target and then over targets)
angstrom · lower

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ProteinMPNN grouped on CATH4.3 test (Self-consistency RMSD of designed sequences under ESMFold2, HyInv report)

hyinv-20261106-protocol-scrmsd-esmfold2

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 15, 'scRMSD' block, row 'ProteinMPNN grouped', column 'CATH4.3 test' (page 17 of 21)
Configuration: ProteinMPNN grouped (HyInv report)Protocol: Self-consistency RMSD of designed sequences under ESMFold2 (HyInv report)
Dataset: RecentPDB (121 chains from 111 recent PDB entries)
4.67 Scrmsd (CA RMSD between the ESMFold2 prediction of a design and the native backbone at valid sites after optimal Kabsch superposition with the residue correspondence fixed by position, averaged over the designs of a target and then over targets)
angstrom · lower

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ProteinMPNN grouped on RecentPDB (Self-consistency RMSD of designed sequences under ESMFold2, HyInv report)

hyinv-20261106-protocol-scrmsd-esmfold2

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 15, 'scRMSD' block, row 'ProteinMPNN grouped', column 'RecentPDB' (page 17 of 21)
Configuration: ProteinMPNN grouped (HyInv report)Protocol: Self-consistency RMSD of designed sequences under ESMFold2 (HyInv report)
Dataset: TS50 (50 chains)
2.29 Scrmsd (CA RMSD between the ESMFold2 prediction of a design and the native backbone at valid sites after optimal Kabsch superposition with the residue correspondence fixed by position, averaged over the designs of a target and then over targets)
angstrom · lower

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ProteinMPNN grouped on TS50 (Self-consistency RMSD of designed sequences under ESMFold2, HyInv report)

hyinv-20261106-protocol-scrmsd-esmfold2

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 15, 'scRMSD' block, row 'ProteinMPNN grouped', column 'TS50' (page 17 of 21)
Configuration: ProteinMPNN grouped (HyInv report)Protocol: Self-consistency RMSD of designed sequences under ESMFold2 (HyInv report)
Dataset: TS500 (500 chains)
4.04 Scrmsd (CA RMSD between the ESMFold2 prediction of a design and the native backbone at valid sites after optimal Kabsch superposition with the residue correspondence fixed by position, averaged over the designs of a target and then over targets)
angstrom · lower

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ProteinMPNN grouped on TS500 (Self-consistency RMSD of designed sequences under ESMFold2, HyInv report)

hyinv-20261106-protocol-scrmsd-esmfold2

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 15, 'scRMSD' block, row 'ProteinMPNN grouped', column 'TS500' (page 17 of 21)
Configuration: ProteinMPNN grouped (HyInv report)Protocol: scTM of designed sequences under Boltz2 (HyInv report)
Dataset: RecentPDB (121 chains from 111 recent PDB entries)
0.86 Sctm (Mean TM-score of the predicted structure to the native backbone, averaged over the designs of a target and then over targets; Boltz2 as the structure predictor, with the alignment built from the designed sequence by MMseqs2 against UniRef50; RecentPDB only)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ProteinMPNN grouped on RecentPDB Boltz2 (scTM of designed sequences under Boltz2, HyInv report)

hyinv-20261106-protocol-sctm-boltz2

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Table 6, row 'ProteinMPNN grouped', column 'RecentPDB, Boltz2' (page 16 of 21)
Configuration: ProteinMPNN grouped (HyInv report)Protocol: Paired scTM difference from HyInv under Boltz2 (HyInv report)
Dataset: RecentPDB (121 chains from 111 recent PDB entries)
+13.6 [3.5, 25.1] Sctm difference (HyInv default minus the baseline, paired by chain on RecentPDB with shared folding randomness, printed in units of 10^-3 scTM with a 95% percentile interval; Boltz2 as the structure predictor; the reference system is the HyInv default setting; the baseline is ProteinMPNN grouped)
unitless · higher

Uncertainty: 95% CI 3.5 to 25.1. Printed in units of 10^-3 scTM, as the point estimate is. The interval excludes zero.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

HyInv minus ProteinMPNN grouped on RecentPDB Boltz2 (paired scTM difference, HyInv report)

hyinv-20261106-protocol-sctm-difference-boltz2

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Table 7, row 'ProteinMPNN grouped', column 'RecentPDB, Boltz2' (page 16 of 21)
Configuration: ProteinMPNN grouped (HyInv report)Protocol: Paired scTM difference from HyInv under ESMFold2 (HyInv report)
Dataset: CATH4.2 test (1,120 chains)
+11.6 [1.4, 25.9] Sctm difference (HyInv default minus the baseline, paired by chain on the same panel with shared folding randomness, printed in units of 10^-3 scTM with a 95% percentile interval; ESMFold2 as the structure predictor; the reference system is the HyInv default setting; the baseline is ProteinMPNN grouped)
unitless · higher

Uncertainty: 95% CI 1.4 to 25.9. Printed in units of 10^-3 scTM, as the point estimate is. The interval excludes zero.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

HyInv minus ProteinMPNN grouped on CATH4.2 test (paired scTM difference, HyInv report)

hyinv-20261106-protocol-sctm-difference-esmfold2

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Table 7, row 'ProteinMPNN grouped', column 'CATH4.2 test' (page 16 of 21)
Configuration: ProteinMPNN grouped (HyInv report)Protocol: Paired scTM difference from HyInv under ESMFold2 (HyInv report)
Dataset: CATH4.3 test (1,882 chains)
+13.2 [2.5, 25.5] Sctm difference (HyInv default minus the baseline, paired by chain on the same panel with shared folding randomness, printed in units of 10^-3 scTM with a 95% percentile interval; ESMFold2 as the structure predictor; the reference system is the HyInv default setting; the baseline is ProteinMPNN grouped)
unitless · higher

Uncertainty: 95% CI 2.5 to 25.5. Printed in units of 10^-3 scTM, as the point estimate is. The interval excludes zero.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

HyInv minus ProteinMPNN grouped on CATH4.3 test (paired scTM difference, HyInv report)

hyinv-20261106-protocol-sctm-difference-esmfold2

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Table 7, row 'ProteinMPNN grouped', column 'CATH4.3 test' (page 16 of 21)
Configuration: ProteinMPNN grouped (HyInv report)Protocol: Paired scTM difference from HyInv under ESMFold2 (HyInv report)
Dataset: RecentPDB (121 chains from 111 recent PDB entries)
+17.8 [4.7, 32.5] Sctm difference (HyInv default minus the baseline, paired by chain on the same panel with shared folding randomness, printed in units of 10^-3 scTM with a 95% percentile interval; ESMFold2 as the structure predictor; the reference system is the HyInv default setting; the baseline is ProteinMPNN grouped)
unitless · higher

Uncertainty: 95% CI 4.7 to 32.5. Printed in units of 10^-3 scTM, as the point estimate is. The interval excludes zero.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

HyInv minus ProteinMPNN grouped on RecentPDB (paired scTM difference, HyInv report)

hyinv-20261106-protocol-sctm-difference-esmfold2

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Table 7, row 'ProteinMPNN grouped', column 'RecentPDB, ESMFold2' (page 16 of 21)
Configuration: ProteinMPNN grouped (HyInv report)Protocol: Paired scTM difference from HyInv under ESMFold2 (HyInv report)
Dataset: TS50 (50 chains)
+4.5 [−17.9, 26.7] Sctm difference (HyInv default minus the baseline, paired by chain on the same panel with shared folding randomness, printed in units of 10^-3 scTM with a 95% percentile interval; ESMFold2 as the structure predictor; the reference system is the HyInv default setting; the baseline is ProteinMPNN grouped)
unitless · higher

Uncertainty: 95% CI -17.9 to 26.7. Printed in units of 10^-3 scTM, as the point estimate is. The interval includes zero.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

HyInv minus ProteinMPNN grouped on TS50 (paired scTM difference, HyInv report)

hyinv-20261106-protocol-sctm-difference-esmfold2

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Table 7, row 'ProteinMPNN grouped', column 'TS50' (page 16 of 21)
Configuration: ProteinMPNN grouped (HyInv report)Protocol: Paired scTM difference from HyInv under ESMFold2 (HyInv report)
Dataset: TS500 (500 chains)
+4.3 [0.0, 8.4] Sctm difference (HyInv default minus the baseline, paired by chain on the same panel with shared folding randomness, printed in units of 10^-3 scTM with a 95% percentile interval; ESMFold2 as the structure predictor; the reference system is the HyInv default setting; the baseline is ProteinMPNN grouped)
unitless · higher

Uncertainty: 95% CI 0.0 to 8.4. Printed in units of 10^-3 scTM, as the point estimate is. The interval includes zero.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

HyInv minus ProteinMPNN grouped on TS500 (paired scTM difference, HyInv report)

hyinv-20261106-protocol-sctm-difference-esmfold2

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Table 7, row 'ProteinMPNN grouped', column 'TS500' (page 16 of 21)
Configuration: ProteinMPNN grouped (HyInv report)Protocol: Paired scTM difference from HyInv under Protenix2 (HyInv report)
Dataset: RecentPDB (121 chains from 111 recent PDB entries)
+14.4 [3.8, 26.3] Sctm difference (HyInv default minus the baseline, paired by chain on RecentPDB with shared folding randomness, printed in units of 10^-3 scTM with a 95% percentile interval; Protenix2 as the structure predictor; the reference system is the HyInv default setting; the baseline is ProteinMPNN grouped)
unitless · higher

Uncertainty: 95% CI 3.8 to 26.3. Printed in units of 10^-3 scTM, as the point estimate is. The interval excludes zero.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

HyInv minus ProteinMPNN grouped on RecentPDB Protenix2 (paired scTM difference, HyInv report)

hyinv-20261106-protocol-sctm-difference-protenix2

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Table 7, row 'ProteinMPNN grouped', column 'RecentPDB, Protenix2' (page 16 of 21)
Configuration: ProteinMPNN grouped (HyInv report)Protocol: scTM of designed sequences under ESMFold2 (HyInv report)
Dataset: CATH4.2 test (1,120 chains)
0.844 Sctm (Mean TM-score of the predicted structure to the native backbone, averaged over the designs of a target and then over targets (macro-average); computed on the CA trace at valid sites, normalised by the native length and clipped at one; ESMFold2 as the structure predictor, which is also the reinforcement-learning reward of HyInv)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ProteinMPNN grouped on CATH4.2 test (scTM of designed sequences under ESMFold2, HyInv report)

hyinv-20261106-protocol-sctm-esmfold2

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Table 6, row 'ProteinMPNN grouped', column 'CATH4.2 test' (page 16 of 21)

Source checking is not independent reproduction. Release 2026-11-21-adc15377fab2.

Use this configuration

How it works, versions and access

Additional methodological details, versions and access terms have not yet been extracted into a structured profile for this configuration. Consult the linked sources and evaluation records below.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-adc15377fab2
Property and statementOriginal source and locationReview and provenance

No evidence rows match these filters. Choose another scope or clear the search.

Sources and history

Release 2026-11-21-adc15377fab2 · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and record identifiers

Technical metadata for this record is tracked under stable ID hyinv-20261106-config-proteinmpnn-grouped.

Source locator: Table 5 row 'ProteinMPNN grouped'; Section 5.1 'Baselines'; Appendix D.1

Related records

How to cite

ProteinMPNN grouped (HyInv report). Rewire biological model benchmark database, release 2026-11-21-adc15377fab2. https://benchmarks.rewirebio.io/database/configuration/hyinv-20261106-config-proteinmpnn-grouped/

Release 2026-11-21-adc15377fab2. Rankings and values change between releases, so keep the release id in the citation. Cite the original publication as well for any value you reuse: each result links its source.

The compilation and annotations made by Rewire in this release are offered under CC BY 4.0; values and text taken from cited sources stay under the terms of those sources and are not covered by this licence. Data licence

Suggest a correction