rewirebio.iobenchmarks
Protocol

Sequence diversity of a design set (HyInv report)

Measure how different the sequences a method designs for one backbone are from each other.

55 evaluations · 55 results

Overview

An explanatory profile has not yet been reviewed for this record.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

55 recorded evaluations, 55 metric rows. A comparison chart has not yet been validated for these results. The table retains the individual findings and their sources.

View coverage and remaining gaps across all benchmarks

Results

Results are available, but no reviewed comparison panel is linked in this release.

All evaluations

55 evaluations · 55 results. Different protocols are not a single leaderboard.

Protocol: Sequence diversity of a design set (HyInv report)

In source order. Decimals are rounded for display; each value links to the printed value and its source.

Tested configurationProtocol and datasetSequence diversity (Mean pairwise normalised Hamming distance between the K designs of a chain over valid sites, then a macro-average over targets; counted at valid sites for every method, because baseline sequences carry X at invalid sites and counting those as identical would lower their diversity)
CMLM (HyInv report)EvaluationCATH4.2 test (1,120 chains)0.105
CMLM (HyInv report)EvaluationCATH4.3 test (1,882 chains)0.104
CMLM (HyInv report)EvaluationRecentPDB (121 chains from 111 recent PDB entries)0.095
CMLM (HyInv report)EvaluationTS50 (50 chains)0.092
CMLM (HyInv report)EvaluationTS500 (500 chains)0.075
DPLM-2 3B (HyInv report)EvaluationCATH4.2 test (1,120 chains)0
DPLM-2 3B (HyInv report)EvaluationCATH4.3 test (1,882 chains)0
DPLM-2 3B (HyInv report)EvaluationRecentPDB (121 chains from 111 recent PDB entries)0
DPLM-2 3B (HyInv report)EvaluationTS50 (50 chains)0
DPLM-2 3B (HyInv report)EvaluationTS500 (500 chains)0
HyInv default (HyInv report)EvaluationCATH4.2 test (1,120 chains)0.328
HyInv default (HyInv report)EvaluationCATH4.3 test (1,882 chains)0.331
HyInv default (HyInv report)EvaluationRecentPDB (121 chains from 111 recent PDB entries)0.309
HyInv default (HyInv report)EvaluationTS50 (50 chains)0.283
HyInv default (HyInv report)EvaluationTS500 (500 chains)0.266
LigandMPNN (HyInv report)EvaluationCATH4.2 test (1,120 chains)0.272
LigandMPNN (HyInv report)EvaluationCATH4.3 test (1,882 chains)0.277
LigandMPNN (HyInv report)EvaluationRecentPDB (121 chains from 111 recent PDB entries)0.266
LigandMPNN (HyInv report)EvaluationTS50 (50 chains)0.224
LigandMPNN (HyInv report)EvaluationTS500 (500 chains)0.22
LM-Design 650M (HyInv report)EvaluationCATH4.2 test (1,120 chains)0.147
LM-Design 650M (HyInv report)EvaluationCATH4.3 test (1,882 chains)0.144
LM-Design 650M (HyInv report)EvaluationRecentPDB (121 chains from 111 recent PDB entries)0.125
LM-Design 650M (HyInv report)EvaluationTS50 (50 chains)0.108
LM-Design 650M (HyInv report)EvaluationTS500 (500 chains)0.095
PiFold (HyInv report)EvaluationCATH4.2 test (1,120 chains)0.097
PiFold (HyInv report)EvaluationCATH4.3 test (1,882 chains)0.093
PiFold (HyInv report)EvaluationRecentPDB (121 chains from 111 recent PDB entries)0.087
PiFold (HyInv report)EvaluationTS50 (50 chains)0.071
PiFold (HyInv report)EvaluationTS500 (500 chains)0.07
ProteinMPNN (HyInv report)EvaluationCATH4.2 test (1,120 chains)0.312
ProteinMPNN (HyInv report)EvaluationCATH4.3 test (1,882 chains)0.314
ProteinMPNN grouped (HyInv report)EvaluationCATH4.2 test (1,120 chains)0.311
ProteinMPNN grouped (HyInv report)EvaluationCATH4.3 test (1,882 chains)0.313
ProteinMPNN grouped (HyInv report)EvaluationRecentPDB (121 chains from 111 recent PDB entries)0.299
ProteinMPNN grouped (HyInv report)EvaluationTS50 (50 chains)0.278
ProteinMPNN grouped (HyInv report)EvaluationTS500 (500 chains)0.262
ProteinMPNN (low-noise, grouped) (HyInv report)EvaluationCATH4.2 test (1,120 chains)0.27
ProteinMPNN (low-noise, grouped) (HyInv report)EvaluationCATH4.3 test (1,882 chains)0.274
ProteinMPNN (low-noise, grouped) (HyInv report)EvaluationRecentPDB (121 chains from 111 recent PDB entries)0.257
ProteinMPNN (low-noise, grouped) (HyInv report)EvaluationTS50 (50 chains)0.235
ProteinMPNN (low-noise, grouped) (HyInv report)EvaluationTS500 (500 chains)0.213
ProteinMPNN (HyInv report)EvaluationRecentPDB (121 chains from 111 recent PDB entries)0.307
ProteinMPNN (HyInv report)EvaluationTS50 (50 chains)0.272
ProteinMPNN (HyInv report)EvaluationTS500 (500 chains)0.264
ProteinZero V2 (ESM1) (HyInv report)EvaluationCATH4.2 test (1,120 chains)0.313
ProteinZero V2 (ESM1) (HyInv report)EvaluationCATH4.3 test (1,882 chains)0.312
ProteinZero V2 (ESM1) (HyInv report)EvaluationRecentPDB (121 chains from 111 recent PDB entries)0.31
ProteinZero V2 (ESM1) (HyInv report)EvaluationTS50 (50 chains)0.275
ProteinZero V2 (ESM1) (HyInv report)EvaluationTS500 (500 chains)0.265
ProteinZero V2 (ESM2) (HyInv report)EvaluationCATH4.2 test (1,120 chains)0.317
ProteinZero V2 (ESM2) (HyInv report)EvaluationCATH4.3 test (1,882 chains)0.315
ProteinZero V2 (ESM2) (HyInv report)EvaluationRecentPDB (121 chains from 111 recent PDB entries)0.324
ProteinZero V2 (ESM2) (HyInv report)EvaluationTS50 (50 chains)0.28
ProteinZero V2 (ESM2) (HyInv report)EvaluationTS500 (500 chains)0.263
All 55 result rows with coverage, uncertainty and sources
Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: CMLM (HyInv report)Protocol: Sequence diversity of a design set (HyInv report)
Dataset: CATH4.2 test (1,120 chains)
0.105 Sequence diversity (Mean pairwise normalised Hamming distance between the K designs of a chain over valid sites, then a macro-average over targets; counted at valid sites for every method, because baseline sequences carry X at invalid sites and counting those as identical would lower their diversity)
fraction · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CMLM on CATH4.2 test (Sequence diversity of a design set, HyInv report)

hyinv-20261106-protocol-sequence-diversity

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 14, 'Diversity' block, row 'CMLM', column 'CATH4.2 test' (page 17 of 21)
Configuration: CMLM (HyInv report)Protocol: Sequence diversity of a design set (HyInv report)
Dataset: CATH4.3 test (1,882 chains)
0.104 Sequence diversity (Mean pairwise normalised Hamming distance between the K designs of a chain over valid sites, then a macro-average over targets; counted at valid sites for every method, because baseline sequences carry X at invalid sites and counting those as identical would lower their diversity)
fraction · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CMLM on CATH4.3 test (Sequence diversity of a design set, HyInv report)

hyinv-20261106-protocol-sequence-diversity

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 14, 'Diversity' block, row 'CMLM', column 'CATH4.3 test' (page 17 of 21)
Configuration: CMLM (HyInv report)Protocol: Sequence diversity of a design set (HyInv report)
Dataset: RecentPDB (121 chains from 111 recent PDB entries)
0.095 Sequence diversity (Mean pairwise normalised Hamming distance between the K designs of a chain over valid sites, then a macro-average over targets; counted at valid sites for every method, because baseline sequences carry X at invalid sites and counting those as identical would lower their diversity)
fraction · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CMLM on RecentPDB (Sequence diversity of a design set, HyInv report)

hyinv-20261106-protocol-sequence-diversity

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 14, 'Diversity' block, row 'CMLM', column 'RecentPDB' (page 17 of 21)
Configuration: CMLM (HyInv report)Protocol: Sequence diversity of a design set (HyInv report)
Dataset: TS50 (50 chains)
0.092 Sequence diversity (Mean pairwise normalised Hamming distance between the K designs of a chain over valid sites, then a macro-average over targets; counted at valid sites for every method, because baseline sequences carry X at invalid sites and counting those as identical would lower their diversity)
fraction · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CMLM on TS50 (Sequence diversity of a design set, HyInv report)

hyinv-20261106-protocol-sequence-diversity

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 14, 'Diversity' block, row 'CMLM', column 'TS50' (page 17 of 21)
Configuration: CMLM (HyInv report)Protocol: Sequence diversity of a design set (HyInv report)
Dataset: TS500 (500 chains)
0.075 Sequence diversity (Mean pairwise normalised Hamming distance between the K designs of a chain over valid sites, then a macro-average over targets; counted at valid sites for every method, because baseline sequences carry X at invalid sites and counting those as identical would lower their diversity)
fraction · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

CMLM on TS500 (Sequence diversity of a design set, HyInv report)

hyinv-20261106-protocol-sequence-diversity

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 14, 'Diversity' block, row 'CMLM', column 'TS500' (page 17 of 21)
Configuration: DPLM-2 3B (HyInv report)Protocol: Sequence diversity of a design set (HyInv report)
Dataset: CATH4.2 test (1,120 chains)
0 Sequence diversity (Mean pairwise normalised Hamming distance between the K designs of a chain over valid sites, then a macro-average over targets; counted at valid sites for every method, because baseline sequences carry X at invalid sites and counting those as identical would lower their diversity)
fraction · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

DPLM-2 3B on CATH4.2 test (Sequence diversity of a design set, HyInv report)

hyinv-20261106-protocol-sequence-diversity

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 14, 'Diversity' block, row 'DPLM-2 3B', column 'CATH4.2 test' (page 17 of 21)
Configuration: DPLM-2 3B (HyInv report)Protocol: Sequence diversity of a design set (HyInv report)
Dataset: CATH4.3 test (1,882 chains)
0 Sequence diversity (Mean pairwise normalised Hamming distance between the K designs of a chain over valid sites, then a macro-average over targets; counted at valid sites for every method, because baseline sequences carry X at invalid sites and counting those as identical would lower their diversity)
fraction · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

DPLM-2 3B on CATH4.3 test (Sequence diversity of a design set, HyInv report)

hyinv-20261106-protocol-sequence-diversity

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 14, 'Diversity' block, row 'DPLM-2 3B', column 'CATH4.3 test' (page 17 of 21)
Configuration: DPLM-2 3B (HyInv report)Protocol: Sequence diversity of a design set (HyInv report)
Dataset: RecentPDB (121 chains from 111 recent PDB entries)
0 Sequence diversity (Mean pairwise normalised Hamming distance between the K designs of a chain over valid sites, then a macro-average over targets; counted at valid sites for every method, because baseline sequences carry X at invalid sites and counting those as identical would lower their diversity)
fraction · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

DPLM-2 3B on RecentPDB (Sequence diversity of a design set, HyInv report)

hyinv-20261106-protocol-sequence-diversity

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 14, 'Diversity' block, row 'DPLM-2 3B', column 'RecentPDB' (page 17 of 21)
Configuration: DPLM-2 3B (HyInv report)Protocol: Sequence diversity of a design set (HyInv report)
Dataset: TS50 (50 chains)
0 Sequence diversity (Mean pairwise normalised Hamming distance between the K designs of a chain over valid sites, then a macro-average over targets; counted at valid sites for every method, because baseline sequences carry X at invalid sites and counting those as identical would lower their diversity)
fraction · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

DPLM-2 3B on TS50 (Sequence diversity of a design set, HyInv report)

hyinv-20261106-protocol-sequence-diversity

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 14, 'Diversity' block, row 'DPLM-2 3B', column 'TS50' (page 17 of 21)
Configuration: DPLM-2 3B (HyInv report)Protocol: Sequence diversity of a design set (HyInv report)
Dataset: TS500 (500 chains)
0 Sequence diversity (Mean pairwise normalised Hamming distance between the K designs of a chain over valid sites, then a macro-average over targets; counted at valid sites for every method, because baseline sequences carry X at invalid sites and counting those as identical would lower their diversity)
fraction · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

DPLM-2 3B on TS500 (Sequence diversity of a design set, HyInv report)

hyinv-20261106-protocol-sequence-diversity

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 14, 'Diversity' block, row 'DPLM-2 3B', column 'TS500' (page 17 of 21)
Configuration: HyInv default (HyInv report)Protocol: Sequence diversity of a design set (HyInv report)
Dataset: CATH4.2 test (1,120 chains)
0.328 Sequence diversity (Mean pairwise normalised Hamming distance between the K designs of a chain over valid sites, then a macro-average over targets; counted at valid sites for every method, because baseline sequences carry X at invalid sites and counting those as identical would lower their diversity)
fraction · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

HyInv on CATH4.2 test (Sequence diversity of a design set, HyInv report)

hyinv-20261106-protocol-sequence-diversity

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 14, 'Diversity' block, row 'HyInv', column 'CATH4.2 test' (page 17 of 21)
Configuration: HyInv default (HyInv report)Protocol: Sequence diversity of a design set (HyInv report)
Dataset: CATH4.3 test (1,882 chains)
0.331 Sequence diversity (Mean pairwise normalised Hamming distance between the K designs of a chain over valid sites, then a macro-average over targets; counted at valid sites for every method, because baseline sequences carry X at invalid sites and counting those as identical would lower their diversity)
fraction · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

HyInv on CATH4.3 test (Sequence diversity of a design set, HyInv report)

hyinv-20261106-protocol-sequence-diversity

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 14, 'Diversity' block, row 'HyInv', column 'CATH4.3 test' (page 17 of 21)
Configuration: HyInv default (HyInv report)Protocol: Sequence diversity of a design set (HyInv report)
Dataset: RecentPDB (121 chains from 111 recent PDB entries)
0.309 Sequence diversity (Mean pairwise normalised Hamming distance between the K designs of a chain over valid sites, then a macro-average over targets; counted at valid sites for every method, because baseline sequences carry X at invalid sites and counting those as identical would lower their diversity)
fraction · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

HyInv on RecentPDB (Sequence diversity of a design set, HyInv report)

hyinv-20261106-protocol-sequence-diversity

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 14, 'Diversity' block, row 'HyInv', column 'RecentPDB' (page 17 of 21)
Configuration: HyInv default (HyInv report)Protocol: Sequence diversity of a design set (HyInv report)
Dataset: TS50 (50 chains)
0.283 Sequence diversity (Mean pairwise normalised Hamming distance between the K designs of a chain over valid sites, then a macro-average over targets; counted at valid sites for every method, because baseline sequences carry X at invalid sites and counting those as identical would lower their diversity)
fraction · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

HyInv on TS50 (Sequence diversity of a design set, HyInv report)

hyinv-20261106-protocol-sequence-diversity

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 14, 'Diversity' block, row 'HyInv', column 'TS50' (page 17 of 21)
Configuration: HyInv default (HyInv report)Protocol: Sequence diversity of a design set (HyInv report)
Dataset: TS500 (500 chains)
0.266 Sequence diversity (Mean pairwise normalised Hamming distance between the K designs of a chain over valid sites, then a macro-average over targets; counted at valid sites for every method, because baseline sequences carry X at invalid sites and counting those as identical would lower their diversity)
fraction · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

HyInv on TS500 (Sequence diversity of a design set, HyInv report)

hyinv-20261106-protocol-sequence-diversity

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 14, 'Diversity' block, row 'HyInv', column 'TS500' (page 17 of 21)
Configuration: LigandMPNN (HyInv report)Protocol: Sequence diversity of a design set (HyInv report)
Dataset: CATH4.2 test (1,120 chains)
0.272 Sequence diversity (Mean pairwise normalised Hamming distance between the K designs of a chain over valid sites, then a macro-average over targets; counted at valid sites for every method, because baseline sequences carry X at invalid sites and counting those as identical would lower their diversity)
fraction · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

LigandMPNN on CATH4.2 test (Sequence diversity of a design set, HyInv report)

hyinv-20261106-protocol-sequence-diversity

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 14, 'Diversity' block, row 'LigandMPNN', column 'CATH4.2 test' (page 17 of 21)
Configuration: LigandMPNN (HyInv report)Protocol: Sequence diversity of a design set (HyInv report)
Dataset: CATH4.3 test (1,882 chains)
0.277 Sequence diversity (Mean pairwise normalised Hamming distance between the K designs of a chain over valid sites, then a macro-average over targets; counted at valid sites for every method, because baseline sequences carry X at invalid sites and counting those as identical would lower their diversity)
fraction · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

LigandMPNN on CATH4.3 test (Sequence diversity of a design set, HyInv report)

hyinv-20261106-protocol-sequence-diversity

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 14, 'Diversity' block, row 'LigandMPNN', column 'CATH4.3 test' (page 17 of 21)
Configuration: LigandMPNN (HyInv report)Protocol: Sequence diversity of a design set (HyInv report)
Dataset: RecentPDB (121 chains from 111 recent PDB entries)
0.266 Sequence diversity (Mean pairwise normalised Hamming distance between the K designs of a chain over valid sites, then a macro-average over targets; counted at valid sites for every method, because baseline sequences carry X at invalid sites and counting those as identical would lower their diversity)
fraction · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

LigandMPNN on RecentPDB (Sequence diversity of a design set, HyInv report)

hyinv-20261106-protocol-sequence-diversity

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 14, 'Diversity' block, row 'LigandMPNN', column 'RecentPDB' (page 17 of 21)
Configuration: LigandMPNN (HyInv report)Protocol: Sequence diversity of a design set (HyInv report)
Dataset: TS50 (50 chains)
0.224 Sequence diversity (Mean pairwise normalised Hamming distance between the K designs of a chain over valid sites, then a macro-average over targets; counted at valid sites for every method, because baseline sequences carry X at invalid sites and counting those as identical would lower their diversity)
fraction · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

LigandMPNN on TS50 (Sequence diversity of a design set, HyInv report)

hyinv-20261106-protocol-sequence-diversity

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 14, 'Diversity' block, row 'LigandMPNN', column 'TS50' (page 17 of 21)
Configuration: LigandMPNN (HyInv report)Protocol: Sequence diversity of a design set (HyInv report)
Dataset: TS500 (500 chains)
0.22 Sequence diversity (Mean pairwise normalised Hamming distance between the K designs of a chain over valid sites, then a macro-average over targets; counted at valid sites for every method, because baseline sequences carry X at invalid sites and counting those as identical would lower their diversity)
fraction · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

LigandMPNN on TS500 (Sequence diversity of a design set, HyInv report)

hyinv-20261106-protocol-sequence-diversity

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 14, 'Diversity' block, row 'LigandMPNN', column 'TS500' (page 17 of 21)
Configuration: LM-Design 650M (HyInv report)Protocol: Sequence diversity of a design set (HyInv report)
Dataset: CATH4.2 test (1,120 chains)
0.147 Sequence diversity (Mean pairwise normalised Hamming distance between the K designs of a chain over valid sites, then a macro-average over targets; counted at valid sites for every method, because baseline sequences carry X at invalid sites and counting those as identical would lower their diversity)
fraction · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

LM-Design 650M on CATH4.2 test (Sequence diversity of a design set, HyInv report)

hyinv-20261106-protocol-sequence-diversity

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 14, 'Diversity' block, row 'LM-Design 650M', column 'CATH4.2 test' (page 17 of 21)
Configuration: LM-Design 650M (HyInv report)Protocol: Sequence diversity of a design set (HyInv report)
Dataset: CATH4.3 test (1,882 chains)
0.144 Sequence diversity (Mean pairwise normalised Hamming distance between the K designs of a chain over valid sites, then a macro-average over targets; counted at valid sites for every method, because baseline sequences carry X at invalid sites and counting those as identical would lower their diversity)
fraction · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

LM-Design 650M on CATH4.3 test (Sequence diversity of a design set, HyInv report)

hyinv-20261106-protocol-sequence-diversity

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 14, 'Diversity' block, row 'LM-Design 650M', column 'CATH4.3 test' (page 17 of 21)
Configuration: LM-Design 650M (HyInv report)Protocol: Sequence diversity of a design set (HyInv report)
Dataset: RecentPDB (121 chains from 111 recent PDB entries)
0.125 Sequence diversity (Mean pairwise normalised Hamming distance between the K designs of a chain over valid sites, then a macro-average over targets; counted at valid sites for every method, because baseline sequences carry X at invalid sites and counting those as identical would lower their diversity)
fraction · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

LM-Design 650M on RecentPDB (Sequence diversity of a design set, HyInv report)

hyinv-20261106-protocol-sequence-diversity

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 14, 'Diversity' block, row 'LM-Design 650M', column 'RecentPDB' (page 17 of 21)
Configuration: LM-Design 650M (HyInv report)Protocol: Sequence diversity of a design set (HyInv report)
Dataset: TS50 (50 chains)
0.108 Sequence diversity (Mean pairwise normalised Hamming distance between the K designs of a chain over valid sites, then a macro-average over targets; counted at valid sites for every method, because baseline sequences carry X at invalid sites and counting those as identical would lower their diversity)
fraction · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

LM-Design 650M on TS50 (Sequence diversity of a design set, HyInv report)

hyinv-20261106-protocol-sequence-diversity

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 14, 'Diversity' block, row 'LM-Design 650M', column 'TS50' (page 17 of 21)
Configuration: LM-Design 650M (HyInv report)Protocol: Sequence diversity of a design set (HyInv report)
Dataset: TS500 (500 chains)
0.095 Sequence diversity (Mean pairwise normalised Hamming distance between the K designs of a chain over valid sites, then a macro-average over targets; counted at valid sites for every method, because baseline sequences carry X at invalid sites and counting those as identical would lower their diversity)
fraction · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

LM-Design 650M on TS500 (Sequence diversity of a design set, HyInv report)

hyinv-20261106-protocol-sequence-diversity

Aggregation: Not reported

HyInv Technical Report (Hyra Team, 2026-10-14) · Figure 14, 'Diversity' block, row 'LM-Design 650M', column 'TS500' (page 17 of 21)

Source checking is not independent reproduction. Release 2026-11-21-adc15377fab2.

Methods and evaluation design

Procedure, tasks and evaluated configurations

Recorded evaluations

Each evaluation records what was tested and under which conditions.

Explore all linked results

Baseline coverage

Reference methods help show what a model adds beyond simple controls. We track a null control and a conventional method for each protocol.

0 of 2 active baseline roles have published Rewire measurements in this release. Measurements on a selected protocol do not establish coverage of an entire suite.

No execution recipe linked to this protocol. Recipe availability does not establish a completed evaluation.

Author-reported evaluations
55

Literature evidence is not a Rewire measurement. Executed but unpublished runs and private review status are not included.

Null control

Proposed control: requires review

Select a task-valid null control after reviewing inputs and metric

Protocol-specific applicability, permitted inputs, access, split, evaluator and execution requirements need review before implementation or execution.

This is a suggested selection rule, not a validated method or a measured score.

Conventional reference

Proposed control: requires review

Select an upstream conventional reference after reviewing the full protocol

Protocol-specific applicability, permitted inputs, access, split, evaluator and execution requirements need review before implementation or execution.

This is a suggested selection rule, not a validated method or a measured score.

Protocol coverage CSV (gzip) · Model evaluation matrix (gzip) · Source table (gzip) · Release and checksums (gzip)

Coverage is derived from release 2026-11-21-adc15377fab2. Source citations describe the original records; they do not validate an unreviewed baseline proposal. No results have been generated by this audit.

Run instructions

No runnable recipe has been reviewed for this protocol. Dataset access, model requirements, licences and compute requirements must be checked against its sources before execution.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-adc15377fab2
Property and statementOriginal source and locationReview and provenance

No evidence rows match these filters. Choose another scope or clear the search.

Sources and history

Release 2026-11-21-adc15377fab2 · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and record identifiers

Technical metadata for this record is tracked under stable ID hyinv-20261106-protocol-sequence-diversity.

Source locator: Figure 14, 'Diversity' block; Appendix A 'Scores'; Appendix B 'Diversity'

Related records

Suggest a correction