rewirebio.iobenchmarks
Result

Count (Number of designs per backbone (of 4) that are both foldable (ESMFold2 scTM at least 0.9) and novel (sequence identity below 0.3 to the nearest UniRef50 sequence and to the nearest sequence of the pretraining library), at matched diversity; two readings, with and without the report's composition filter; the composition-filtered reading: sequence entropy at least 3.5 bits, hydrophobic fraction (AVILMFWY) 0.25 to 0.55, longest homopolymer run at most 6 The baselines are interpolated at the HyInv diversity from their own temperature grids, so 'at matched diversity' is the report's wording for an interpolated comparison and not a measurement of either baseline at HyInv's diversity.) of ProteinZero V2 (ESM2) (HyInv report) on De novo backbones application panel (74 backbones)

0.11 Count (Number of designs per backbone (of 4) that are both foldable (ESMFold2 scTM at least 0.9) and novel (sequence identity below 0.3 to the nearest UniRef50 sequence and to the nearest sequence of the pretraining library), at matched diversity; two readings, with and without the report's composition filter; the composition-filtered reading: sequence entropy at least 3.5 bits, hydrophobic fraction (AVILMFWY) 0.25 to 0.55, longest homopolymer run at most 6 The baselines are interpolated at the HyInv diversity from their own temperature grids, so 'at matched diversity' is the report's wording for an interpolated comparison and not a measurement of either baseline at HyInv's diversity.)

Methods

Tested configuration
ProteinZero V2 (ESM2) (HyInv report)
Protocol
Novel and foldable designs per de novo backbone at matched diversity (HyInv report)
Dataset
De novo backbones application panel (74 backbones)
Procedure
Novel and foldable designs per de novo backbone at matched diversity (HyInv report)
Evaluation
ProteinZero V2: novel and foldable designs per de novo backbone at matched diversity (HyInv report)
Coverage
74/74 backbones scored (58 clusters of 30% sequence identity; 4 designs per backbone.)
Uncertainty
Not reported by the source
Evidence
Author-reported evaluation · source checkedHyInv Technical Report (Hyra Team, 2026-10-14) · Section 6 'De novo backbones', sentence '0.68 unfiltered and 0.38 filtered per backbone, against 0.47 and 0.05 for ProteinMPNN and 0.45 and 0.11 for ProteinZero V2' (page 8 of 21)

A source-checked result verifies the numerical transcription, not every model or protocol detail. Evaluation metadata: source checked. Source checked does not mean independently reproduced.

Reproduction

Split
application panel
Adaptation
HyInv runs its default setting. ProteinMPNN and ProteinZero V2 are interpolated at the HyInv diversity from their temperature grids, without extrapolating by more than 0.05, so the baseline side is interpolated rather than measured at HyInv's diversity
Scoring implementation
74 de novo backbones, 4 designs each. A design is foldable if its ESMFold2 scTM is at least 0.9 and novel if its identity to the nearest UniRef50 sequence and to the nearest pretraining-library sequence is below 0.3. The composition filter keeps sequences with entropy at least 3.5 bits, hydrophobic fraction (AVILMFWY) between 0.25 and 0.55 and longest homopolymer run at most 6, which excludes low-complexity sequences a structure predictor can fold to a high scTM. Both readings were fixed before designs were generated. HyInv is compared with ProteinMPNN and ProteinZero V2 over their temperature grids, interpolating each curve at the HyInv diversity without extrapolating by more than 0.05.

No execution recipe has been verified for this exact configuration and evaluation. A benchmark's general instructions may use different inputs, splits or model settings.

Reproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

1 evidence row matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Reported result
0.11
Individual claims
HyInv Technical Report (Hyra Team, 2026-10-14)

Original source ↗

Section 6 'De novo backbones', sentence '0.68 unfiltered and 0.38 filtered per backbone, against 0.47 and 0.05 for ProteinMPNN and 0.45 and 0.11 for ProteinZero V2' (page 8 of 21)

Version: Dated 2026-10-14; retrieved at commit 0dcc533cc9f8f76c90ecbfe944df816b6672328a (21 pages)
Retrieved: 2026-11-06T09:52:00Z

source checked

["independent-cell-check","deterministic-table-parse","pdf-text-parse","source-hash-verification"] · 2026-11-06T00:00:00Z

author reported

Source has a recorded evidence concern. Consult its source page before using the claim.

Audit details

Field: attributes.printed_value

Source artifact SHA-256: 0f10b390be399c341d1f7497c5a3ca0ac857ce78172c4732bdc86a9c66e46419

Hash scope: pdftotext -layout text layer, parsed by extract/parse.py with every row label and column count asserted.

Inspected artifact

Extraction artifact SHA-256: 0f10b390be399c341d1f7497c5a3ca0ac857ce78172c4732bdc86a9c66e46419

Extraction artifact

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: hyinv-20261106-result-novel-foldable-proteinzero-v2-esm2-composition-filtered

coverage
eligible: 74; note: 58 clusters of 30% sequence identity; 4 designs per backbone.; scored: 74; unit: backbones
metric
count
metric direction
higher
metric qualifier
Number of designs per backbone (of 4) that are both foldable (ESMFold2 scTM at least 0.9) and novel (sequence identity below 0.3 to the nearest UniRef50 sequence and to the nearest sequence of the pretraining library), at matched diversity; two readings, with and without the report's composition filter; the composition-filtered reading: sequence entropy at least 3.5 bits, hydrophobic fraction (AVILMFWY) 0.25 to 0.55, longest homopolymer run at most 6 The baselines are interpolated at the HyInv diversity from their own temperature grids, so 'at matched diversity' is the report's wording for an interpolated comparison and not a measurement of either baseline at HyInv's diversity.
missing metadata
uncertainty: reason: unreported
numeric value
0.11
printed value
0.11
review
artifact sha256: 0f10b390be399c341d1f7497c5a3ca0ac857ce78172c4732bdc86a9c66e46419; method: independent-cell-check; deterministic-table-parse; pdf-text-parse; source-hash-verification; method note: Independent review pass. The pinned PDF was re-downloaded at the pinned commit and its SHA-256 checked against the source record; pdftotext -layout reproduced the archived text layer byte for byte. npm run batch -- check-values was run over the whole batch against that text layer (value-check.tsv). The 170 cells of Tables 6, 7, 8 and 9 and the 290 cells of the Figure 14 and Figure 15 matrices were then re-read by a reviewer script that finds each row by its printed label and splits the printed cells by position, written for this pass without using the extractor's parser; every printed value and column matched. Column assignment in Figure 14 was confirmed against the labelled columns of Table 2 and against Section 5.2's prose figures; Figure 15's was confirmed by the coordinator reading the rotated column headers on the rendered page 17, which match Figure 14's order. Table 1, Figure 4a and the eleven prose values were read by hand against the text layer. Each claim was re-read against the passage its locator names.; retrieval url: https://raw.githubusercontent.com/Tencent-Hunyuan/Hyra-results/0dcc533cc9f8f76c90ecbfe944df816b6672328a/AI4Science/hyinv/HyInv_Technical_Report.pdf; reviewed at: 2026-11-06T00:00:00Z; reviewer: claude; reviewer note: Claude research agent; no human review claimed. Reviewed by a different agent from the one that extracted the batch. Transcription checked against the pinned source; nothing was reproduced and no value was recomputed.
source locator
Section 6 'De novo backbones', sentence '0.68 unfiltered and 0.38 filtered per backbone, against 0.47 and 0.05 for ProteinMPNN and 0.45 and 0.11 for ProteinZero V2' (page 8 of 21)
unit
count
unit detail
Designs per backbone, of 4 designs made per backbone
Related records

Suggest a correction