rewirebio.iobenchmarks
Result

Designability of Protpardelle-1c (cc58) on 500 generated monomers per run; lengths 50–250 in steps of 50; three runs (Genie 3 short monomer generation split)

1 Designability

Methods

Tested configuration
Protpardelle-1c (cc58)
Protocol
Genie 3 short monomer generation designability: Unconditional short monomer Designability
Dataset subset
500 generated monomers per run; lengths 50–250 in steps of 50; three runs (Genie 3 short monomer generation split)
Procedure
Unconditional short monomer generation: 100 structures at each length 50, 100, 150, 200 and 250 (500 samples per run); 3 repeated runs; Table 3 reports the authors’ average across runs. Designability uses minimum C-alpha scRMSD <2 angstrom across 8 ProteinMPNN sequences refolded with ESMFold. Diversity and novelty use FoldSeek release 10 (2025-01-19); exact definitions and reference sets in Appendix B.1. Method-specific checkpoints and sampling settings remain as Appendix B.2.
Evaluation
Protpardelle-1c (cc58) on Genie 3 short monomer generation designability: Unconditional short monomer Designability
Coverage
500 generated per run, 3 repeats (Three repeated runs; metric-specific valid subsets not assigned a pooled denominator.)
Uncertainty
Not yet extracted
Evidence
Author-reported evaluation · source checkedGenie 3 primary paper v1, Table 3 · PDF page 20, Appendix B.3, Table 3, data row 9 (Protpardelle-1c (cc58)), column Designability

A source-checked result verifies the numerical transcription, not every model or protocol detail. Evaluation metadata: source checked. Source checked does not mean independently reproduced.

Reproduction

Split
Not reported
Adaptation
Not reported
Scoring implementation
Designability

No execution recipe has been verified for this exact configuration and evaluation. A benchmark's general instructions may use different inputs, splits or model settings.

Reproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

1 evidence row matching the loaded filters

Claims, original sources and review scope · Release 2026-11-02-a7f03c9e55a5
Property and statementOriginal source and locationReview and provenance
Reported result
1.00
Individual claims
Genie 3 primary paper v1, Table 3

Original source ↗

PDF page 20, Appendix B.3, Table 3, data row 9 (Protpardelle-1c (cc58)), column Designability

Version: 10.64898/2026.05.01.722168v1; posted 2026-05-05
Retrieved: 2026-09-23T11:22:04.377971+00:00

source checked

["transcription","rendered-source-visual-check"] · 2026-09-23

author reported

Audit details

Source checked, not reproduced. Metrics differ by task, so no composite score across tasks is computed or implied.

Field: attributes.printed_value

Source artifact SHA-256: 43de8eab49ac74ad9141fbe955703a4e5f7879e0a83cbb547de37fc4e1d3e089

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Extraction artifact SHA-256: 43de8eab49ac74ad9141fbe955703a4e5f7879e0a83cbb547de37fc4e1d3e089

Extraction artifact

Sources and history

Release 2026-11-02-a7f03c9e55a5 · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: genie3-2026-table3-result-protpardelle-1c-cc58-designability-designability

areas
proteins-complexes
tasks
Unconditional short monomer Designability
metric
designability
metric direction
higher
unit
unitless
printed value
1.00
numeric value
1.00
source locator
PDF page 20, Appendix B.3, Table 3, data row 9 (Protpardelle-1c (cc58)), column Designability
missing metadata
denominator: reason: unextracted; seeds: reason: unreported; uncertainty: reason: unextracted
review
method: transcription; rendered-source-visual-check; reviewer: codex; date: 2026-09-23; artifact sha256: 43de8eab49ac74ad9141fbe955703a4e5f7879e0a83cbb547de37fc4e1d3e089; retrieval url: https://www.biorxiv.org/content/10.64898/2026.05.01.722168v1.full.pdf; method note: exact-string transcription of complete Table 3; checked against rendered primary PDF; no graph digitization or recomputation; reviewer note: role: automated source review; note: Source checked, not reproduced. Metrics differ by task, so no composite score across tasks is computed or implied.
aggregation
Mean over three repeated runs
coverage
generated per run: 500; repeats: 3; note: Three repeated runs; metric-specific valid subsets not assigned a pooled denominator.
unit detail
reported score
Related records

Suggest a correction