Sctm at fixed diversity difference (Setting minus the unmodified single-temperature sampler of the same checkpoint on the same panel, both read at fixed diversity (D = 0.30 on the development panel, 0.32 on CATH4.3 test, 0.30 on RecentPDB), paired, with a 95% interval; ESMFold2; checkpoint at update 288; the reference system is the unmodified sampler; read at diversity D = 0.30 Both values are read from least-squares quadratic fits of scTM against design-set diversity over a rewrite-temperature grid, so the level is interpolated from a fit and is not a measurement at a matched sampling setting.) of HyInv decoupled draft Td = 0.3 (update 288) (HyInv report) on RecentPDB (121 chains from 111 recent PDB entries)
+0.0089 [+0.0036, +0.0145] Sctm at fixed diversity difference (Setting minus the unmodified single-temperature sampler of the same checkpoint on the same panel, both read at fixed diversity (D = 0.30 on the development panel, 0.32 on CATH4.3 test, 0.30 on RecentPDB), paired, with a 95% interval; ESMFold2; checkpoint at update 288; the reference system is the unmodified sampler; read at diversity D = 0.30 Both values are read from least-squares quadratic fits of scTM against design-set diversity over a rewrite-temperature grid, so the level is interpolated from a fit and is not a measurement at a matched sampling setting.)
Methods
- Tested configuration
- HyInv decoupled draft Td = 0.3 (update 288) (HyInv report)
- Protocol
- Gain in scTM at fixed diversity over the unmodified sampler (HyInv report)
- Dataset
- RecentPDB (121 chains from 111 recent PDB entries)
- Procedure
- Gain in scTM at fixed diversity over the unmodified sampler (HyInv report)
- Evaluation
- Decoupled draft, Td = 0.3 over the unmodified sampler on RecentPDB at equal diversity (HyInv report)
- Coverage
- Not reported scored / Not reported eligible
- Uncertainty
- 95% CI +0.0036 to +0.0145. 95% interval over CATH topology clusters, over chains on RecentPDB; Appendix A states the interval comes from 1,000 draws in which all points of all curves are recomputed from one cluster resample.
- Evidence
- Author-reported evaluation · source checkedHyInv Technical Report (Hyra Team, 2026-10-14) · Table 8, row 'Decoupled draft, Td = 0.3', column 'RecentPDB' (page 19 of 21)
A source-checked result verifies the numerical transcription, not every model or protocol detail. Evaluation metadata: source checked. Source checked does not mean independently reproduced.
Reproduction
- Split
- test
- Adaptation
- Both settings are read from their own scTM-against-diversity curves at the same diversity, so the level is interpolated from a fit rather than measured at a matched sampling setting. Checkpoint at update 288, not the released update 640
- Scoring implementation
- A sampler family is evaluated at a grid of rewrite temperatures, giving points of diversity and scTM on the same chains. The scTM at fixed diversity D is the value at D of the least-squares quadratic fit s = a + b*d + c*d^2, with no extrapolation. The gain of a setting is its S@D minus that of the unmodified sampler of the same checkpoint on the same panel, with an interval from 1,000 draws in which all points of all curves are recomputed from one cluster resample. Grids: {0.3, 0.4, 0.5, 0.7} for the unmodified sampler, {0.1, 0.2, 0.3, 0.5} for the decoupled sampler at Td = 0.6 and {0.3, 0.4, 0.5, 0.7} at Td = 0.3. On the held-out panels D is the development value times the ratio of the panel to the development diversity of the unmodified sampler. Development chains K = 2, held-out panels K = 4 with new draws and fold seeds.
No execution recipe has been verified for this exact configuration and evaluation. A benchmark's general instructions may use different inputs, splits or model settings.
Reproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
1 evidence row matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| Reported result +0.0089 [+0.0036, +0.0145] Individual claims | HyInv Technical Report (Hyra Team, 2026-10-14) Table 8, row 'Decoupled draft, Td = 0.3', column 'RecentPDB' (page 19 of 21) Version: Dated 2026-10-14; retrieved at commit 0dcc533cc9f8f76c90ecbfe944df816b6672328a (21 pages) | source checked ["independent-cell-check","deterministic-table-parse","pdf-text-parse","source-hash-verification"] · 2026-11-06T00:00:00Z author reported Source has a recorded evidence concern. Consult its source page before using the claim. Audit detailsField: Source artifact SHA-256: Hash scope: pdftotext -layout text layer, parsed by extract/parse.py with every row label and column count asserted. Extraction artifact SHA-256: |
Sources and history
Release 2026-11-21-c8bea25e5abb · Record review: source checked
1 source record and release history
- HyInv Technical Report (Hyra Team, 2026-10-14) · Original source · Dated 2026-10-14; retrieved at commit 0dcc533cc9f8f76c90ecbfe944df816b6672328a (21 pages)
Technical metadata and extraction receipts
Stable ID: hyinv-20261106-result-sctm-fd-gain-vs-unmodified-hyinv-decoupled-td03-recentpdb
- metric
- sctm-at-fixed-diversity-difference
- metric direction
- higher
- metric qualifier
- Setting minus the unmodified single-temperature sampler of the same checkpoint on the same panel, both read at fixed diversity (D = 0.30 on the development panel, 0.32 on CATH4.3 test, 0.30 on RecentPDB), paired, with a 95% interval; ESMFold2; checkpoint at update 288; the reference system is the unmodified sampler; read at diversity D = 0.30 Both values are read from least-squares quadratic fits of scTM against design-set diversity over a rewrite-temperature grid, so the level is interpolated from a fit and is not a measurement at a matched sampling setting.
- numeric value
- +0.0089
- printed value
- +0.0089 [+0.0036, +0.0145]
- review
- artifact sha256: 0f10b390be399c341d1f7497c5a3ca0ac857ce78172c4732bdc86a9c66e46419; method: independent-cell-check; deterministic-table-parse; pdf-text-parse; source-hash-verification; method note: Independent review pass. The pinned PDF was re-downloaded at the pinned commit and its SHA-256 checked against the source record; pdftotext -layout reproduced the archived text layer byte for byte. npm run batch -- check-values was run over the whole batch against that text layer (value-check.tsv). The 170 cells of Tables 6, 7, 8 and 9 and the 290 cells of the Figure 14 and Figure 15 matrices were then re-read by a reviewer script that finds each row by its printed label and splits the printed cells by position, written for this pass without using the extractor's parser; every printed value and column matched. Column assignment in Figure 14 was confirmed against the labelled columns of Table 2 and against Section 5.2's prose figures; Figure 15's was confirmed by the coordinator reading the rotated column headers on the rendered page 17, which match Figure 14's order. Table 1, Figure 4a and the eleven prose values were read by hand against the text layer. Each claim was re-read against the passage its locator names.; retrieval url: https://raw.githubusercontent.com/Tencent-Hunyuan/Hyra-results/0dcc533cc9f8f76c90ecbfe944df816b6672328a/AI4Science/hyinv/HyInv_Technical_Report.pdf; reviewed at: 2026-11-06T00:00:00Z; reviewer: claude; reviewer note: Claude research agent; no human review claimed. Reviewed by a different agent from the one that extracted the batch. Transcription checked against the pinned source; nothing was reproduced and no value was recomputed.
- source locator
- Table 8, row 'Decoupled draft, Td = 0.3', column 'RecentPDB' (page 19 of 21)
- uncertainty
- level: 0.95; lower: +0.0036; method: bootstrap_percentile; note: 95% interval over CATH topology clusters, over chains on RecentPDB; Appendix A states the interval comes from 1,000 draws in which all points of all curves are recomputed from one cluster resample.; printed: [+0.0036, +0.0145]; resamples: 1000; type: confidence_interval; upper: +0.0145
- unit
- unitless