rewirebio.iobenchmarks
Evidence claim

HyPLM report: figure1b dplm 650m lost

Head to head of HyPLM technical report protein language model evaluation

Figure 1b prints 14 task splits lost by HyPLM-Flash against DPLM-650M, on min-max normalised scores. Figure 1's axis reads 'of 35' but the report never defines its 35 task splits against the 32 tasks of Tables 6 and 7, and the won and lost labels of the ESM-2 650M row sum to 34 while the other seven rows sum to 35, so the denominator is not established. Appendix A also records that three regression splits are left out of Figure 1 altogether.

Descriptive fact read from the pinned sources at the locator given; not a measurement on a benchmark panel.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

6 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Claimed field
head_to_head
Context-only references
HyPLM Technical Report (Hyra Team, 2026-10-12)

Original source ↗

Figure 1b, row 'DPLM-650M', lost label (page 1)

Version: Dated 2026-10-12 on page 1; retrieved at commit 0dcc533cc9f8f76c90ecbfe944df816b6672328a (13 pages)
Retrieved: 2026-11-06T11:08:21Z

not individually reviewed

No individual claim review recorded

Source has a recorded evidence concern. Consult its source page before using the claim.

Audit details

Field: attributes.field

Source artifact SHA-256: d81d88a415a91c2b00d8e97513a90c03ccffd857ec75033fa7de77227dea1710

Hash scope: pdftotext -layout text layer, parsed by extract/parse.py with every row label, metric label and cell count asserted.

Inspected artifact

Source location
Figure 1b, row 'DPLM-650M', lost label (page 1)
Context-only references
HyPLM Technical Report (Hyra Team, 2026-10-12)

Original source ↗

Figure 1b, row 'DPLM-650M', lost label (page 1)

Version: Dated 2026-10-12 on page 1; retrieved at commit 0dcc533cc9f8f76c90ecbfe944df816b6672328a (13 pages)
Retrieved: 2026-11-06T11:08:21Z

not individually reviewed

No individual claim review recorded

Source has a recorded evidence concern. Consult its source page before using the claim.

Audit details

Field: attributes.source_locator

Source artifact SHA-256: d81d88a415a91c2b00d8e97513a90c03ccffd857ec75033fa7de77227dea1710

Hash scope: pdftotext -layout text layer, parsed by extract/parse.py with every row label, metric label and cell count asserted.

Inspected artifact

Claimed value
Figure 1b prints 14 task splits lost by HyPLM-Flash against DPLM-650M, on min-max normalised scores. Figure 1's axis reads 'of 35' but the report never defines its 35 task splits against the 32 tasks of Tables 6 and 7, and the won and lost labels of the ESM-2 650M row sum to 34 while the other seven rows sum to 35, so the denominator is not established. Appendix A also records that three regression splits are left out of Figure 1 altogether.
Context-only references
HyPLM Technical Report (Hyra Team, 2026-10-12)

Original source ↗

Figure 1b, row 'DPLM-650M', lost label (page 1)

Version: Dated 2026-10-12 on page 1; retrieved at commit 0dcc533cc9f8f76c90ecbfe944df816b6672328a (13 pages)
Retrieved: 2026-11-06T11:08:21Z

not individually reviewed

No individual claim review recorded

Source has a recorded evidence concern. Consult its source page before using the claim.

Audit details

Field: attributes.value

Source artifact SHA-256: d81d88a415a91c2b00d8e97513a90c03ccffd857ec75033fa7de77227dea1710

Hash scope: pdftotext -layout text layer, parsed by extract/parse.py with every row label, metric label and cell count asserted.

Inspected artifact

Description
Descriptive fact read from the pinned sources at the locator given; not a measurement on a benchmark panel.
Context-only references
HyPLM Technical Report (Hyra Team, 2026-10-12)

Original source ↗

Figure 1b, row 'DPLM-650M', lost label (page 1)

Version: Dated 2026-10-12 on page 1; retrieved at commit 0dcc533cc9f8f76c90ecbfe944df816b6672328a (13 pages)
Retrieved: 2026-11-06T11:08:21Z

not individually reviewed

No individual claim review recorded

Source has a recorded evidence concern. Consult its source page before using the claim.

Audit details

Field: description

Source artifact SHA-256: d81d88a415a91c2b00d8e97513a90c03ccffd857ec75033fa7de77227dea1710

Hash scope: pdftotext -layout text layer, parsed by extract/parse.py with every row label, metric label and cell count asserted.

Inspected artifact

Relationship: subject
hyplm-flash-20261106-benchmark-report-evaluation
Context-only references
HyPLM Technical Report (Hyra Team, 2026-10-12)

Original source ↗

Figure 1b, row 'DPLM-650M', lost label (page 1)

Version: Dated 2026-10-12 on page 1; retrieved at commit 0dcc533cc9f8f76c90ecbfe944df816b6672328a (13 pages)
Retrieved: 2026-11-06T11:08:21Z

not individually reviewed

No individual claim review recorded

Source has a recorded evidence concern. Consult its source page before using the claim.

Audit details

Field: links:subject:hyplm-flash-20261106-benchmark-report-evaluation

Source artifact SHA-256: d81d88a415a91c2b00d8e97513a90c03ccffd857ec75033fa7de77227dea1710

Hash scope: pdftotext -layout text layer, parsed by extract/parse.py with every row label, metric label and cell count asserted.

Inspected artifact

Name
HyPLM report: figure1b dplm 650m lost
Context-only references
HyPLM Technical Report (Hyra Team, 2026-10-12)

Original source ↗

Figure 1b, row 'DPLM-650M', lost label (page 1)

Version: Dated 2026-10-12 on page 1; retrieved at commit 0dcc533cc9f8f76c90ecbfe944df816b6672328a (13 pages)
Retrieved: 2026-11-06T11:08:21Z

not individually reviewed

No individual claim review recorded

Source has a recorded evidence concern. Consult its source page before using the claim.

Audit details

Field: name

Source artifact SHA-256: d81d88a415a91c2b00d8e97513a90c03ccffd857ec75033fa7de77227dea1710

Hash scope: pdftotext -layout text layer, parsed by extract/parse.py with every row label, metric label and cell count asserted.

Inspected artifact

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: hyplm-flash-20261106-claim-benchmark-figure1b-dplm-650m-lost

areas
protein-function; proteins-complexes
contexts
research
field
head_to_head
review
artifact sha256: d81d88a415a91c2b00d8e97513a90c03ccffd857ec75033fa7de77227dea1710; method: independent-cell-check; deterministic-table-parse; pdf-text-parse; source-hash-verification; method note: Independent review pass. All six pinned artifacts were re-downloaded at the pinned commit and their SHA-256 checked against the source records; pdftotext -layout reproduced the archived text layer byte for byte. npm run batch -- check-values was run over the whole batch (value-check.tsv). The 469 recorded cells of Tables 3, 5, 6 and 7 were then re-read by a reviewer script written for this pass, which takes each table's column order from its printed header line and splits every body row by printed cell, without using extract/parse.py; every printed value and column matched. The two arithmetic constraints were re-derived independently rather than taken from the extractor's checker: each Table 3 perplexity against exp of its NLL over the NLL's own rounding interval, and each Table 5 average against the mean of its five categories. Column assignment in Tables 6 and 7 is anchored outside those tables, by Table 3's NLL values and by Figure 3a's and Table 5's ProteinGym values, and the four printed paired differences reconcile with the Table 6 ProteinGym row. The 15 locators check-values cannot parse, four Figure 3a bar labels and eleven prose values, were read by hand against the text layer; in Figure 3a each bar label and its value share one line. extract/check_cells.py was rerun and reproduces cell-check.tsv.; retrieval url: https://raw.githubusercontent.com/Tencent-Hunyuan/Hyra-results/0dcc533cc9f8f76c90ecbfe944df816b6672328a/AI4Science/hyplm_flash/HyPLM_Technical_Report.pdf; reviewed at: 2026-11-06T00:00:00Z; reviewer: claude; reviewer note: Claude research agent; no human review claimed. Reviewed by a different agent from the one that extracted the batch. Transcription checked against the pinned source; nothing was reproduced and no value was recomputed.
source locator
Figure 1b, row 'DPLM-650M', lost label (page 1)
value
Figure 1b prints 14 task splits lost by HyPLM-Flash against DPLM-650M, on min-max normalised scores. Figure 1's axis reads 'of 35' but the report never defines its 35 task splits against the 32 tasks of Tables 6 and 7, and the won and lost labels of the ESM-2 650M row sum to 34 while the other seven rows sum to 35, so the denominator is not established. Appendix A also records that three regression splits are left out of Figure 1 altogether.
Related records

Suggest a correction