rewirebio.iobenchmarks
Result

AUROC (AUC for pathological complete response, HER2+ tumours, model fitted on TransNEO and applied unchanged) of Ladon deconvolution composition + L2 logistic regression (breast cancer pCR) on DFCI inflammatory breast cancer HER2+ patients (22, 9 pCR)

0.73 AUROC (AUC for pathological complete response, HER2+ tumours, model fitted on TransNEO and applied unchanged)

Methods

Tested configuration
Ladon deconvolution composition + L2 logistic regression (breast cancer pCR)
Protocol
Breast cancer pCR, HER2+ external cohorts, AUC of a model fitted on TransNEO
Dataset subset
DFCI inflammatory breast cancer HER2+ patients (22, 9 pCR)
Procedure
Breast cancer pCR, HER2+ external cohorts, AUC of a model fitted on TransNEO
Evaluation
Ladon deconvolution, DFCI IBC HER2+, pCR AUC
Coverage
Not reported scored / Not reported eligible
Uncertainty
95% CI 0.50 to 0.93. Percentile bootstrap resampling the cohort's patients; resamples with a single class discarded (page 39).
Evidence
Author-reported evaluation · source checkedLadon: An RNA Foundation Model for Predicting Patient Outcomes (Zenodo PDF) · Figure 18 (page 35), panel 'HER2+' cohort 'DFCI IBC', row 'Ladon deconvolution', column 'AUC [95% CI]'

A source-checked result verifies the numerical transcription, not every model or protocol detail. Evaluation metadata: source checked. Source checked does not mean independently reproduced.

Reproduction

Split
External cohort; model fitted on TransNEO
Adaptation
Inferred 12-class composition, L2 logistic regression fitted on TransNEO
Scoring implementation
AUC

No execution recipe has been verified for this exact configuration and evaluation. A benchmark's general instructions may use different inputs, splits or model settings.

Reproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

1 evidence row matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Reported result
0.73
Individual claims
Ladon: An RNA Foundation Model for Predicting Patient Outcomes (Zenodo PDF)

Original source ↗

Figure 18 (page 35), panel 'HER2+' cohort 'DFCI IBC', row 'Ladon deconvolution', column 'AUC [95% CI]'

Version: Zenodo record 24157116 (version DOI 10.5281/zenodo.24157116; concept DOI 10.5281/zenodo.24157115), file Ladon-An-RNA-Foundation-Model-for-Predicting-Patient-Outcomes.pdf, 47 pages, dated 12 November 2026
Retrieved: 2026-11-15T20:29:10Z

source checked

["independent-cell-check","pdf-text-parse","source-hash-verification"] · 2026-11-15T23:30:00Z

author reported

Audit details

Figure 18 prints 0.73 and the page 34 prose prints 0.74 for the same AUC. Confirmed as one value rounded two ways, not two values: the figure page holds 0.735 and renders it with toFixed(2), which gives 0.73 because 0.735 is below 0.735 in binary floating point, while the prose rounds half up. The figure's value is stored, the locator names the figure, and attributes.source_discrepancy records the conflict. No evidence concern: the difference is 0.005 against a printed interval of [0.50, 0.93].

Field: attributes.printed_value

Source artifact SHA-256: 64edf7c3c956c50a65aa01a0dcaa13f0cfef28ab4373ecfd50c431e67143893c

Hash scope: Hash scope not separately documented; inspect source record

Extraction artifact SHA-256: 64edf7c3c956c50a65aa01a0dcaa13f0cfef28ab4373ecfd50c431e67143893c

Extraction artifact

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: ladon-20261115-result-fig18-ladon-deconvolution-dfci-ibc-her2-pos

areas
rna-transcriptomes
contexts
clinical_research
metric
auroc
metric direction
higher
metric qualifier
AUC for pathological complete response, HER2+ tumours, model fitted on TransNEO and applied unchanged
numeric value
0.73
printed value
0.73
review
artifact sha256: 64edf7c3c956c50a65aa01a0dcaa13f0cfef28ab4373ecfd50c431e67143893c; method: independent-cell-check; pdf-text-parse; source-hash-verification; method note: Independent review pass. The Zenodo PDF was re-downloaded and its SHA-256 and MD5 checked against the source record and the Zenodo file checksum; the three HTML sources were refetched and all three hashes matched. The report prints no tables, so npm run batch -- check-values cannot place any locator and reports locator_not_parsed for all 101 results; value-check.tsv is kept as that record. All 101 were therefore re-read by review/check_figure_labels.py, written for this pass and using neither of the extractor's scripts: it reads the word-level geometry of a pdftotext -bbox-layout run and places every cell by its x and y coordinates, so each value is tied to the row whose label it sits beside and to the column or panel whose printed header it sits under, rather than to a line of a -layout text layer or a character offset. Figure 2's three panels and Figure 17's two columns were resolved by clustering the value positions and ordering the clusters by the printed headers; every printed 95% interval was matched to the result's uncertainty bounds. 113 checks, no disagreement. Three arithmetic constraints were re-derived: Figure 17's five per-lineage Pearson r values average to the bottom chart's overall r for both Ladon (0.872 against a printed 0.87) and CIBERSORT (0.594 against 0.600), which independently fixes which of the two numbers in each lineage label is Ladon's; Figure 2's pan-cancer bar differs from the mean of its two transfer bars, as the caption requires; and Figure 14's in-figure top-5% label agrees with the page 27 prose. A manual sample was read by eye from the -layout text layer: all 24 Figure 2 cells, all 14 Figure 3 OS and PFS values, all 10 Figure 18 AUCs with their intervals, and the Figure 5, 11, 12a, 13 and 17 readouts, with column and panel assignment checked in each. Figure 2's 24 cells, Figure 3's 14 and Figure 18's 10 AUCs and intervals were confirmed a third time against the facet and row keys of the authors' own figure pages.; note: Figure 18 prints 0.73 and the page 34 prose prints 0.74 for the same AUC. Confirmed as one value rounded two ways, not two values: the figure page holds 0.735 and renders it with toFixed(2), which gives 0.73 because 0.735 is below 0.735 in binary floating point, while the prose rounds half up. The figure's value is stored, the locator names the figure, and attributes.source_discrepancy records the conflict. No evidence concern: the difference is 0.005 against a printed interval of [0.50, 0.93].; retrieval url: https://zenodo.org/api/records/24157116/files/Ladon-An-RNA-Foundation-Model-for-Predicting-Patient-Outcomes.pdf/content; reviewed at: 2026-11-15T23:30:00Z; reviewer: claude; reviewer note: Claude review agent, independent of the extractor; no human review claimed. Transcription was checked against the pinned sources, which is not reproduction: nothing was rerun and no value was recomputed.
rounding note
Stored as printed in the figure (0.73); the prose rounds the same value to 0.74.
source discrepancy
Figure 18 prints 0.73 [0.50, 0.93]; the page 34 prose says 0.74. The web figure data holds 0.735, so the two are the same value rounded differently.
source locator
Figure 18 (page 35), panel 'HER2+' cohort 'DFCI IBC', row 'Ladon deconvolution', column 'AUC [95% CI]'
uncertainty
level: 0.95; lower: 0.50; method: bootstrap_percentile; note: Percentile bootstrap resampling the cohort's patients; resamples with a single class discarded (page 39).; printed: 0.73 [0.50, 0.93]; resamples: 2000; type: confidence_interval; upper: 0.93
unit
unitless
Related records

Suggest a correction