rewirebio.iobenchmarks
Evaluation

E1 MDS on grail guardant360 (Helzer et al. 2025)

Published comparison; transcribed, not reproduced.

Evaluation results

1 evaluation · 5 results. Different protocols are not a single leaderboard.

Protocol: Helzer et al. 2025 Razavi et al. 2019 GRAIL cohort, Guardant360 CDx gene subset: multinomial phenotype AUROC · Dataset: Razavi et al. 2019 GRAIL targeted cfDNA cohort as used by Helzer et al. 2025 (198 samples)

Sorted by AUROC (Breast vs all other classes, one-vs-rest, median of 25 replicates; Guardant360 CDx genes) (higher is better). The best value in each column is highlighted. Decimals are rounded for display; each value links to the printed value and its source.

Tested configurationAUROC (Breast vs all other classes, one-vs-rest, median of 25 replicates; Guardant360 CDx genes)AUROC (healthy (Normal) vs all cancers, one-vs-rest, median of 25 replicates; Guardant360 CDx genes)AUROC (Lung vs all other classes, one-vs-rest, median of 25 replicates; Guardant360 CDx genes)AUROC (mean over 4 phenotypes of the median one-vs-rest AUROCs; Guardant360 CDx genes)AUROC (Prostate vs all other classes, one-vs-rest, median of 25 replicates; Guardant360 CDx genes)
End-motif diversity score at first coding exons, GLMnet multinomial classifier (Helzer et al. 2025)Evaluation0.7740.9640.7070.8330.888
All 5 result rows with coverage, uncertainty and sources
Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: End-motif diversity score at first coding exons, GLMnet multinomial classifier (Helzer et al. 2025)Protocol: Helzer et al. 2025 Razavi et al. 2019 GRAIL cohort, Guardant360 CDx gene subset: multinomial phenotype AUROC
Dataset: Razavi et al. 2019 GRAIL targeted cfDNA cohort as used by Helzer et al. 2025 (198 samples)
0.774 AUROC (Breast vs all other classes, one-vs-rest, median of 25 replicates; Guardant360 CDx genes)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

E1 MDS on grail guardant360 (Helzer et al. 2025)

ctdnalit-20261011-helzer2025-protocol-grail-guardant360

Aggregation: Not reported

Analysis of cfDNA fragmentomics metrics and commercial targeted sequencing panels; Helzer et al. 2025, Supplementary Information (Figures S1-S7, Tables S1-S2) · Supplementary Table S1 (PDF caption), block 'Guardant360 CDx', row 'E1 MDS', column 'Breast'
Configuration: End-motif diversity score at first coding exons, GLMnet multinomial classifier (Helzer et al. 2025)Protocol: Helzer et al. 2025 Razavi et al. 2019 GRAIL cohort, Guardant360 CDx gene subset: multinomial phenotype AUROC
Dataset: Razavi et al. 2019 GRAIL targeted cfDNA cohort as used by Helzer et al. 2025 (198 samples)
0.707 AUROC (Lung vs all other classes, one-vs-rest, median of 25 replicates; Guardant360 CDx genes)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

E1 MDS on grail guardant360 (Helzer et al. 2025)

ctdnalit-20261011-helzer2025-protocol-grail-guardant360

Aggregation: Not reported

Analysis of cfDNA fragmentomics metrics and commercial targeted sequencing panels; Helzer et al. 2025, Supplementary Information (Figures S1-S7, Tables S1-S2) · Supplementary Table S1 (PDF caption), block 'Guardant360 CDx', row 'E1 MDS', column 'Lung'
Configuration: End-motif diversity score at first coding exons, GLMnet multinomial classifier (Helzer et al. 2025)Protocol: Helzer et al. 2025 Razavi et al. 2019 GRAIL cohort, Guardant360 CDx gene subset: multinomial phenotype AUROC
Dataset: Razavi et al. 2019 GRAIL targeted cfDNA cohort as used by Helzer et al. 2025 (198 samples)
0.833 AUROC (mean over 4 phenotypes of the median one-vs-rest AUROCs; Guardant360 CDx genes)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

E1 MDS on grail guardant360 (Helzer et al. 2025)

ctdnalit-20261011-helzer2025-protocol-grail-guardant360

Aggregation: Not reported

Analysis of cfDNA fragmentomics metrics and commercial targeted sequencing panels; Helzer et al. 2025, Supplementary Information (Figures S1-S7, Tables S1-S2) · Supplementary Table S1 (PDF caption), block 'Guardant360 CDx', row 'E1 MDS', column 'Mean AUROC'
Configuration: End-motif diversity score at first coding exons, GLMnet multinomial classifier (Helzer et al. 2025)Protocol: Helzer et al. 2025 Razavi et al. 2019 GRAIL cohort, Guardant360 CDx gene subset: multinomial phenotype AUROC
Dataset: Razavi et al. 2019 GRAIL targeted cfDNA cohort as used by Helzer et al. 2025 (198 samples)
0.964 AUROC (healthy (Normal) vs all cancers, one-vs-rest, median of 25 replicates; Guardant360 CDx genes)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

E1 MDS on grail guardant360 (Helzer et al. 2025)

ctdnalit-20261011-helzer2025-protocol-grail-guardant360

Aggregation: Not reported

Analysis of cfDNA fragmentomics metrics and commercial targeted sequencing panels; Helzer et al. 2025, Supplementary Information (Figures S1-S7, Tables S1-S2) · Supplementary Table S1 (PDF caption), block 'Guardant360 CDx', row 'E1 MDS', column 'Normal'
Configuration: End-motif diversity score at first coding exons, GLMnet multinomial classifier (Helzer et al. 2025)Protocol: Helzer et al. 2025 Razavi et al. 2019 GRAIL cohort, Guardant360 CDx gene subset: multinomial phenotype AUROC
Dataset: Razavi et al. 2019 GRAIL targeted cfDNA cohort as used by Helzer et al. 2025 (198 samples)
0.888 AUROC (Prostate vs all other classes, one-vs-rest, median of 25 replicates; Guardant360 CDx genes)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

E1 MDS on grail guardant360 (Helzer et al. 2025)

ctdnalit-20261011-helzer2025-protocol-grail-guardant360

Aggregation: Not reported

Analysis of cfDNA fragmentomics metrics and commercial targeted sequencing panels; Helzer et al. 2025, Supplementary Information (Figures S1-S7, Tables S1-S2) · Supplementary Table S1 (PDF caption), block 'Guardant360 CDx', row 'E1 MDS', column 'Prostate'

Source checking is not independent reproduction. Release 2026-11-21-c8bea25e5abb.

Research readiness

0 of 4 readiness checks met. These checks assess whether the evidence supports a reproducible investigation; a source-checked score alone does not meet them.

Readiness checks, gaps and artifacts

Release 2026-11-21-c8bea25e5abb · Evidence verified: Not verified

Evidence incomplete

Replay metrics

Exact outcomes, predictions, identifiers and evaluator are connected.

Missing or unresolved evidence

  • No verified artifact manifest is linked to this exact record.
  • File checksums match the recorded files: not yet verified
  • Predictions are matched to the right samples: not yet verified
  • Score meaning and direction are confirmed: not yet verified
  • Metrics are recomputed from the saved predictions: not yet verified

Verified: Not verified

Evidence incomplete

Investigate discrepancies

Replay evidence includes annotations and an assessment of dependence. Unknown independence permits descriptive analysis only.

Missing or unresolved evidence

  • No verified artifact manifest is linked to this exact record.
  • File checksums match the recorded files: not yet verified
  • Predictions are matched to the right samples: not yet verified
  • Score meaning and direction are confirmed: not yet verified
  • Metrics are recomputed from the saved predictions: not yet verified
  • Sample annotations are recorded: not yet verified
  • Dependence between samples is assessed: not yet verified

Verified: Not verified

Evidence incomplete

Run locally

A pinned recipe describes the inputs, environment and resource requirements.

Missing or unresolved evidence

  • No verified artifact manifest is linked to this exact record.
  • File checksums match the recorded files: not yet verified
  • Predictions are matched to the right samples: not yet verified
  • Score meaning and direction are confirmed: not yet verified
  • A pinned run recipe exists: not yet verified
  • Compute requirements are estimated: not yet verified

Verified: Not verified

Evidence incomplete

Validate independently

Separate data and exposure records support an independent test.

Missing or unresolved evidence

  • No verified artifact manifest is linked to this exact record.
  • File checksums match the recorded files: not yet verified
  • Predictions are matched to the right samples: not yet verified
  • Score meaning and direction are confirmed: not yet verified
  • Independent validation data exist: not yet verified
  • Overlap with training data is checked: not yet verified

Verified: Not verified

Readiness describes the evidence in this release. Availability on your computer is checked separately when an investigation runs. Existing data exposure can prevent independent validation even when files are available.

Artifacts and reproduction

No verified artifact manifest is connected to this record yet. The gaps above identify what is needed before analysis can begin.

Evaluation procedure

Helzer et al. 2025 Razavi et al. 2019 GRAIL cohort, Guardant360 CDx gene subset: multinomial phenotype AUROC

Configuration
End-motif diversity score at first coding exons, GLMnet multinomial classifier (Helzer et al. 2025)
Protocol
Helzer et al. 2025 Razavi et al. 2019 GRAIL cohort, Guardant360 CDx gene subset: multinomial phenotype AUROC
Dataset
Razavi et al. 2019 GRAIL targeted cfDNA cohort as used by Helzer et al. 2025 (198 samples)
origin
Independent external evaluation
configuration
Primary source as retrieved 2026-10-11
protocol id
ctdnalit-20261011-helzer2025-protocol-grail-guardant360
dataset version
Razavi et al. 2019 (Nature Medicine) GRAIL panel data, as reanalysed by Helzer et al. 2025
split
10-fold cross-validation, 25 seeds, same folds for all metrics
population
151 cancers and 47 healthy donors
inputs
E1 MDS features; Guardant360 CDx genes
adaptation
GLMnet multinomial model trained within each training fold
metric implementation
One-vs-rest AUROC per phenotype from the multinomial model
aggregation
Median over 25 replicates
budget
Not reported

Metadata review: source checked. Unreported conditions prevent automatic comparisons.

Reproduction

Split
10-fold cross-validation, 25 seeds, same folds for all metrics
Adaptation
GLMnet multinomial model trained within each training fold
Scoring implementation
One-vs-rest AUROC per phenotype from the multinomial model

No execution recipe has been verified for this exact configuration and evaluation. A benchmark's general instructions may use different inputs, splits or model settings.

Reproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

38 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Comparison: adaptation
GLMnet multinomial model trained within each training fold
Context-only references
Analysis of cfDNA fragmentomics metrics and commercial targeted sequencing panels

Original source ↗

Supplementary Table S1, block 'Guardant360 CDx', row 'E1 MDS' (text layer line 81)

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Nature Communications 16, published online 2025-10-14; Europe PMC full-text JATS XML of PMC12521513
Retrieved: 2026-10-11T21:40:59Z

not individually reviewed

No individual claim review recorded

independent paper

Audit details

Field: attributes.comparison.adaptation

Source artifact SHA-256: 48e63b9225dd6b4b8f67e25c58a026e9a7183eb790c5900e752a6d2f70ead835

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Comparison: adaptation
GLMnet multinomial model trained within each training fold
Context-only references
Helzer et al. 2025, Supplementary Information (Figures S1-S7, Tables S1-S2)

Original source ↗

Supplementary Table S1, block 'Guardant360 CDx', row 'E1 MDS' (text layer line 81)

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: 41467_2025_64153_MOESM1_ESM.pdf, publisher supplementary file
Retrieved: 2026-10-11T21:41:25Z

not individually reviewed

No individual claim review recorded

independent paper

Audit details

Field: attributes.comparison.adaptation

Source artifact SHA-256: 3fe7690ed5d7227d4b0c51c5d70d69ca947a26da7d51928c45a209b88fe79b6e

Hash scope: pdftotext -layout (poppler 26.08.0) text layer, parsed by extract/extract_helzer2025.py

Inspected artifact

Comparison: aggregation
Median over 25 replicates
Context-only references
Analysis of cfDNA fragmentomics metrics and commercial targeted sequencing panels

Original source ↗

Supplementary Table S1, block 'Guardant360 CDx', row 'E1 MDS' (text layer line 81)

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Nature Communications 16, published online 2025-10-14; Europe PMC full-text JATS XML of PMC12521513
Retrieved: 2026-10-11T21:40:59Z

not individually reviewed

No individual claim review recorded

independent paper

Audit details

Field: attributes.comparison.aggregation

Source artifact SHA-256: 48e63b9225dd6b4b8f67e25c58a026e9a7183eb790c5900e752a6d2f70ead835

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Comparison: aggregation
Median over 25 replicates
Context-only references
Helzer et al. 2025, Supplementary Information (Figures S1-S7, Tables S1-S2)

Original source ↗

Supplementary Table S1, block 'Guardant360 CDx', row 'E1 MDS' (text layer line 81)

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: 41467_2025_64153_MOESM1_ESM.pdf, publisher supplementary file
Retrieved: 2026-10-11T21:41:25Z

not individually reviewed

No individual claim review recorded

independent paper

Audit details

Field: attributes.comparison.aggregation

Source artifact SHA-256: 3fe7690ed5d7227d4b0c51c5d70d69ca947a26da7d51928c45a209b88fe79b6e

Hash scope: pdftotext -layout (poppler 26.08.0) text layer, parsed by extract/extract_helzer2025.py

Inspected artifact

Comparison: budget
Not reported
Context-only references
Analysis of cfDNA fragmentomics metrics and commercial targeted sequencing panels

Original source ↗

Supplementary Table S1, block 'Guardant360 CDx', row 'E1 MDS' (text layer line 81)

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Nature Communications 16, published online 2025-10-14; Europe PMC full-text JATS XML of PMC12521513
Retrieved: 2026-10-11T21:40:59Z

missing or unspecified

No individual claim review recorded

independent paper

Audit details

Field: attributes.comparison.budget

Source artifact SHA-256: 48e63b9225dd6b4b8f67e25c58a026e9a7183eb790c5900e752a6d2f70ead835

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Comparison: budget
Not reported
Context-only references
Helzer et al. 2025, Supplementary Information (Figures S1-S7, Tables S1-S2)

Original source ↗

Supplementary Table S1, block 'Guardant360 CDx', row 'E1 MDS' (text layer line 81)

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: 41467_2025_64153_MOESM1_ESM.pdf, publisher supplementary file
Retrieved: 2026-10-11T21:41:25Z

missing or unspecified

No individual claim review recorded

independent paper

Audit details

Field: attributes.comparison.budget

Source artifact SHA-256: 3fe7690ed5d7227d4b0c51c5d70d69ca947a26da7d51928c45a209b88fe79b6e

Hash scope: pdftotext -layout (poppler 26.08.0) text layer, parsed by extract/extract_helzer2025.py

Inspected artifact

Comparison: dataset version
Razavi et al. 2019 (Nature Medicine) GRAIL panel data, as reanalysed by Helzer et al. 2025
Context-only references
Analysis of cfDNA fragmentomics metrics and commercial targeted sequencing panels

Original source ↗

Supplementary Table S1, block 'Guardant360 CDx', row 'E1 MDS' (text layer line 81)

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Nature Communications 16, published online 2025-10-14; Europe PMC full-text JATS XML of PMC12521513
Retrieved: 2026-10-11T21:40:59Z

not individually reviewed

No individual claim review recorded

independent paper

Audit details

Field: attributes.comparison.dataset_version

Source artifact SHA-256: 48e63b9225dd6b4b8f67e25c58a026e9a7183eb790c5900e752a6d2f70ead835

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Comparison: dataset version
Razavi et al. 2019 (Nature Medicine) GRAIL panel data, as reanalysed by Helzer et al. 2025
Context-only references
Helzer et al. 2025, Supplementary Information (Figures S1-S7, Tables S1-S2)

Original source ↗

Supplementary Table S1, block 'Guardant360 CDx', row 'E1 MDS' (text layer line 81)

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: 41467_2025_64153_MOESM1_ESM.pdf, publisher supplementary file
Retrieved: 2026-10-11T21:41:25Z

not individually reviewed

No individual claim review recorded

independent paper

Audit details

Field: attributes.comparison.dataset_version

Source artifact SHA-256: 3fe7690ed5d7227d4b0c51c5d70d69ca947a26da7d51928c45a209b88fe79b6e

Hash scope: pdftotext -layout (poppler 26.08.0) text layer, parsed by extract/extract_helzer2025.py

Inspected artifact

Comparison: inputs
E1 MDS features; Guardant360 CDx genes
Context-only references
Analysis of cfDNA fragmentomics metrics and commercial targeted sequencing panels

Original source ↗

Supplementary Table S1, block 'Guardant360 CDx', row 'E1 MDS' (text layer line 81)

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Nature Communications 16, published online 2025-10-14; Europe PMC full-text JATS XML of PMC12521513
Retrieved: 2026-10-11T21:40:59Z

not individually reviewed

No individual claim review recorded

independent paper

Audit details

Field: attributes.comparison.inputs

Source artifact SHA-256: 48e63b9225dd6b4b8f67e25c58a026e9a7183eb790c5900e752a6d2f70ead835

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Comparison: inputs
E1 MDS features; Guardant360 CDx genes
Context-only references
Helzer et al. 2025, Supplementary Information (Figures S1-S7, Tables S1-S2)

Original source ↗

Supplementary Table S1, block 'Guardant360 CDx', row 'E1 MDS' (text layer line 81)

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: 41467_2025_64153_MOESM1_ESM.pdf, publisher supplementary file
Retrieved: 2026-10-11T21:41:25Z

not individually reviewed

No individual claim review recorded

independent paper

Audit details

Field: attributes.comparison.inputs

Source artifact SHA-256: 3fe7690ed5d7227d4b0c51c5d70d69ca947a26da7d51928c45a209b88fe79b6e

Hash scope: pdftotext -layout (poppler 26.08.0) text layer, parsed by extract/extract_helzer2025.py

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

2 source records and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: ctdnalit-20261011-helzer2025-eval-grail-guardant360-e1-mds

areas
dna-genomes
contexts
clinical_research
origin
independent_paper
protocol
ctdnalit-20261011-helzer2025-protocol-grail-guardant360
version
Primary source as retrieved 2026-10-11
comparison
protocol id: ctdnalit-20261011-helzer2025-protocol-grail-guardant360; dataset version: Razavi et al. 2019 (Nature Medicine) GRAIL panel data, as reanalysed by Helzer et al. 2025; split: 10-fold cross-validation, 25 seeds, same folds for all metrics; population: 151 cancers and 47 healthy donors; inputs: E1 MDS features; Guardant360 CDx genes; adaptation: GLMnet multinomial model trained within each training fold; metric implementation: One-vs-rest AUROC per phenotype from the multinomial model; aggregation: Median over 25 replicates; budget: Not reported
source locator
Supplementary Table S1, block 'Guardant360 CDx', row 'E1 MDS' (text layer line 81)
limitations
Re-implemented by the authors on panel exons from a whole-genome method published by another group.
missing metadata
comparison.budget: reason: inapplicable
Related records

Suggest a correction