rewirebio.iobenchmarks
Evaluation

DELFI 2019 internally cross-validated cancer detection

DELFI 2019 internally cross-validated cancer detection; bounded primary-source candidate.

Evaluation results

1 evaluation · 1 result. Different protocols are not a single leaderboard.

Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: DELFI 2019 internally cross-validated cancer detection tested configurationProtocol: DELFI 2019 internally cross-validated cancer detection protocol
Dataset: DELFI 2019 internally cross-validated cancer detection cohort
73% Sensitivity at 98% specificity
percent · higher

Uncertainty: 95% CI 67 to 79

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

DELFI 2019 internally cross-validated cancer detection

amp-20261007-ctdna-fragmentomics-protocol

Aggregation: Not reported

Cristiano et al., Nature 570, 385–389 (2019), author manuscript PMC6774252 · PMC6774252 Table 1 T1 Cancer row / 98% specificity columns; Results P15; Methods P34; Extended Data Fig. 7 F11.

Source checking is not independent reproduction. Release 2026-11-21-c8bea25e5abb.

Research readiness

0 of 4 readiness checks met. These checks assess whether the evidence supports a reproducible investigation; a source-checked score alone does not meet them.

Readiness checks, gaps and artifacts

Release 2026-11-21-c8bea25e5abb · Evidence verified: Not verified

Evidence incomplete

Replay metrics

Exact outcomes, predictions, identifiers and evaluator are connected.

Missing or unresolved evidence

  • No verified artifact manifest is linked to this exact record.
  • File checksums match the recorded files: not yet verified
  • Predictions are matched to the right samples: not yet verified
  • Score meaning and direction are confirmed: not yet verified
  • Metrics are recomputed from the saved predictions: not yet verified

Verified: Not verified

Evidence incomplete

Investigate discrepancies

Replay evidence includes annotations and an assessment of dependence. Unknown independence permits descriptive analysis only.

Missing or unresolved evidence

  • No verified artifact manifest is linked to this exact record.
  • File checksums match the recorded files: not yet verified
  • Predictions are matched to the right samples: not yet verified
  • Score meaning and direction are confirmed: not yet verified
  • Metrics are recomputed from the saved predictions: not yet verified
  • Sample annotations are recorded: not yet verified
  • Dependence between samples is assessed: not yet verified

Verified: Not verified

Evidence incomplete

Run locally

A pinned recipe describes the inputs, environment and resource requirements.

Missing or unresolved evidence

  • No verified artifact manifest is linked to this exact record.
  • File checksums match the recorded files: not yet verified
  • Predictions are matched to the right samples: not yet verified
  • Score meaning and direction are confirmed: not yet verified
  • A pinned run recipe exists: not yet verified
  • Compute requirements are estimated: not yet verified

Verified: Not verified

Evidence incomplete

Validate independently

Separate data and exposure records support an independent test.

Missing or unresolved evidence

  • No verified artifact manifest is linked to this exact record.
  • File checksums match the recorded files: not yet verified
  • Predictions are matched to the right samples: not yet verified
  • Score meaning and direction are confirmed: not yet verified
  • Independent validation data exist: not yet verified
  • Overlap with training data is checked: not yet verified

Verified: Not verified

Readiness describes the evidence in this release. Availability on your computer is checked separately when an investigation runs. Existing data exposure can prevent independent validation even when files are available.

Artifacts and reproduction

No verified artifact manifest is connected to this record yet. The gaps above identify what is needed before analysis can begin.

Evaluation procedure

DELFI 2019 internally cross-validated cancer detection protocol

Configuration
DELFI 2019 internally cross-validated cancer detection tested configuration
Protocol
DELFI 2019 internally cross-validated cancer detection protocol
Dataset
DELFI 2019 internally cross-validated cancer detection cohort
origin
Author-reported evaluation
configuration
Not reported
adaptation
Supervised cohort-specific gradient boosting; not a foundation model
aggregation
Not reported
budget
Not reported
dataset version
Not reported
inputs
Plasma cfDNA whole-genome fragmentation and copy-number features; composite cfDNA includes background and tumour-derived signal
metric implementation
sensitivity_at_reported_98_percent_specificity
population
208 patients with seven cancer types and 215 healthy individuals used for classifier; broader study abstract 236 cancers/245 healthy is not classifier denominator.
protocol id
amp-20261007-ctdna-fragmentomics-protocol
split
10-fold cross-validation repeated 10 times; feature selection and model estimation on training folds only

Metadata review: source checked. Unreported conditions prevent automatic comparisons.

Reproduction

Split
10-fold cross-validation repeated 10 times; feature selection and model estimation on training folds only
Adaptation
Supervised cohort-specific gradient boosting; not a foundation model
Scoring implementation
sensitivity_at_reported_98_percent_specificity

No execution recipe has been verified for this exact configuration and evaluation. A benchmark's general instructions may use different inputs, splits or model settings.

Reproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

19 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Comparison: adaptation
Supervised cohort-specific gradient boosting; not a foundation model
Context-only references
Cristiano et al., Nature 570, 385–389 (2019), author manuscript PMC6774252

Original source ↗

PMC6774252 Table 1 T1 Cancer row / 98% specificity columns; Results P15; Methods P34; Extended Data Fig. 7 F11.

Version: Cristiano et al., Nature 570, 385–389 (2019), author manuscript PMC6774252
Retrieved: 2026-10-07T12:24:27.091080+00:00

not individually reviewed

No individual claim review recorded

author reported

Audit details

Field: attributes.comparison.adaptation

Source artifact SHA-256: 192730a334f4752575543fb6bd9d13faa84eb27e939d918363cfe633c0358322

Hash scope: Hash scope not separately documented; inspect source record

Format: curator_factual_receipt

Comparison: aggregation
Not reported
Context-only references
Cristiano et al., Nature 570, 385–389 (2019), author manuscript PMC6774252

Original source ↗

PMC6774252 Table 1 T1 Cancer row / 98% specificity columns; Results P15; Methods P34; Extended Data Fig. 7 F11.

Version: Cristiano et al., Nature 570, 385–389 (2019), author manuscript PMC6774252
Retrieved: 2026-10-07T12:24:27.091080+00:00

missing or unspecified

No individual claim review recorded

author reported

Audit details

Field: attributes.comparison.aggregation

Source artifact SHA-256: 192730a334f4752575543fb6bd9d13faa84eb27e939d918363cfe633c0358322

Hash scope: Hash scope not separately documented; inspect source record

Format: curator_factual_receipt

Comparison: budget
Not reported
Context-only references
Cristiano et al., Nature 570, 385–389 (2019), author manuscript PMC6774252

Original source ↗

PMC6774252 Table 1 T1 Cancer row / 98% specificity columns; Results P15; Methods P34; Extended Data Fig. 7 F11.

Version: Cristiano et al., Nature 570, 385–389 (2019), author manuscript PMC6774252
Retrieved: 2026-10-07T12:24:27.091080+00:00

missing or unspecified

No individual claim review recorded

author reported

Audit details

Field: attributes.comparison.budget

Source artifact SHA-256: 192730a334f4752575543fb6bd9d13faa84eb27e939d918363cfe633c0358322

Hash scope: Hash scope not separately documented; inspect source record

Format: curator_factual_receipt

Comparison: dataset version
Not reported
Context-only references
Cristiano et al., Nature 570, 385–389 (2019), author manuscript PMC6774252

Original source ↗

PMC6774252 Table 1 T1 Cancer row / 98% specificity columns; Results P15; Methods P34; Extended Data Fig. 7 F11.

Version: Cristiano et al., Nature 570, 385–389 (2019), author manuscript PMC6774252
Retrieved: 2026-10-07T12:24:27.091080+00:00

missing or unspecified

No individual claim review recorded

author reported

Audit details

Field: attributes.comparison.dataset_version

Source artifact SHA-256: 192730a334f4752575543fb6bd9d13faa84eb27e939d918363cfe633c0358322

Hash scope: Hash scope not separately documented; inspect source record

Format: curator_factual_receipt

Comparison: inputs
Plasma cfDNA whole-genome fragmentation and copy-number features; composite cfDNA includes background and tumour-derived signal
Context-only references
Cristiano et al., Nature 570, 385–389 (2019), author manuscript PMC6774252

Original source ↗

PMC6774252 Table 1 T1 Cancer row / 98% specificity columns; Results P15; Methods P34; Extended Data Fig. 7 F11.

Version: Cristiano et al., Nature 570, 385–389 (2019), author manuscript PMC6774252
Retrieved: 2026-10-07T12:24:27.091080+00:00

not individually reviewed

No individual claim review recorded

author reported

Audit details

Field: attributes.comparison.inputs

Source artifact SHA-256: 192730a334f4752575543fb6bd9d13faa84eb27e939d918363cfe633c0358322

Hash scope: Hash scope not separately documented; inspect source record

Format: curator_factual_receipt

Comparison: metric implementation
sensitivity_at_reported_98_percent_specificity
Context-only references
Cristiano et al., Nature 570, 385–389 (2019), author manuscript PMC6774252

Original source ↗

PMC6774252 Table 1 T1 Cancer row / 98% specificity columns; Results P15; Methods P34; Extended Data Fig. 7 F11.

Version: Cristiano et al., Nature 570, 385–389 (2019), author manuscript PMC6774252
Retrieved: 2026-10-07T12:24:27.091080+00:00

not individually reviewed

No individual claim review recorded

author reported

Audit details

Field: attributes.comparison.metric_implementation

Source artifact SHA-256: 192730a334f4752575543fb6bd9d13faa84eb27e939d918363cfe633c0358322

Hash scope: Hash scope not separately documented; inspect source record

Format: curator_factual_receipt

Comparison: population
208 patients with seven cancer types and 215 healthy individuals used for classifier; broader study abstract 236 cancers/245 healthy is not classifier denominator.
Context-only references
Cristiano et al., Nature 570, 385–389 (2019), author manuscript PMC6774252

Original source ↗

PMC6774252 Table 1 T1 Cancer row / 98% specificity columns; Results P15; Methods P34; Extended Data Fig. 7 F11.

Version: Cristiano et al., Nature 570, 385–389 (2019), author manuscript PMC6774252
Retrieved: 2026-10-07T12:24:27.091080+00:00

not individually reviewed

No individual claim review recorded

author reported

Audit details

Field: attributes.comparison.population

Source artifact SHA-256: 192730a334f4752575543fb6bd9d13faa84eb27e939d918363cfe633c0358322

Hash scope: Hash scope not separately documented; inspect source record

Format: curator_factual_receipt

Comparison: protocol id
amp-20261007-ctdna-fragmentomics-protocol
Context-only references
Cristiano et al., Nature 570, 385–389 (2019), author manuscript PMC6774252

Original source ↗

PMC6774252 Table 1 T1 Cancer row / 98% specificity columns; Results P15; Methods P34; Extended Data Fig. 7 F11.

Version: Cristiano et al., Nature 570, 385–389 (2019), author manuscript PMC6774252
Retrieved: 2026-10-07T12:24:27.091080+00:00

not individually reviewed

No individual claim review recorded

author reported

Audit details

Field: attributes.comparison.protocol_id

Source artifact SHA-256: 192730a334f4752575543fb6bd9d13faa84eb27e939d918363cfe633c0358322

Hash scope: Hash scope not separately documented; inspect source record

Format: curator_factual_receipt

Comparison: split
10-fold cross-validation repeated 10 times; feature selection and model estimation on training folds only
Context-only references
Cristiano et al., Nature 570, 385–389 (2019), author manuscript PMC6774252

Original source ↗

PMC6774252 Table 1 T1 Cancer row / 98% specificity columns; Results P15; Methods P34; Extended Data Fig. 7 F11.

Version: Cristiano et al., Nature 570, 385–389 (2019), author manuscript PMC6774252
Retrieved: 2026-10-07T12:24:27.091080+00:00

not individually reviewed

No individual claim review recorded

author reported

Audit details

Field: attributes.comparison.split

Source artifact SHA-256: 192730a334f4752575543fb6bd9d13faa84eb27e939d918363cfe633c0358322

Hash scope: Hash scope not separately documented; inspect source record

Format: curator_factual_receipt

Conventional baseline
Same Fig. 4/Results P15 feature comparisons: chromosomal-arm copy number ML AUC 0.88, individual copy-number scores AUC 0.78, mitochondrial copy number AUC 0.72; separate ROC endpoints, not sensitivity-matched comparisons.
Context-only references
Cristiano et al., Nature 570, 385–389 (2019), author manuscript PMC6774252

Original source ↗

PMC6774252 Table 1 T1 Cancer row / 98% specificity columns; Results P15; Methods P34; Extended Data Fig. 7 F11.

Version: Cristiano et al., Nature 570, 385–389 (2019), author manuscript PMC6774252
Retrieved: 2026-10-07T12:24:27.091080+00:00

not individually reviewed

No individual claim review recorded

author reported

Audit details

Field: attributes.conventional_baseline

Source artifact SHA-256: 192730a334f4752575543fb6bd9d13faa84eb27e939d918363cfe633c0358322

Hash scope: Hash scope not separately documented; inspect source record

Format: curator_factual_receipt

How to read the evidence

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: amp-20261007-ctdna-fragmentomics-evaluation

areas
dna-genomes
method types
supervised_machine_learning
tasks
cancer_detection
comparison
adaptation: Supervised cohort-specific gradient boosting; not a foundation model; aggregation: Not reported; budget: Not reported; dataset version: Not reported; inputs: Plasma cfDNA whole-genome fragmentation and copy-number features; composite cfDNA includes background and tumour-derived signal; metric implementation: sensitivity_at_reported_98_percent_specificity; population: 208 patients with seven cancer types and 215 healthy individuals used for classifier; broader study abstract 236 cancers/245 healthy is not classifier denominator.; protocol id: amp-20261007-ctdna-fragmentomics-protocol; split: 10-fold cross-validation repeated 10 times; feature selection and model estimation on training folds only
conventional baseline
Same Fig. 4/Results P15 feature comparisons: chromosomal-arm copy number ML AUC 0.88, individual copy-number scores AUC 0.78, mitochondrial copy number AUC 0.72; separate ROC endpoints, not sensitivity-matched comparisons.
limitations
4 of 215 healthy individuals misclassified at source-labelled 98% specificity. Retain rounded printed specificity; do not recompute sensitivity.; Internal repeated cross-validation is not independent prospective screening validation; clinically identified cancers and healthy comparators differ from intended screening population.; DELFI composite features include CNAs/mtDNA, so this exact result is not pure fragmentation alone.; cfDNA signal is not purified ctDNA, tumour fraction limit is unreported for this endpoint.; Combined mutation+DELFI 115/126 (91%) is a different subset/configuration and is excluded.
missing metadata
aggregation: reason: unextracted; note: Endpoint-specific weighting in source where noted; budget: reason: unextracted; note: Not extracted; no execution; version: reason: unextracted
origin
author_reported
protocol
amp-20261007-ctdna-fragmentomics-protocol
source locator
PMC6774252 Table 1 T1 Cancer row / 98% specificity columns; Results P15; Methods P34; Extended Data Fig. 7 F11.
Related records

Suggest a correction