Relevance of ctdnajam-20261010-protocol-ccga1-validation-sens-98spec to "Which measured methylation workflow detects tumour-derived plasma DNA and, where separately supported, identifies tissue of origin?"
- Use case
- Select a plasma ctDNA methylation detection workflow
- Assessed by
- CCGA substudy 1 validation set: cancer signal sensitivity at 98% specificity
- Relevance
- Direct evidence
- Endpoint
- Sensitivity (95% CI, TP/total) at 98% specificity on the validation set (464 cancers, 362 non-cancers) for the whole-genome methylation classifier and the five other classifiers analysed double-blinded, with paired McNemar tests against whole-genome methylation
Measures the use case's endpoint on a held-out set: whole-genome methylation reached 34% (30%-39%) against 16% to 33% for single non-methylation cfDNA classifiers on the same participants. Developer-run, case-control, with a post hoc threshold.
6 reviewed evaluations
- clinical data on CCGA substudy 1 validation set: cancer signal sensitivity at 98% specificity
- SCNA on CCGA substudy 1 validation set: cancer signal sensitivity at 98% specificity
- SCNA-WBC on CCGA substudy 1 validation set: cancer signal sensitivity at 98% specificity
- SNV on CCGA substudy 1 validation set: cancer signal sensitivity at 98% specificity
- SNV-WBC on CCGA substudy 1 validation set: cancer signal sensitivity at 98% specificity
- WG methylation on CCGA substudy 1 validation set: cancer signal sensitivity at 98% specificity
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
21 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
Citation locations1 values
| Evaluation of cell-free DNA approaches for multi-cancer early detection ctdnajam-20261010-source-jamshidi2022: Table 3, validation columns and footnotes Version: Cancer Cell 40(12):1537-1549.e12, published 2022-12-12; publisher PDF (1-s2.0-S153561082200513X-main.pdf) as deposited by the Francis Crick Institute on figshare, 10.25418/crick.21731870.v1 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: pdftotext -layout text layer, parsed by extract/extract_ctdna_jamshidi.py |
| Comparison group jamshidi2022-ccga1-detection Context-only references | Evaluation of cell-free DNA approaches for multi-cancer early detection ctdnajam-20261010-source-jamshidi2022: Table 3, validation columns and footnotes Version: Cancer Cell 40(12):1537-1549.e12, published 2022-12-12; publisher PDF (1-s2.0-S153561082200513X-main.pdf) as deposited by the Francis Crick Institute on figshare, 10.25418/crick.21731870.v1 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: pdftotext -layout text layer, parsed by extract/extract_ctdna_jamshidi.py |
| Comparison title CCGA substudy 1: cfDNA classifiers on the same participants at a post hoc 98% specificity Context-only references | Evaluation of cell-free DNA approaches for multi-cancer early detection ctdnajam-20261010-source-jamshidi2022: Table 3, validation columns and footnotes Version: Cancer Cell 40(12):1537-1549.e12, published 2022-12-12; publisher PDF (1-s2.0-S153561082200513X-main.pdf) as deposited by the Francis Crick Institute on figshare, 10.25418/crick.21731870.v1 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: pdftotext -layout text layer, parsed by extract/extract_ctdna_jamshidi.py |
Constraints3 values
| Evaluation of cell-free DNA approaches for multi-cancer early detection ctdnajam-20261010-source-jamshidi2022: Table 3, validation columns and footnotes Version: Cancer Cell 40(12):1537-1549.e12, published 2022-12-12; publisher PDF (1-s2.0-S153561082200513X-main.pdf) as deposited by the Francis Crick Institute on figshare, 10.25418/crick.21731870.v1 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: pdftotext -layout text layer, parsed by extract/extract_ctdna_jamshidi.py |
| Endpoint Sensitivity (95% CI, TP/total) at 98% specificity on the validation set (464 cancers, 362 non-cancers) for the whole-genome methylation classifier and the five other classifiers analysed double-blinded, with paired McNemar tests against whole-genome methylation Context-only references | Evaluation of cell-free DNA approaches for multi-cancer early detection ctdnajam-20261010-source-jamshidi2022: Table 3, validation columns and footnotes Version: Cancer Cell 40(12):1537-1549.e12, published 2022-12-12; publisher PDF (1-s2.0-S153561082200513X-main.pdf) as deposited by the Francis Crick Institute on figshare, 10.25418/crick.21731870.v1 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: pdftotext -layout text layer, parsed by extract/extract_ctdna_jamshidi.py |
Excluded evaluations4 values
| Evaluation of cell-free DNA approaches for multi-cancer early detection ctdnajam-20261010-source-jamshidi2022: Table 3, validation columns and footnotes Version: Cancer Cell 40(12):1537-1549.e12, published 2022-12-12; publisher PDF (1-s2.0-S153561082200513X-main.pdf) as deposited by the Francis Crick Institute on figshare, 10.25418/crick.21731870.v1 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: pdftotext -layout text layer, parsed by extract/extract_ctdna_jamshidi.py |
| Claimed field links:assessed_by:ctdnajam-20261010-protocol-ccga1-validation-sens-98spec Context-only references | Evaluation of cell-free DNA approaches for multi-cancer early detection ctdnajam-20261010-source-jamshidi2022: Table 3, validation columns and footnotes Version: Cancer Cell 40(12):1537-1549.e12, published 2022-12-12; publisher PDF (1-s2.0-S153561082200513X-main.pdf) as deposited by the Francis Crick Institute on figshare, 10.25418/crick.21731870.v1 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: pdftotext -layout text layer, parsed by extract/extract_ctdna_jamshidi.py |
| Headline metric sensitivity-at-98-percent-specificity Context-only references | Evaluation of cell-free DNA approaches for multi-cancer early detection ctdnajam-20261010-source-jamshidi2022: Table 3, validation columns and footnotes Version: Cancer Cell 40(12):1537-1549.e12, published 2022-12-12; publisher PDF (1-s2.0-S153561082200513X-main.pdf) as deposited by the Francis Crick Institute on figshare, 10.25418/crick.21731870.v1 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: pdftotext -layout text layer, parsed by extract/extract_ctdna_jamshidi.py |
Limitations8 values
| Evaluation of cell-free DNA approaches for multi-cancer early detection ctdnajam-20261010-source-jamshidi2022: Table 3, validation columns and footnotes Version: Cancer Cell 40(12):1537-1549.e12, published 2022-12-12; publisher PDF (1-s2.0-S153561082200513X-main.pdf) as deposited by the Francis Crick Institute on figshare, 10.25418/crick.21731870.v1 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: pdftotext -layout text layer, parsed by extract/extract_ctdna_jamshidi.py |
Pinned records15 values
| Evaluation of cell-free DNA approaches for multi-cancer early detection ctdnajam-20261010-source-jamshidi2022: Table 3, validation columns and footnotes Version: Cancer Cell 40(12):1537-1549.e12, published 2022-12-12; publisher PDF (1-s2.0-S153561082200513X-main.pdf) as deposited by the Francis Crick Institute on figshare, 10.25418/crick.21731870.v1 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: pdftotext -layout text layer, parsed by extract/extract_ctdna_jamshidi.py |
Sources and history
Release 2026-11-21-c8bea25e5abb · Record review: source checked
1 source record and release history
- Evaluation of cell-free DNA approaches for multi-cancer early detection · Original source · Cancer Cell 40(12):1537-1549.e12, published 2022-12-12; publisher PDF (1-s2.0-S153561082200513X-main.pdf) as deposited by the Francis Crick Institute on figshare, 10.25418/crick.21731870.v1
Technical metadata and extraction receipts
Stable ID: use-case-mapping-ctdna-jamshidi-20261010-meth-validation
- field
- links:assessed_by:ctdnajam-20261010-protocol-ccga1-validation-sens-98spec
- value
- ctdnajam-20261010-protocol-ccga1-validation-sens-98spec
- relevance
- direct
- endpoint
- Sensitivity (95% CI, TP/total) at 98% specificity on the validation set (464 cancers, 362 non-cancers) for the whole-genome methylation classifier and the five other classifiers analysed double-blinded, with paired McNemar tests against whole-genome methylation
- rationale
- Measures the use case's endpoint, all-stage detection sensitivity at a declared specificity, for a locked whole-genome bisulfite methylation classifier on a validation set analysed double-blinded: 34% (30%-39%; 158 of 464), against 16% to 33% for the blinded mutation and copy-number classifiers on the same participants and 2.6% for clinical data alone. Direct despite the post hoc threshold: the classifier was locked before unblinding, and the 98% cutoff was read off the validation non-cancer scores, which is how a sensitivity at a declared specificity is read; it is not a threshold fixed in advance. Developer-run and case-control. The CCGA samples are not public and do not overlap the cohorts of this use case's other judgements.
- constraints
- Inspect every linked evaluation's source locator and preserved limitations before citing a result.; Do not combine this mapping's evaluations with any other protocol's results; cohorts, assays and thresholds differ.; The 98% specificity threshold was set post hoc within each set and is not a locked screening threshold.
- limitations
- Developer study: GRAIL designed the assays and classifiers, ran every arm, and reports the comparison.; The 98% specificity threshold was set post hoc within each set, including the validation set, so it is not a threshold locked before validation.; Case-control enrolment of clinically diagnosed cancers and matched non-cancer participants, not an intended-use screening population.; Prototype assays; the targeted methylation test developed afterwards is a different assay and is not scored here.; The fragment endpoints, fragment lengths, allelic imbalance and pan-feature classifiers were developed after validation blinding was lifted; the other classifiers were blinded.; Table 3 scores 833 training and 464 validation cancers against 854 and 485 analysable cancers in Table 1. STAR Methods restrict detection to solid cancers, and Table 1 lists 11 plasma cell neoplasms and 10 leukaemias in training and 8 and 13 in validation, which is 21 in each set; lymphomas stay in.; Specificity was 97.9% (548/560) in training and 97.8% (354/362) in validation for every cfDNA classifier, slightly below the 98% target.; Only the six classifiers analysed double-blinded are shown; the four developed after unblinding are excluded.
- citation locators
- source id: ctdnajam-20261010-source-jamshidi2022; locator: Table 3, validation columns and footnotes
- source locator
- ctdnajam-20261010-source-jamshidi2022: Table 3, validation columns and footnotes
- revision
- 1
- reason
- Add the CCGA substudy 1 same-sample comparison of cfDNA classifiers (Jamshidi et al. 2022), retrieved 2026-10-10.
- comparison group
- jamshidi2022-ccga1-detection
- comparison title
- CCGA substudy 1: cfDNA classifiers on the same participants at a post hoc 98% specificity
- headline metric
- sensitivity-at-98-percent-specificity
- stratum label
- Validation set, double-blinded classifiers
- stratum order
- 2
- excluded evaluations
- id: ctdnajam-20261010-eval-validation-fragment-endpoints; reason: Developed after validation blinding was lifted (STAR Methods), so its validation value is not a blinded validation. Excluded from this judgement at independent review 2026-10-10; it stays in the fragmentomics judgements with that limitation.; id: ctdnajam-20261010-eval-validation-fragment-lengths; reason: Developed after validation blinding was lifted (STAR Methods), so its validation value is not a blinded validation. Excluded from this judgement at independent review 2026-10-10; it stays in the fragmentomics judgements with that limitation.; id: ctdnajam-20261010-eval-validation-allelic-imbalance; reason: Developed after validation blinding was lifted (STAR Methods), so its validation value is not a blinded validation. Excluded from this judgement at independent review 2026-10-10; it stays in the fragmentomics judgements with that limitation.; id: ctdnajam-20261010-eval-validation-pan-feature; reason: Pan-feature classifier over all nine cfDNA classifier scores, developed after validation blinding was lifted; it is neither a methylation-only workflow nor a blinded validation. Excluded at independent review 2026-10-10.
- reviewed evaluations
- ctdnajam-20261010-eval-validation-clinical-data; ctdnajam-20261010-eval-validation-scna; ctdnajam-20261010-eval-validation-scna-wbc; ctdnajam-20261010-eval-validation-snv; ctdnajam-20261010-eval-validation-snv-wbc; ctdnajam-20261010-eval-validation-wg-methylation
- review
- method: automated-source-review; reviewer: claude; reviewer note: Separate Claude review agent, independent of the extractor; no human review claimed; reviewed at: 2026-10-10T09:00:00Z; note: Independent review of endpoint fit, relevance grade, limitations, exclusions and grouping against the use case and the article; every value of the listed evaluations was checked against Table 3 or the Results text, with percentages and Clopper-Pearson intervals recomputed. Developer study; no execution, reproduction, human scientific review or clinical validation.
- pins
- record id: ctdnajam-20261010-eval-validation-clinical-data; fields: status; links; attributes.origin; attributes.comparison; sha256: 9acccfeb5c5d122fa37e9182d0b0463c58157aba3884ebab1f449c412950b2cd; record id: ctdnajam-20261010-eval-validation-scna; fields: status; links; attributes.origin; attributes.comparison; sha256: 92a1c5a205452c2dd95c5bb2c4f13e513014eb41176676e827935b1371d341db; record id: ctdnajam-20261010-eval-validation-scna-wbc; fields: status; links; attributes.origin; attributes.comparison; sha256: 2e81cf24df947c08bba5062a168088cb95f4a7e2fd73579d5267434b6630878e; record id: ctdnajam-20261010-eval-validation-snv; fields: status; links; attributes.origin; attributes.comparison; sha256: f1135018a2fb35072b121640005f02fdad5bb113e94010f3b7cc6de257e86411; record id: ctdnajam-20261010-eval-validation-snv-wbc; fields: status; links; attributes.origin; attributes.comparison; sha256: 8038775c7848b78bc6e165728024248fc3c34edcc4622c7897a10af8f75fcbf0; record id: ctdnajam-20261010-eval-validation-wg-methylation; fields: status; links; attributes.origin; attributes.comparison; sha256: 67308b83c8607fd2fb7740bd85b88ced6d2fd3e8141d03ef776560b8016fbe35; record id: ctdnajam-20261010-protocol-ccga1-validation-sens-98spec; fields: status; name; description; facets; source_ids; links; attributes; sha256: 20ffe90ea58ab3d334e77d8fa1d0ec0cde9231d4d0bc77a3bee167f12e7eb756; record id: ctdnajam-20261010-result-validation-clinical-data-sensitivity; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: f0b6b98aead2b135e70bec77363a72a7a8297c7c5da2e49f1328d93898bfbeae; record id: ctdnajam-20261010-result-validation-scna-sensitivity; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: b8f61d415953846234e1dc5c9f7759b7871bec0331aece765435dc4207ffea35; record id: ctdnajam-20261010-result-validation-scna-wbc-sensitivity; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: ca57272ec3d0b2aa050284a89149d13792db4c32418fa441200187f071be8e5b; record id: ctdnajam-20261010-result-validation-snv-sensitivity; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: e17f4878015a270104d99f8da54cc1a3fb296e8791a99b200a9a390cbc4bb543; record id: ctdnajam-20261010-result-validation-snv-wbc-sensitivity; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 9167f27958cef583fcdfcf8921ce9f7aa3d0c3103f2c04084da872972de9f9ed; record id: ctdnajam-20261010-result-validation-wg-methylation-sensitivity; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: c0509264f208ac500b83daf15c002594045eb2995a6a182fcf6b7d82c741e4e2; record id: ctdnajam-20261010-source-jamshidi2022; fields: status; attributes.artifact_sha256; sha256: 49c49ed0c10c6121644dee3068618d9f5a06bbc63f5979bc8417acd9c1c0e56e; record id: use-case-plasma-ctdna-methylation; fields: status; name; description; facets; attributes.question; attributes.decision; attributes.inputs; attributes.output; attributes.exclusions; attributes.setting; attributes.clinical_scope; attributes.intended_users; sha256: 4d9542463e1400d5d9701c7f52859a23e4c78804cbda1477663445f945e22429