Chen et al. 2020, Additional file 10: Performance metrics of 17 algorithms, default categories, benchmark 2 (OncoKB)
13059_2020_1954_MOESM10_ESM.xlsx · Peer-reviewed
What this source contributed
Records in this release that cite this source. A record can cite several sources.
Results
Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.
Claims
Statements this source supports, each with where in the source it was checked.
- Evidence summary: somatic small-variant oncogenicity: Summary Two predictor comparisons join the existing OncoVI evidence; their values cannot be pooled. In Chen et al. 2020 (peer reviewed), 33 predictors scored somatic missense mutations labelled by OncoKB curation or by the authors' own cell viability assays, with likely neutral or assay-neutral somatic negatives. The authors co-developed one scored tool, CanDrA, and developed none of the others. With each tool's own default calls, the highest accuracy was 0.70 on OncoKB labels (DEOGEN2, sensitivity 0.87, specificity 0.51), and several tools called most neutral mutations damaging, for example M-CAP with sensitivity 0.97 and specificity 0.11, and CanDrA with specificity 0.17 and the lowest accuracy, 0.49. On the assay labels the highest default accuracy was 0.65 (PrimateAI). When each tool's median score on the test draw was used as the threshold, which ranks tools but is not an operating point a reviewer could apply, the highest accuracy was 0.69 on OncoKB labels (PROVEAN and VEST4) and 0.70 on assay labels (CTAT-cancer and PrimateAI), and FATHMM-disease scored 0.50 on OncoKB labels. Chen et al. print each value as a mean with a range of two standard deviations over 100 draws, not a confidence interval, and do not say which OncoKB positive set fed these tables. In a single-author bioRxiv preprint that is not peer reviewed (Lee 2026), 49 scores were compared on Cancer Gene Census missense variants whose negatives are germline-benign labels (ClinVar benign or likely benign, and gnomAD common variants), which this use case does not accept as somatic controls. In that table 42 of the 49 scores had a lower AUROC on oncogene variants than on tumour-suppressor variants, for example AlphaMissense 0.885 against 0.900 and CADD 0.821 against 0.894, while popEVE went the other way (0.900 against 0.842). The highest all-gene AUROC was 0.876 (MutScore); these AUROC values are rounded here to three decimals from the table's full precision. None of these comparisons covers small indels, calibrated probabilities, criterion-level evidence strength, drug response or reviewer agreement. (somatic-oncogenicity-20261009-source-chen2020-additional-file-9 and -10: Benchmark 2; somatic-oncogenicity-20261009-source-chen2020-additional-file-21 and -22: Benchmark 5; somatic-oncogenicity-20261009-source-chen2020: Methods and reference 7; somatic-oncogenicity-20261009-source-lee2026-oncocal-tool-performance: tables/tool_performance.tsv; somatic-oncogenicity-20261009-source-lee2026: Methods and Results)
- Relevance of OncoKB benchmark (positive set not stated), default categorical calls (Chen et al. 2020) to "Assess somatic small-variant oncogenicity": Assessed by OncoKB benchmark (positive set not stated), default categorical calls (Chen et al. 2020 Additional file 10) (somatic-oncogenicity-20261009-source-chen2020-additional-file-10: Additional file 10; somatic-oncogenicity-20261009-source-chen2020: Results 'Benchmark 2'; Methods)
Models, benchmarks and other records
Protocols (1)
Evaluations (17)
- CanDrA on OncoKB benchmark (positive set not stated), default categorical calls (Chen et al. 2020)
- DEOGEN2 on OncoKB benchmark (positive set not stated), default categorical calls (Chen et al. 2020)
- FATHMM-disease on OncoKB benchmark (positive set not stated), default categorical calls (Chen et al. 2020)
- FATHMM-MKL on OncoKB benchmark (positive set not stated), default categorical calls (Chen et al. 2020)
- FATHMM-XF on OncoKB benchmark (positive set not stated), default categorical calls (Chen et al. 2020)
- LRT on OncoKB benchmark (positive set not stated), default categorical calls (Chen et al. 2020)
- M-CAP on OncoKB benchmark (positive set not stated), default categorical calls (Chen et al. 2020)
- MetaLR on OncoKB benchmark (positive set not stated), default categorical calls (Chen et al. 2020)
- MetaSVM on OncoKB benchmark (positive set not stated), default categorical calls (Chen et al. 2020)
- MutationAssessor on OncoKB benchmark (positive set not stated), default categorical calls (Chen et al. 2020)
- MutationTaster2 on OncoKB benchmark (positive set not stated), default categorical calls (Chen et al. 2020)
- Polyphen2_HDIV on OncoKB benchmark (positive set not stated), default categorical calls (Chen et al. 2020)
- Polyphen2_HVAR on OncoKB benchmark (positive set not stated), default categorical calls (Chen et al. 2020)
- PrimateAI on OncoKB benchmark (positive set not stated), default categorical calls (Chen et al. 2020)
- PROVEAN on OncoKB benchmark (positive set not stated), default categorical calls (Chen et al. 2020)
- SIFT on OncoKB benchmark (positive set not stated), default categorical calls (Chen et al. 2020)
- SIFT4G on OncoKB benchmark (positive set not stated), default categorical calls (Chen et al. 2020)
Use cases (1)
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
17 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| Artifact SHA-256 b9c41136f45b38533312baa4abfe2923390861c4e49d4d91c6d0275a85222294 Source metadata | Chen et al. 2020, Additional file 10: Performance metrics of 17 algorithms, default categories, benchmark 2 (OncoKB) No field-specific location recorded Version: 13059_2020_1954_MOESM10_ESM.xlsx | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Artifact url https://static-content.springer.com/esm/art%3A10.1186%2Fs13059-020-01954-z/MediaObjects/13059_2020_1954_MOESM10_ESM.xlsx Source metadata | Chen et al. 2020, Additional file 10: Performance metrics of 17 algorithms, default categories, benchmark 2 (OncoKB) No field-specific location recorded Version: 13059_2020_1954_MOESM10_ESM.xlsx | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Doi 10.1186/s13059-020-01954-z Source metadata | Chen et al. 2020, Additional file 10: Performance metrics of 17 algorithms, default categories, benchmark 2 (OncoKB) No field-specific location recorded Version: 13059_2020_1954_MOESM10_ESM.xlsx | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Licence CC-BY-4.0 Source metadata | Chen et al. 2020, Additional file 10: Performance metrics of 17 algorithms, default categories, benchmark 2 (OncoKB) No field-specific location recorded Version: 13059_2020_1954_MOESM10_ESM.xlsx | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Media type application/vnd.openxmlformats-officedocument.spreadsheetml.sheet Source metadata | Chen et al. 2020, Additional file 10: Performance metrics of 17 algorithms, default categories, benchmark 2 (OncoKB) No field-specific location recorded Version: 13059_2020_1954_MOESM10_ESM.xlsx | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Publication status peer_reviewed Source metadata | Chen et al. 2020, Additional file 10: Performance metrics of 17 algorithms, default categories, benchmark 2 (OncoKB) No field-specific location recorded Version: 13059_2020_1954_MOESM10_ESM.xlsx | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Retrieved at 2026-10-09T20:46:14Z Source metadata | Chen et al. 2020, Additional file 10: Performance metrics of 17 algorithms, default categories, benchmark 2 (OncoKB) No field-specific location recorded Version: 13059_2020_1954_MOESM10_ESM.xlsx | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Url https://doi.org/10.1186/s13059-020-01954-z Source metadata | Chen et al. 2020, Additional file 10: Performance metrics of 17 algorithms, default categories, benchmark 2 (OncoKB) No field-specific location recorded Version: 13059_2020_1954_MOESM10_ESM.xlsx | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Version 13059_2020_1954_MOESM10_ESM.xlsx Source metadata | Chen et al. 2020, Additional file 10: Performance metrics of 17 algorithms, default categories, benchmark 2 (OncoKB) No field-specific location recorded Version: 13059_2020_1954_MOESM10_ESM.xlsx | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Description Supplementary workbook as served by the publisher. Source metadata | Chen et al. 2020, Additional file 10: Performance metrics of 17 algorithms, default categories, benchmark 2 (OncoKB) No field-specific location recorded Version: 13059_2020_1954_MOESM10_ESM.xlsx | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Sources and history
Release 2026-11-02-a7f03c9e55a5 · Record review: source checked
Supplementary workbook as served by the publisher.
Technical metadata and extraction receipts
Stable ID: somatic-oncogenicity-20261009-source-chen2020-additional-file-10
- areas
- dna-genomes
- contexts
- clinical_research
- url
- https://doi.org/10.1186/s13059-020-01954-z
- artifact url
- https://static-content.springer.com/esm/art%3A10.1186%2Fs13059-020-01954-z/MediaObjects/13059_2020_1954_MOESM10_ESM.xlsx
- version
- 13059_2020_1954_MOESM10_ESM.xlsx
- retrieved at
- 2026-10-09T20:46:14Z
- artifact sha256
- b9c41136f45b38533312baa4abfe2923390861c4e49d4d91c6d0275a85222294
- doi
- 10.1186/s13059-020-01954-z
- publication status
- peer_reviewed
- licence
- CC-BY-4.0
- media type
- application/vnd.openxmlformats-officedocument.spreadsheetml.sheet