Chen et al. 2020, Additional file 21: Performance metrics of 33 algorithms, median-score threshold, benchmark 5 (cell viability)

What this source contributed

Records in this release that cite this source. A record can cite several sources.

• 1 protocol
• 33 evaluations
• 165 results
• 2 evidence claims
• 1 use case

Results

Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.

Claims

Statements this source supports, each with where in the source it was checked.

• Evidence summary: somatic small-variant oncogenicity: Summary Two predictor comparisons join the existing OncoVI evidence; their values cannot be pooled. In Chen et al. 2020 (peer reviewed), 33 predictors scored somatic missense mutations labelled by OncoKB curation or by the authors' own cell viability assays, with likely neutral or assay-neutral somatic negatives. The authors co-developed one scored tool, CanDrA, and developed none of the others. With each tool's own default calls, the highest accuracy was 0.70 on OncoKB labels (DEOGEN2, sensitivity 0.87, specificity 0.51), and several tools called most neutral mutations damaging, for example M-CAP with sensitivity 0.97 and specificity 0.11, and CanDrA with specificity 0.17 and the lowest accuracy, 0.49. On the assay labels the highest default accuracy was 0.65 (PrimateAI). When each tool's median score on the test draw was used as the threshold, which ranks tools but is not an operating point a reviewer could apply, the highest accuracy was 0.69 on OncoKB labels (PROVEAN and VEST4) and 0.70 on assay labels (CTAT-cancer and PrimateAI), and FATHMM-disease scored 0.50 on OncoKB labels. Chen et al. print each value as a mean with a range of two standard deviations over 100 draws, not a confidence interval, and do not say which OncoKB positive set fed these tables. In a single-author bioRxiv preprint that is not peer reviewed (Lee 2026), 49 scores were compared on Cancer Gene Census missense variants whose negatives are germline-benign labels (ClinVar benign or likely benign, and gnomAD common variants), which this use case does not accept as somatic controls. In that table 42 of the 49 scores had a lower AUROC on oncogene variants than on tumour-suppressor variants, for example AlphaMissense 0.885 against 0.900 and CADD 0.821 against 0.894, while popEVE went the other way (0.900 against 0.842). The highest all-gene AUROC was 0.876 (MutScore); these AUROC values are rounded here to three decimals from the table's full precision. None of these comparisons covers small indels, calibrated probabilities, criterion-level evidence strength, drug response or reviewer agreement. (somatic-oncogenicity-20261009-source-chen2020-additional-file-9 and -10: Benchmark 2; somatic-oncogenicity-20261009-source-chen2020-additional-file-21 and -22: Benchmark 5; somatic-oncogenicity-20261009-source-chen2020: Methods and reference 7; somatic-oncogenicity-20261009-source-lee2026-oncocal-tool-performance: tables/tool_performance.tsv; somatic-oncogenicity-20261009-source-lee2026: Methods and Results)
• Relevance of cell viability drivers versus neutral, median-score threshold (Chen et al. 2020) to "Assess somatic small-variant oncogenicity": Assessed by Cell viability drivers versus neutral, median-score threshold (Chen et al. 2020 Additional file 21) (somatic-oncogenicity-20261009-source-chen2020-additional-file-21: Additional file 21; somatic-oncogenicity-20261009-source-chen2020: Results 'Benchmark 5'; Methods)

Models, benchmarks and other records

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.