rewirebio.iobenchmarks
Contested result

MuSE and NeuSomatic: A benchmarking study of individual somatic variant callers and voting-based ensembles for whole-exome sequencing and Achieving robust somatic mutation detection with deep learning models derived from reference data sets of a cancer sample disagree

  • Low severity
  • Not yet reviewed
  • Two-study conflict
  • unknown

A benchmarking study of individual somatic variant callers and voting-based ensembles for whole-exome sequencing ranks MuSE above NeuSomatic in 3 of 3 comparisons; Achieving robust somatic mutation detection with deep learning models derived from reference data sets of a cancer sample ranks NeuSomatic above MuSE in 67 of 74 comparisons. No other study gives a verdict, so neither is the outlier.

An automatic lead, not a finding of error. The results below are shown as published, everywhere on the site, until a reviewer decides otherwise.

Which studies agree

3 papers rank MuSE above NeuSomatic in 25 of their 107 comparisons and NeuSomatic higher in 75; 7 are ties. Of those papers, Achieving robust somatic mutation… ranks NeuSomatic higher on its own (67 of 77).

Papers grouped by which system they rank higher: MuSE or NeuSomaticRank MuSE higher: A benchmarking study of individual…. Rank NeuSomatic higher: Achieving robust somatic mutation…. Mixed: SomaticCombiner.Rank MuSE higherMixedRank NeuSomatic higherA benchmarking studyof individual…A benchmarking study of individual somatic variant callers and voting-based ensembles for whole-exome sequencingSomaticCombinerSomaticCombiner: improving the performance of somatic variant calling based on evaluation tests and a consensus approachAchieving robustsomatic mutation…Achieving robust somatic mutation detection with deep learning models derived from reference data sets of a cancer sample
  • Rank MuSE higher (1): A benchmarking study of individual…
  • Rank NeuSomatic higher (1): Achieving robust somatic mutation…
  • Mixed (1): SomaticCombiner

Each paper sits where at least two thirds of its comparisons point; Mixed means neither model reaches two thirds. The larger, outlined dot is the paper that disagrees.

Comparisons in which each paper scores MuSE or NeuSomatic higherAchieving robust somatic mutation…: MuSE higher in 7, NeuSomatic higher in 67, 3 ties. SomaticCombiner: MuSE higher in 15, NeuSomatic higher in 8, 1 tie. A benchmarking study of individual…: MuSE higher in 3, NeuSomatic higher in 0, 3 ties.Achieving robust somatic mutation…Achieving robust somatic mutation detection with deep learning models derived from reference data sets of a cancer sample7 MuSE higher73 tie67 NeuSomatic higher67SomaticCombinerSomaticCombiner: improving the performance of somatic variant calling based on evaluation tests and a consensus approach15 MuSE higher151 tie8 NeuSomatic higher8A benchmarking study of individual…A benchmarking study of individual somatic variant callers and voting-based ensembles for whole-exome sequencing3 MuSE higher33 tie3
MuSE higherTieNeuSomatic higherNumbers are counts of comparisons; the outlined bar is the paper that disagrees.
Comparisons in Achieving robust somatic mutation… (77)
ProtocolDatasetMetricMuSENeuSomaticHigher
SEQC2 HCC1395 library preparation and DNA input, SNV F1 (Sahraeian et al. 2022 Table S4)SEQC2 HCC1395/HCC1395BL library-preparation replicates (TruSeq-Nano and Nextera Flex, 1-100 ng DNA)F1 (SNVs, average over the 6 library pairs as printed), percent76.277.4NeuSomatic
SEQC2 HCC1395 library preparation and DNA input, SNV F1 (Sahraeian et al. 2022 Table S4)SEQC2 HCC1395/HCC1395BL library-preparation replicates (TruSeq-Nano and Nextera Flex, 1-100 ng DNA)F1 (SNVs, tumour LBP_Nextera_T_100ng with normal LBP_Nextera_N_100ng), percent8993NeuSomatic
SEQC2 HCC1395 library preparation and DNA input, SNV F1 (Sahraeian et al. 2022 Table S4)SEQC2 HCC1395/HCC1395BL library-preparation replicates (TruSeq-Nano and Nextera Flex, 1-100 ng DNA)F1 (SNVs, tumour LBP_Nextera_T_10ng with normal LBP_Nextera_N_10ng), percent9093.1NeuSomatic
SEQC2 HCC1395 library preparation and DNA input, SNV F1 (Sahraeian et al. 2022 Table S4)SEQC2 HCC1395/HCC1395BL library-preparation replicates (TruSeq-Nano and Nextera Flex, 1-100 ng DNA)F1 (SNVs, tumour LBP_Nextera_T_1ng with normal LBP_Nextera_N_1ng), percent86.489.2NeuSomatic
SEQC2 HCC1395 library preparation and DNA input, SNV F1 (Sahraeian et al. 2022 Table S4)SEQC2 HCC1395/HCC1395BL library-preparation replicates (TruSeq-Nano and Nextera Flex, 1-100 ng DNA)F1 (SNVs, tumour LBP_TruSeq_T_100ng with normal LBP_TruSeq_N_100ng), percent86.390.4NeuSomatic
SEQC2 HCC1395 library preparation and DNA input, SNV F1 (Sahraeian et al. 2022 Table S4)SEQC2 HCC1395/HCC1395BL library-preparation replicates (TruSeq-Nano and Nextera Flex, 1-100 ng DNA)F1 (SNVs, tumour LBP_TruSeq_T_10ng with normal LBP_TruSeq_N_10ng), percent82.279.6MuSE
SEQC2 HCC1395 library preparation and DNA input, SNV F1 (Sahraeian et al. 2022 Table S4)SEQC2 HCC1395/HCC1395BL library-preparation replicates (TruSeq-Nano and Nextera Flex, 1-100 ng DNA)F1 (SNVs, tumour LBP_TruSeq_T_1ng with normal LBP_TruSeq_N_1ng), percent23.119.2MuSE
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, average over the 47 purity-coverage pairs as printed), percent51.766.1NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_100x_10%T with normal SPP_100x_100%N), percent2563NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_100x_100%T with normal SPP_100x_100%N), percent92.695.9NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_100x_20%T with normal SPP_100x_100%N), percent59.482.6NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_100x_5%T with normal SPP_100x_100%N), percent3.733.6NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_100x_50%T with normal SPP_100x_100%N), percent85.592.8NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_100x_75%T with normal SPP_100x_100%N), percent90.195.2NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_10x_10%T with normal SPP_10x_100%N), percent3.84.7NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_10x_100%T with normal SPP_10x_100%N), percent49.633.9MuSE
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_10x_20%T with normal SPP_10x_100%N), percent12.312.2Tie
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_10x_5%T with normal SPP_10x_100%N), percent1.11.7NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_10x_50%T with normal SPP_10x_100%N), percent36.929MuSE
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_10x_75%T with normal SPP_10x_100%N), percent4733.8MuSE
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_200x_10%T with normal SPP_200x_100%N), percent40.475.9NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_200x_100%T with normal SPP_200x_100%N), percent9597NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_200x_20%T with normal SPP_200x_100%N), percent7288.4NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_200x_5%T with normal SPP_200x_100%N), percent8.350.7NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_200x_50%T with normal SPP_200x_100%N), percent88.795.7NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_200x_75%T with normal SPP_200x_100%N), percent92.597NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_300x_10%T with normal SPP_300x_100%N), percent46.981.2NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_300x_100%T with normal SPP_300x_100%N), percent96.797Tie
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_300x_20%T with normal SPP_300x_100%N), percent76.891.2NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_300x_5%T with normal SPP_300x_100%N), percent13.261.9NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_300x_50%T with normal SPP_300x_100%N), percent90.296.6NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_300x_75%T with normal SPP_300x_100%N), percent93.897.5NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_30x_10%T with normal SPP_30x_100%N), percent1023.6NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_30x_100%T with normal SPP_30x_100%N), percent84.584Tie
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_30x_20%T with normal SPP_30x_100%N), percent34.145.6NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_30x_5%T with normal SPP_30x_100%N), percent1.99.1NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_30x_50%T with normal SPP_30x_100%N), percent71.869.4MuSE
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_30x_75%T with normal SPP_30x_100%N), percent81.282.3NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_50x_10%T with normal SPP_50x_100%N), percent14.735.8NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_50x_100%T with normal SPP_50x_100%N), percent88.691.8NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_50x_20%T with normal SPP_50x_100%N), percent44.762.9NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_50x_5%T with normal SPP_50x_100%N), percent2.313.8NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_50x_50%T with normal SPP_50x_100%N), percent79.386.6NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_50x_75%T with normal SPP_50x_100%N), percent85.991NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_80x_10%T with normal SPP_80x_100%N), percent20.856.5NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_80x_10%T with normal SPP_80x_95%N), percent2.232.4NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_80x_100%T with normal SPP_80x_100%N), percent91.695.2NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_80x_100%T with normal SPP_80x_95%N), percent59.591.5NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_80x_20%T with normal SPP_80x_100%N), percent5578.9NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_80x_20%T with normal SPP_80x_95%N), percent12.260.2NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_80x_5%T with normal SPP_80x_100%N), percent3.327.5NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_80x_50%T with normal SPP_80x_100%N), percent83.991.7NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_80x_50%T with normal SPP_80x_95%N), percent39.885.7NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_80x_75%T with normal SPP_80x_100%N), percent88.993.8NeuSomatic
SEQC2 HCC1395 tumour purity, coverage and normal contamination, SNV F1 (Sahraeian et al. 2022 Table S3)SEQC2 tumour-normal titration: HCC1395 gDNA mixed with HCC1395BL gDNA at 5-100% tumour purity, 10x-300x WGSF1 (SNVs, tumour SPP_80x_75%T with normal SPP_80x_95%N), percent52.389.2NeuSomatic
SEQC2 HCC1395 sequencing centre and platform, SNV F1 (Sahraeian et al. 2022 Table S2)SEQC2 HCC1395/HCC1395BL WGS replicate pairs from multiple sequencing centresF1 (SNVs, average over the 21 replicate pairs as printed), percent88.191.8NeuSomatic
SEQC2 HCC1395 sequencing centre and platform, SNV F1 (Sahraeian et al. 2022 Table S2)SEQC2 HCC1395/HCC1395BL WGS replicate pairs from multiple sequencing centresF1 (SNVs, tumour WGS_EA_T_1 with normal WGS_EA_N_1), percent90.293.8NeuSomatic
SEQC2 HCC1395 sequencing centre and platform, SNV F1 (Sahraeian et al. 2022 Table S2)SEQC2 HCC1395/HCC1395BL WGS replicate pairs from multiple sequencing centresF1 (SNVs, tumour WGS_FD_T_1 with normal WGS_FD_N_1), percent8891.8NeuSomatic
SEQC2 HCC1395 sequencing centre and platform, SNV F1 (Sahraeian et al. 2022 Table S2)SEQC2 HCC1395/HCC1395BL WGS replicate pairs from multiple sequencing centresF1 (SNVs, tumour WGS_FD_T_2 with normal WGS_FD_N_2), percent88.691.8NeuSomatic
SEQC2 HCC1395 sequencing centre and platform, SNV F1 (Sahraeian et al. 2022 Table S2)SEQC2 HCC1395/HCC1395BL WGS replicate pairs from multiple sequencing centresF1 (SNVs, tumour WGS_FD_T_3 with normal WGS_FD_N_3), percent88.491.8NeuSomatic
SEQC2 HCC1395 sequencing centre and platform, SNV F1 (Sahraeian et al. 2022 Table S2)SEQC2 HCC1395/HCC1395BL WGS replicate pairs from multiple sequencing centresF1 (SNVs, tumour WGS_IL_T_1 with normal WGS_IL_N_1), percent90.695NeuSomatic
SEQC2 HCC1395 sequencing centre and platform, SNV F1 (Sahraeian et al. 2022 Table S2)SEQC2 HCC1395/HCC1395BL WGS replicate pairs from multiple sequencing centresF1 (SNVs, tumour WGS_IL_T_2 with normal WGS_IL_N_2), percent8993.3NeuSomatic
SEQC2 HCC1395 sequencing centre and platform, SNV F1 (Sahraeian et al. 2022 Table S2)SEQC2 HCC1395/HCC1395BL WGS replicate pairs from multiple sequencing centresF1 (SNVs, tumour WGS_IL_T_3 with normal WGS_IL_N_3), percent88.793.4NeuSomatic
SEQC2 HCC1395 sequencing centre and platform, SNV F1 (Sahraeian et al. 2022 Table S2)SEQC2 HCC1395/HCC1395BL WGS replicate pairs from multiple sequencing centresF1 (SNVs, tumour WGS_LL_T_1 with normal WGS_LL_N_1), percent80.679.7MuSE
SEQC2 HCC1395 sequencing centre and platform, SNV F1 (Sahraeian et al. 2022 Table S2)SEQC2 HCC1395/HCC1395BL WGS replicate pairs from multiple sequencing centresF1 (SNVs, tumour WGS_NC_T_1 with normal WGS_NC_N_1), percent8891.5NeuSomatic
SEQC2 HCC1395 sequencing centre and platform, SNV F1 (Sahraeian et al. 2022 Table S2)SEQC2 HCC1395/HCC1395BL WGS replicate pairs from multiple sequencing centresF1 (SNVs, tumour WGS_NS_T_1 with normal WGS_NS_N_1), percent88.491.7NeuSomatic
SEQC2 HCC1395 sequencing centre and platform, SNV F1 (Sahraeian et al. 2022 Table S2)SEQC2 HCC1395/HCC1395BL WGS replicate pairs from multiple sequencing centresF1 (SNVs, tumour WGS_NS_T_2 with normal WGS_NS_N_2), percent85.990.6NeuSomatic
SEQC2 HCC1395 sequencing centre and platform, SNV F1 (Sahraeian et al. 2022 Table S2)SEQC2 HCC1395/HCC1395BL WGS replicate pairs from multiple sequencing centresF1 (SNVs, tumour WGS_NS_T_3 with normal WGS_NS_N_3), percent87.690.8NeuSomatic
SEQC2 HCC1395 sequencing centre and platform, SNV F1 (Sahraeian et al. 2022 Table S2)SEQC2 HCC1395/HCC1395BL WGS replicate pairs from multiple sequencing centresF1 (SNVs, tumour WGS_NS_T_4 with normal WGS_NS_N_4), percent87.690.8NeuSomatic
SEQC2 HCC1395 sequencing centre and platform, SNV F1 (Sahraeian et al. 2022 Table S2)SEQC2 HCC1395/HCC1395BL WGS replicate pairs from multiple sequencing centresF1 (SNVs, tumour WGS_NS_T_5 with normal WGS_NS_N_5), percent84.890.5NeuSomatic
SEQC2 HCC1395 sequencing centre and platform, SNV F1 (Sahraeian et al. 2022 Table S2)SEQC2 HCC1395/HCC1395BL WGS replicate pairs from multiple sequencing centresF1 (SNVs, tumour WGS_NS_T_6 with normal WGS_NS_N_6), percent88.492.4NeuSomatic
SEQC2 HCC1395 sequencing centre and platform, SNV F1 (Sahraeian et al. 2022 Table S2)SEQC2 HCC1395/HCC1395BL WGS replicate pairs from multiple sequencing centresF1 (SNVs, tumour WGS_NS_T_7 with normal WGS_NS_N_7), percent84.989.8NeuSomatic
SEQC2 HCC1395 sequencing centre and platform, SNV F1 (Sahraeian et al. 2022 Table S2)SEQC2 HCC1395/HCC1395BL WGS replicate pairs from multiple sequencing centresF1 (SNVs, tumour WGS_NS_T_8 with normal WGS_NS_N_8), percent86.290.7NeuSomatic
SEQC2 HCC1395 sequencing centre and platform, SNV F1 (Sahraeian et al. 2022 Table S2)SEQC2 HCC1395/HCC1395BL WGS replicate pairs from multiple sequencing centresF1 (SNVs, tumour WGS_NS_T_9 with normal WGS_NS_N_9), percent87.291.2NeuSomatic
SEQC2 HCC1395 sequencing centre and platform, SNV F1 (Sahraeian et al. 2022 Table S2)SEQC2 HCC1395/HCC1395BL WGS replicate pairs from multiple sequencing centresF1 (SNVs, tumour WGS_NV_T_1 with normal WGS_NV_N_1), percent92.295.7NeuSomatic
SEQC2 HCC1395 sequencing centre and platform, SNV F1 (Sahraeian et al. 2022 Table S2)SEQC2 HCC1395/HCC1395BL WGS replicate pairs from multiple sequencing centresF1 (SNVs, tumour WGS_NV_T_2 with normal WGS_NV_N_2), percent92.395.7NeuSomatic
SEQC2 HCC1395 sequencing centre and platform, SNV F1 (Sahraeian et al. 2022 Table S2)SEQC2 HCC1395/HCC1395BL WGS replicate pairs from multiple sequencing centresF1 (SNVs, tumour WGS_NV_T_3 with normal WGS_NV_N_3), percent92.295.9NeuSomatic
Comparisons in SomaticCombiner (24)
ProtocolDatasetMetricMuSENeuSomaticHigher
AML tumour somatic SNVs, WGS (Wang et al. 2020 Table S1)Acute myeloid leukaemia tumour-normal WGS with platinum somatic listF1 (SNV only), fraction0.7860.772MuSE
AML tumour somatic SNVs, WGS (Wang et al. 2020 Table S1)Acute myeloid leukaemia tumour-normal WGS with platinum somatic listPrecision (SNV only), fraction0.7130.659MuSE
AML tumour somatic SNVs, WGS (Wang et al. 2020 Table S1)Acute myeloid leukaemia tumour-normal WGS with platinum somatic listRecall (SNV only), fraction0.8760.931NeuSomatic
CLL tumour somatic SNVs, WGS (Wang et al. 2020 Table S1)Chronic lymphocytic leukaemia tumour-normal WGS with curated somatic callsF1 (SNV only), fraction0.6470.166MuSE
CLL tumour somatic SNVs, WGS (Wang et al. 2020 Table S1)Chronic lymphocytic leukaemia tumour-normal WGS with curated somatic callsPrecision (SNV only), fraction0.5490.091MuSE
CLL tumour somatic SNVs, WGS (Wang et al. 2020 Table S1)Chronic lymphocytic leukaemia tumour-normal WGS with curated somatic callsRecall (SNV only), fraction0.7880.982NeuSomatic
COLO829 cell line somatic SNVs, WGS (Wang et al. 2020 Table S1)COLO829 metastatic melanoma cell line tumour-normal WGS with curated somatic callsF1 (SNV only), fraction0.9310.854MuSE
COLO829 cell line somatic SNVs, WGS (Wang et al. 2020 Table S1)COLO829 metastatic melanoma cell line tumour-normal WGS with curated somatic callsPrecision (SNV only), fraction0.890.756MuSE
COLO829 cell line somatic SNVs, WGS (Wang et al. 2020 Table S1)COLO829 metastatic melanoma cell line tumour-normal WGS with curated somatic callsRecall (SNV only), fraction0.9760.982Tie
DREAM synthetic set 1 somatic SNVs, WGS (Wang et al. 2020 Table S1)ICGC-TCGA DREAM synthetic set 1 (WGS)F1 (SNV only), fraction0.9110.571MuSE
DREAM synthetic set 1 somatic SNVs, WGS (Wang et al. 2020 Table S1)ICGC-TCGA DREAM synthetic set 1 (WGS)Precision (SNV only), fraction0.8550.402MuSE
DREAM synthetic set 1 somatic SNVs, WGS (Wang et al. 2020 Table S1)ICGC-TCGA DREAM synthetic set 1 (WGS)Recall (SNV only), fraction0.9750.987NeuSomatic
DREAM synthetic set 2 somatic SNVs, WGS (Wang et al. 2020 Table S1)ICGC-TCGA DREAM synthetic set 2 (WGS)F1 (SNV only), fraction0.9380.551MuSE
DREAM synthetic set 2 somatic SNVs, WGS (Wang et al. 2020 Table S1)ICGC-TCGA DREAM synthetic set 2 (WGS)Precision (SNV only), fraction0.9070.382MuSE
DREAM synthetic set 2 somatic SNVs, WGS (Wang et al. 2020 Table S1)ICGC-TCGA DREAM synthetic set 2 (WGS)Recall (SNV only), fraction0.9710.991NeuSomatic
DREAM synthetic set 3 somatic SNVs, WGS (Wang et al. 2020 Table S1)ICGC-TCGA DREAM synthetic set 3 (WGS)F1 (SNV only), fraction0.9180.735MuSE
DREAM synthetic set 3 somatic SNVs, WGS (Wang et al. 2020 Table S1)ICGC-TCGA DREAM synthetic set 3 (WGS)Precision (SNV only), fraction0.9590.594MuSE
DREAM synthetic set 3 somatic SNVs, WGS (Wang et al. 2020 Table S1)ICGC-TCGA DREAM synthetic set 3 (WGS)Recall (SNV only), fraction0.880.966NeuSomatic
DREAM synthetic set 4 somatic SNVs, WGS (Wang et al. 2020 Table S1)ICGC-TCGA DREAM synthetic set 4 (WGS)F1 (SNV only), fraction0.6730.783NeuSomatic
DREAM synthetic set 4 somatic SNVs, WGS (Wang et al. 2020 Table S1)ICGC-TCGA DREAM synthetic set 4 (WGS)Precision (SNV only), fraction0.8690.704MuSE
DREAM synthetic set 4 somatic SNVs, WGS (Wang et al. 2020 Table S1)ICGC-TCGA DREAM synthetic set 4 (WGS)Recall (SNV only), fraction0.550.881NeuSomatic
MB brain tumour somatic SNVs, WGS (Wang et al. 2020 Table S1)Malignant paediatric cerebellar brain tumour (MB) tumour-normal WGS with curated somatic callsF1 (SNV only), fraction0.8060.477MuSE
MB brain tumour somatic SNVs, WGS (Wang et al. 2020 Table S1)Malignant paediatric cerebellar brain tumour (MB) tumour-normal WGS with curated somatic callsPrecision (SNV only), fraction0.7730.315MuSE
MB brain tumour somatic SNVs, WGS (Wang et al. 2020 Table S1)Malignant paediatric cerebellar brain tumour (MB) tumour-normal WGS with curated somatic callsRecall (SNV only), fraction0.8420.987NeuSomatic
Comparisons in A benchmarking study of individual… (6)

What disagrees

studies
2
Compared
MuSE, NeuSomatic
Study that disagrees
Other studies
Rule
Two-study conflict; unknown
Model identity
Matched across studies partly through links not yet reviewed

Follow-up

Current state: Not yet reviewed.

No one has reviewed this finding yet.

How to help resolve this

If you know why these studies disagree, for example a different population, metric or preprocessing step, or you have a corrected value, tell us through the contribution form. A reviewer checks every submission against its source before anything changes, and the step is added to the follow-up above.

Finding discrepancy-a671743148e9f1f0 · All contested results · How findings are made and followed up