Configuration

Union of Mutect2, Strelka2 and DeepSomatic (at least one caller) (Hasan 2026)

Union of Mutect2, Strelka2 and DeepSomatic (at least one caller), a configuration of Majority-vote consensus of somatic callers: Variant kept when at least one of Mutect2, Strelka2 and DeepSomatic reports it.

4 evaluations · 24 results

Overview

An explanatory profile has not yet been reviewed for this record.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Evaluations and results

4 evaluations · 24 results. Different protocols are not a single leaderboard.

Dataset: NIST/GIAB HG008 tumour-normal WGS (HG008-T pancreatic cancer cell line, matched normal), HG008-T draft somatic small-variant benchmark v0.3

Sorted by F1 (indel only, HG008 primary region) (higher is better). The best value in each column is highlighted. Decimals are rounded for display; each value links to the printed value and its source.

Tested configuration	Protocol and dataset	F1 (indel only, HG008 primary region)	F1 (SNV only, HG008 primary region)	F1 (SNVs and indels, HG008 all-benchmark region)	F1 (SNVs and indels, HG008 primary region)	False negatives (indel only, HG008 primary region)	False negatives (SNV only, HG008 primary region)	False negatives (SNVs and indels, HG008 all-benchmark region)	False negatives (SNVs and indels, HG008 primary region)	False positives (indel only, HG008 primary region)	False positives (SNV only, HG008 primary region)	False positives (SNVs and indels, HG008 all-benchmark region)	False positives (SNVs and indels, HG008 primary region)	Precision (indel only, HG008 primary region)	Precision (SNV only, HG008 primary region)	Precision (SNVs and indels, HG008 all-benchmark region)	Precision (SNVs and indels, HG008 primary region)	Recall (indel only, HG008 primary region)	Recall (SNV only, HG008 primary region)	Recall (SNVs and indels, HG008 all-benchmark region)	Recall (SNVs and indels, HG008 primary region)	True positives (indel only, HG008 primary region)	True positives (SNV only, HG008 primary region)	True positives (SNVs and indels, HG008 all-benchmark region)	True positives (SNVs and indels, HG008 primary region)
Union of Mutect2, Strelka2 and DeepSomatic (at least one caller) (Hasan 2026)Evaluation	HG008 primary region (nogermlineinterference), indels, Mutect2, Strelka2, DeepSomatic and ensembles (Hasan 2026 Table 2, Class 'INDEL')	0.809	Not reported	Not reported	Not reported	1081	Not reported	Not reported	Not reported	740	Not reported	Not reported	Not reported	0.839	Not reported	Not reported	Not reported	0.781	Not reported	Not reported	Not reported	3855	Not reported	Not reported	Not reported
Union of Mutect2, Strelka2 and DeepSomatic (at least one caller) (Hasan 2026)Evaluation	HG008 all-benchmark region (sensitivity analysis), SNVs and indels combined, Mutect2, Strelka2, DeepSomatic and ensembles (Hasan 2026 Table 4)	Not reported	Not reported	0.73	Not reported	Not reported	Not reported	4707	Not reported	Not reported	Not reported	5297	Not reported	Not reported	Not reported	0.718	Not reported	Not reported	Not reported	0.741	Not reported	Not reported	Not reported	13500	Not reported
Union of Mutect2, Strelka2 and DeepSomatic (at least one caller) (Hasan 2026)Evaluation	HG008 primary region (nogermlineinterference), SNVs and indels combined, Mutect2, Strelka2, DeepSomatic and ensembles (Hasan 2026 Table 1)	Not reported	Not reported	Not reported	0.801	Not reported	Not reported	Not reported	1194	Not reported	Not reported	Not reported	5173	Not reported	Not reported	Not reported	0.712	Not reported	Not reported	Not reported	0.915	Not reported	Not reported	Not reported	12820
Union of Mutect2, Strelka2 and DeepSomatic (at least one caller) (Hasan 2026)Evaluation	HG008 primary region (nogermlineinterference), SNVs, Mutect2, Strelka2, DeepSomatic and ensembles (Hasan 2026 Table 2, Class 'SNV')	Not reported	0.805	Not reported	Not reported	Not reported	113	Not reported	Not reported	Not reported	4224	Not reported	Not reported	Not reported	0.68	Not reported	Not reported	Not reported	0.988	Not reported	Not reported	Not reported	8965	Not reported	Not reported

All 24 result rows with coverage, uncertainty and sources

Filter evaluations

Tested model or methodProtocolDatasetEvaluation setupMetricEvidence origin

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configuration	Protocol and dataset	Finding	Evidence and details
Configuration: Union of Mutect2, Strelka2 and DeepSomatic (at least one caller) (Hasan 2026)	Protocol: HG008 all-benchmark region (sensitivity analysis), SNVs and indels combined, Mutect2, Strelka2, DeepSomatic and ensembles (Hasan 2026 Table 4) Dataset: NIST/GIAB HG008 tumour-normal WGS (HG008-T pancreatic cancer cell line, matched normal), HG008-T draft somatic small-variant benchmark v0.3	0.73 F1 (SNVs and indels, HG008 all-benchmark region) fraction · higher Uncertainty: 95% CI 0.7018 to 0.7521. Genomic block bootstrap over 5-Mb blocks, linear percentile interval; prespecified, but executed after the primary external evaluation; spatial variation within the benchmark region, not between tumours Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source Union on HG008 all-benchmark region (sensitivity analysis), SNVs and indels combined (Hasan 2026) somatic-hg008-20261011-protocol-all-region-overall Aggregation: Not reported Prospectively frozen external benchmarking reveals benchmark-context dependence in somatic variant calling; AmbioSpire P003/T001 publication source data and reproducibility package v1.0.0 (Zenodo) · Zenodo tables/Table4_HG008_sensitivity_all_region.tsv, row 'Union', column 'F1'
Configuration: Union of Mutect2, Strelka2 and DeepSomatic (at least one caller) (Hasan 2026)	Protocol: HG008 all-benchmark region (sensitivity analysis), SNVs and indels combined, Mutect2, Strelka2, DeepSomatic and ensembles (Hasan 2026 Table 4) Dataset: NIST/GIAB HG008 tumour-normal WGS (HG008-T pancreatic cancer cell line, matched normal), HG008-T draft somatic small-variant benchmark v0.3	4710 False negatives (SNVs and indels, HG008 all-benchmark region) count · lower Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source Union on HG008 all-benchmark region (sensitivity analysis), SNVs and indels combined (Hasan 2026) somatic-hg008-20261011-protocol-all-region-overall Aggregation: Not reported Prospectively frozen external benchmarking reveals benchmark-context dependence in somatic variant calling; AmbioSpire P003/T001 publication source data and reproducibility package v1.0.0 (Zenodo) · Zenodo tables/Table4_HG008_sensitivity_all_region.tsv, row 'Union', column 'FN'
Configuration: Union of Mutect2, Strelka2 and DeepSomatic (at least one caller) (Hasan 2026)	Protocol: HG008 all-benchmark region (sensitivity analysis), SNVs and indels combined, Mutect2, Strelka2, DeepSomatic and ensembles (Hasan 2026 Table 4) Dataset: NIST/GIAB HG008 tumour-normal WGS (HG008-T pancreatic cancer cell line, matched normal), HG008-T draft somatic small-variant benchmark v0.3	5300 False positives (SNVs and indels, HG008 all-benchmark region) count · lower Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source Union on HG008 all-benchmark region (sensitivity analysis), SNVs and indels combined (Hasan 2026) somatic-hg008-20261011-protocol-all-region-overall Aggregation: Not reported Prospectively frozen external benchmarking reveals benchmark-context dependence in somatic variant calling; AmbioSpire P003/T001 publication source data and reproducibility package v1.0.0 (Zenodo) · Zenodo tables/Table4_HG008_sensitivity_all_region.tsv, row 'Union', column 'FP'
Configuration: Union of Mutect2, Strelka2 and DeepSomatic (at least one caller) (Hasan 2026)	Protocol: HG008 all-benchmark region (sensitivity analysis), SNVs and indels combined, Mutect2, Strelka2, DeepSomatic and ensembles (Hasan 2026 Table 4) Dataset: NIST/GIAB HG008 tumour-normal WGS (HG008-T pancreatic cancer cell line, matched normal), HG008-T draft somatic small-variant benchmark v0.3	0.718 Precision (SNVs and indels, HG008 all-benchmark region) fraction · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source Union on HG008 all-benchmark region (sensitivity analysis), SNVs and indels combined (Hasan 2026) somatic-hg008-20261011-protocol-all-region-overall Aggregation: Not reported Prospectively frozen external benchmarking reveals benchmark-context dependence in somatic variant calling; AmbioSpire P003/T001 publication source data and reproducibility package v1.0.0 (Zenodo) · Zenodo tables/Table4_HG008_sensitivity_all_region.tsv, row 'Union', column 'Precision'
Configuration: Union of Mutect2, Strelka2 and DeepSomatic (at least one caller) (Hasan 2026)	Protocol: HG008 all-benchmark region (sensitivity analysis), SNVs and indels combined, Mutect2, Strelka2, DeepSomatic and ensembles (Hasan 2026 Table 4) Dataset: NIST/GIAB HG008 tumour-normal WGS (HG008-T pancreatic cancer cell line, matched normal), HG008-T draft somatic small-variant benchmark v0.3	0.741 Recall (SNVs and indels, HG008 all-benchmark region) fraction · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source Union on HG008 all-benchmark region (sensitivity analysis), SNVs and indels combined (Hasan 2026) somatic-hg008-20261011-protocol-all-region-overall Aggregation: Not reported Prospectively frozen external benchmarking reveals benchmark-context dependence in somatic variant calling; AmbioSpire P003/T001 publication source data and reproducibility package v1.0.0 (Zenodo) · Zenodo tables/Table4_HG008_sensitivity_all_region.tsv, row 'Union', column 'Recall'
Configuration: Union of Mutect2, Strelka2 and DeepSomatic (at least one caller) (Hasan 2026)	Protocol: HG008 all-benchmark region (sensitivity analysis), SNVs and indels combined, Mutect2, Strelka2, DeepSomatic and ensembles (Hasan 2026 Table 4) Dataset: NIST/GIAB HG008 tumour-normal WGS (HG008-T pancreatic cancer cell line, matched normal), HG008-T draft somatic small-variant benchmark v0.3	13500 True positives (SNVs and indels, HG008 all-benchmark region) count · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source Union on HG008 all-benchmark region (sensitivity analysis), SNVs and indels combined (Hasan 2026) somatic-hg008-20261011-protocol-all-region-overall Aggregation: Not reported Prospectively frozen external benchmarking reveals benchmark-context dependence in somatic variant calling; AmbioSpire P003/T001 publication source data and reproducibility package v1.0.0 (Zenodo) · Zenodo tables/Table4_HG008_sensitivity_all_region.tsv, row 'Union', column 'TP'
Configuration: Union of Mutect2, Strelka2 and DeepSomatic (at least one caller) (Hasan 2026)	Protocol: HG008 primary region (nogermlineinterference), indels, Mutect2, Strelka2, DeepSomatic and ensembles (Hasan 2026 Table 2, Class 'INDEL') Dataset: NIST/GIAB HG008 tumour-normal WGS (HG008-T pancreatic cancer cell line, matched normal), HG008-T draft somatic small-variant benchmark v0.3	0.809 F1 (indel only, HG008 primary region) fraction · higher Uncertainty: 95% CI 0.797645 to 0.819468. Genomic block bootstrap over 5-Mb blocks, linear percentile interval; spatial variation within the benchmark region, not between tumours Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source Union on HG008 primary region (nogermlineinterference), indels (Hasan 2026) somatic-hg008-20261011-protocol-primary-indel Aggregation: Not reported Prospectively frozen external benchmarking reveals benchmark-context dependence in somatic variant calling; AmbioSpire P003/T001 publication source data and reproducibility package v1.0.0 (Zenodo) · Zenodo tables/Table2_HG008_variant_class_metrics.tsv, row 'Union', Class 'INDEL', column 'F1'
Configuration: Union of Mutect2, Strelka2 and DeepSomatic (at least one caller) (Hasan 2026)	Protocol: HG008 primary region (nogermlineinterference), indels, Mutect2, Strelka2, DeepSomatic and ensembles (Hasan 2026 Table 2, Class 'INDEL') Dataset: NIST/GIAB HG008 tumour-normal WGS (HG008-T pancreatic cancer cell line, matched normal), HG008-T draft somatic small-variant benchmark v0.3	1080 False negatives (indel only, HG008 primary region) count · lower Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source Union on HG008 primary region (nogermlineinterference), indels (Hasan 2026) somatic-hg008-20261011-protocol-primary-indel Aggregation: Not reported Prospectively frozen external benchmarking reveals benchmark-context dependence in somatic variant calling; AmbioSpire P003/T001 publication source data and reproducibility package v1.0.0 (Zenodo) · Zenodo tables/Table2_HG008_variant_class_metrics.tsv, row 'Union', Class 'INDEL', column 'FN'
Configuration: Union of Mutect2, Strelka2 and DeepSomatic (at least one caller) (Hasan 2026)	Protocol: HG008 primary region (nogermlineinterference), indels, Mutect2, Strelka2, DeepSomatic and ensembles (Hasan 2026 Table 2, Class 'INDEL') Dataset: NIST/GIAB HG008 tumour-normal WGS (HG008-T pancreatic cancer cell line, matched normal), HG008-T draft somatic small-variant benchmark v0.3	740 False positives (indel only, HG008 primary region) count · lower Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source Union on HG008 primary region (nogermlineinterference), indels (Hasan 2026) somatic-hg008-20261011-protocol-primary-indel Aggregation: Not reported Prospectively frozen external benchmarking reveals benchmark-context dependence in somatic variant calling; AmbioSpire P003/T001 publication source data and reproducibility package v1.0.0 (Zenodo) · Zenodo tables/Table2_HG008_variant_class_metrics.tsv, row 'Union', Class 'INDEL', column 'FP'
Configuration: Union of Mutect2, Strelka2 and DeepSomatic (at least one caller) (Hasan 2026)	Protocol: HG008 primary region (nogermlineinterference), indels, Mutect2, Strelka2, DeepSomatic and ensembles (Hasan 2026 Table 2, Class 'INDEL') Dataset: NIST/GIAB HG008 tumour-normal WGS (HG008-T pancreatic cancer cell line, matched normal), HG008-T draft somatic small-variant benchmark v0.3	0.839 Precision (indel only, HG008 primary region) fraction · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source Union on HG008 primary region (nogermlineinterference), indels (Hasan 2026) somatic-hg008-20261011-protocol-primary-indel Aggregation: Not reported Prospectively frozen external benchmarking reveals benchmark-context dependence in somatic variant calling; AmbioSpire P003/T001 publication source data and reproducibility package v1.0.0 (Zenodo) · Zenodo tables/Table2_HG008_variant_class_metrics.tsv, row 'Union', Class 'INDEL', column 'Precision'
Configuration: Union of Mutect2, Strelka2 and DeepSomatic (at least one caller) (Hasan 2026)	Protocol: HG008 primary region (nogermlineinterference), indels, Mutect2, Strelka2, DeepSomatic and ensembles (Hasan 2026 Table 2, Class 'INDEL') Dataset: NIST/GIAB HG008 tumour-normal WGS (HG008-T pancreatic cancer cell line, matched normal), HG008-T draft somatic small-variant benchmark v0.3	0.781 Recall (indel only, HG008 primary region) fraction · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source Union on HG008 primary region (nogermlineinterference), indels (Hasan 2026) somatic-hg008-20261011-protocol-primary-indel Aggregation: Not reported Prospectively frozen external benchmarking reveals benchmark-context dependence in somatic variant calling; AmbioSpire P003/T001 publication source data and reproducibility package v1.0.0 (Zenodo) · Zenodo tables/Table2_HG008_variant_class_metrics.tsv, row 'Union', Class 'INDEL', column 'Recall'
Configuration: Union of Mutect2, Strelka2 and DeepSomatic (at least one caller) (Hasan 2026)	Protocol: HG008 primary region (nogermlineinterference), indels, Mutect2, Strelka2, DeepSomatic and ensembles (Hasan 2026 Table 2, Class 'INDEL') Dataset: NIST/GIAB HG008 tumour-normal WGS (HG008-T pancreatic cancer cell line, matched normal), HG008-T draft somatic small-variant benchmark v0.3	3860 True positives (indel only, HG008 primary region) count · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source Union on HG008 primary region (nogermlineinterference), indels (Hasan 2026) somatic-hg008-20261011-protocol-primary-indel Aggregation: Not reported Prospectively frozen external benchmarking reveals benchmark-context dependence in somatic variant calling; AmbioSpire P003/T001 publication source data and reproducibility package v1.0.0 (Zenodo) · Zenodo tables/Table2_HG008_variant_class_metrics.tsv, row 'Union', Class 'INDEL', column 'TP'
Configuration: Union of Mutect2, Strelka2 and DeepSomatic (at least one caller) (Hasan 2026)	Protocol: HG008 primary region (nogermlineinterference), SNVs and indels combined, Mutect2, Strelka2, DeepSomatic and ensembles (Hasan 2026 Table 1) Dataset: NIST/GIAB HG008 tumour-normal WGS (HG008-T pancreatic cancer cell line, matched normal), HG008-T draft somatic small-variant benchmark v0.3	0.801 F1 (SNVs and indels, HG008 primary region) fraction · higher Uncertainty: 95% CI 0.766634 to 0.828861. Genomic block bootstrap over 5-Mb blocks, linear percentile interval; spatial variation within the benchmark region, not between tumours Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source Union on HG008 primary region (nogermlineinterference), SNVs and indels combined (Hasan 2026) somatic-hg008-20261011-protocol-primary-overall Aggregation: Not reported Prospectively frozen external benchmarking reveals benchmark-context dependence in somatic variant calling; AmbioSpire P003/T001 publication source data and reproducibility package v1.0.0 (Zenodo) · Zenodo tables/Table1_HG008_primary_metrics.tsv, row 'Union', column 'F1'
Configuration: Union of Mutect2, Strelka2 and DeepSomatic (at least one caller) (Hasan 2026)	Protocol: HG008 primary region (nogermlineinterference), SNVs and indels combined, Mutect2, Strelka2, DeepSomatic and ensembles (Hasan 2026 Table 1) Dataset: NIST/GIAB HG008 tumour-normal WGS (HG008-T pancreatic cancer cell line, matched normal), HG008-T draft somatic small-variant benchmark v0.3	1190 False negatives (SNVs and indels, HG008 primary region) count · lower Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source Union on HG008 primary region (nogermlineinterference), SNVs and indels combined (Hasan 2026) somatic-hg008-20261011-protocol-primary-overall Aggregation: Not reported Prospectively frozen external benchmarking reveals benchmark-context dependence in somatic variant calling; AmbioSpire P003/T001 publication source data and reproducibility package v1.0.0 (Zenodo) · Zenodo tables/Table1_HG008_primary_metrics.tsv, row 'Union', column 'FN'
Configuration: Union of Mutect2, Strelka2 and DeepSomatic (at least one caller) (Hasan 2026)	Protocol: HG008 primary region (nogermlineinterference), SNVs and indels combined, Mutect2, Strelka2, DeepSomatic and ensembles (Hasan 2026 Table 1) Dataset: NIST/GIAB HG008 tumour-normal WGS (HG008-T pancreatic cancer cell line, matched normal), HG008-T draft somatic small-variant benchmark v0.3	5170 False positives (SNVs and indels, HG008 primary region) count · lower Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source Union on HG008 primary region (nogermlineinterference), SNVs and indels combined (Hasan 2026) somatic-hg008-20261011-protocol-primary-overall Aggregation: Not reported Prospectively frozen external benchmarking reveals benchmark-context dependence in somatic variant calling; AmbioSpire P003/T001 publication source data and reproducibility package v1.0.0 (Zenodo) · Zenodo tables/Table1_HG008_primary_metrics.tsv, row 'Union', column 'FP'
Configuration: Union of Mutect2, Strelka2 and DeepSomatic (at least one caller) (Hasan 2026)	Protocol: HG008 primary region (nogermlineinterference), SNVs and indels combined, Mutect2, Strelka2, DeepSomatic and ensembles (Hasan 2026 Table 1) Dataset: NIST/GIAB HG008 tumour-normal WGS (HG008-T pancreatic cancer cell line, matched normal), HG008-T draft somatic small-variant benchmark v0.3	0.712 Precision (SNVs and indels, HG008 primary region) fraction · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source Union on HG008 primary region (nogermlineinterference), SNVs and indels combined (Hasan 2026) somatic-hg008-20261011-protocol-primary-overall Aggregation: Not reported Prospectively frozen external benchmarking reveals benchmark-context dependence in somatic variant calling; AmbioSpire P003/T001 publication source data and reproducibility package v1.0.0 (Zenodo) · Zenodo tables/Table1_HG008_primary_metrics.tsv, row 'Union', column 'Precision'
Configuration: Union of Mutect2, Strelka2 and DeepSomatic (at least one caller) (Hasan 2026)	Protocol: HG008 primary region (nogermlineinterference), SNVs and indels combined, Mutect2, Strelka2, DeepSomatic and ensembles (Hasan 2026 Table 1) Dataset: NIST/GIAB HG008 tumour-normal WGS (HG008-T pancreatic cancer cell line, matched normal), HG008-T draft somatic small-variant benchmark v0.3	0.915 Recall (SNVs and indels, HG008 primary region) fraction · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source Union on HG008 primary region (nogermlineinterference), SNVs and indels combined (Hasan 2026) somatic-hg008-20261011-protocol-primary-overall Aggregation: Not reported Prospectively frozen external benchmarking reveals benchmark-context dependence in somatic variant calling; AmbioSpire P003/T001 publication source data and reproducibility package v1.0.0 (Zenodo) · Zenodo tables/Table1_HG008_primary_metrics.tsv, row 'Union', column 'Recall'
Configuration: Union of Mutect2, Strelka2 and DeepSomatic (at least one caller) (Hasan 2026)	Protocol: HG008 primary region (nogermlineinterference), SNVs and indels combined, Mutect2, Strelka2, DeepSomatic and ensembles (Hasan 2026 Table 1) Dataset: NIST/GIAB HG008 tumour-normal WGS (HG008-T pancreatic cancer cell line, matched normal), HG008-T draft somatic small-variant benchmark v0.3	12800 True positives (SNVs and indels, HG008 primary region) count · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source Union on HG008 primary region (nogermlineinterference), SNVs and indels combined (Hasan 2026) somatic-hg008-20261011-protocol-primary-overall Aggregation: Not reported Prospectively frozen external benchmarking reveals benchmark-context dependence in somatic variant calling; AmbioSpire P003/T001 publication source data and reproducibility package v1.0.0 (Zenodo) · Zenodo tables/Table1_HG008_primary_metrics.tsv, row 'Union', column 'TP'
Configuration: Union of Mutect2, Strelka2 and DeepSomatic (at least one caller) (Hasan 2026)	Protocol: HG008 primary region (nogermlineinterference), SNVs, Mutect2, Strelka2, DeepSomatic and ensembles (Hasan 2026 Table 2, Class 'SNV') Dataset: NIST/GIAB HG008 tumour-normal WGS (HG008-T pancreatic cancer cell line, matched normal), HG008-T draft somatic small-variant benchmark v0.3	0.805 F1 (SNV only, HG008 primary region) fraction · higher Uncertainty: 95% CI 0.759011 to 0.842860. Genomic block bootstrap over 5-Mb blocks, linear percentile interval; spatial variation within the benchmark region, not between tumours Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source Union on HG008 primary region (nogermlineinterference), SNVs (Hasan 2026) somatic-hg008-20261011-protocol-primary-snv Aggregation: Not reported Prospectively frozen external benchmarking reveals benchmark-context dependence in somatic variant calling; AmbioSpire P003/T001 publication source data and reproducibility package v1.0.0 (Zenodo) · Zenodo tables/Table2_HG008_variant_class_metrics.tsv, row 'Union', Class 'SNV', column 'F1'
Configuration: Union of Mutect2, Strelka2 and DeepSomatic (at least one caller) (Hasan 2026)	Protocol: HG008 primary region (nogermlineinterference), SNVs, Mutect2, Strelka2, DeepSomatic and ensembles (Hasan 2026 Table 2, Class 'SNV') Dataset: NIST/GIAB HG008 tumour-normal WGS (HG008-T pancreatic cancer cell line, matched normal), HG008-T draft somatic small-variant benchmark v0.3	113 False negatives (SNV only, HG008 primary region) count · lower Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source Union on HG008 primary region (nogermlineinterference), SNVs (Hasan 2026) somatic-hg008-20261011-protocol-primary-snv Aggregation: Not reported Prospectively frozen external benchmarking reveals benchmark-context dependence in somatic variant calling; AmbioSpire P003/T001 publication source data and reproducibility package v1.0.0 (Zenodo) · Zenodo tables/Table2_HG008_variant_class_metrics.tsv, row 'Union', Class 'SNV', column 'FN'
Configuration: Union of Mutect2, Strelka2 and DeepSomatic (at least one caller) (Hasan 2026)	Protocol: HG008 primary region (nogermlineinterference), SNVs, Mutect2, Strelka2, DeepSomatic and ensembles (Hasan 2026 Table 2, Class 'SNV') Dataset: NIST/GIAB HG008 tumour-normal WGS (HG008-T pancreatic cancer cell line, matched normal), HG008-T draft somatic small-variant benchmark v0.3	4220 False positives (SNV only, HG008 primary region) count · lower Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source Union on HG008 primary region (nogermlineinterference), SNVs (Hasan 2026) somatic-hg008-20261011-protocol-primary-snv Aggregation: Not reported Prospectively frozen external benchmarking reveals benchmark-context dependence in somatic variant calling; AmbioSpire P003/T001 publication source data and reproducibility package v1.0.0 (Zenodo) · Zenodo tables/Table2_HG008_variant_class_metrics.tsv, row 'Union', Class 'SNV', column 'FP'
Configuration: Union of Mutect2, Strelka2 and DeepSomatic (at least one caller) (Hasan 2026)	Protocol: HG008 primary region (nogermlineinterference), SNVs, Mutect2, Strelka2, DeepSomatic and ensembles (Hasan 2026 Table 2, Class 'SNV') Dataset: NIST/GIAB HG008 tumour-normal WGS (HG008-T pancreatic cancer cell line, matched normal), HG008-T draft somatic small-variant benchmark v0.3	0.68 Precision (SNV only, HG008 primary region) fraction · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source Union on HG008 primary region (nogermlineinterference), SNVs (Hasan 2026) somatic-hg008-20261011-protocol-primary-snv Aggregation: Not reported Prospectively frozen external benchmarking reveals benchmark-context dependence in somatic variant calling; AmbioSpire P003/T001 publication source data and reproducibility package v1.0.0 (Zenodo) · Zenodo tables/Table2_HG008_variant_class_metrics.tsv, row 'Union', Class 'SNV', column 'Precision'
Configuration: Union of Mutect2, Strelka2 and DeepSomatic (at least one caller) (Hasan 2026)	Protocol: HG008 primary region (nogermlineinterference), SNVs, Mutect2, Strelka2, DeepSomatic and ensembles (Hasan 2026 Table 2, Class 'SNV') Dataset: NIST/GIAB HG008 tumour-normal WGS (HG008-T pancreatic cancer cell line, matched normal), HG008-T draft somatic small-variant benchmark v0.3	0.988 Recall (SNV only, HG008 primary region) fraction · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source Union on HG008 primary region (nogermlineinterference), SNVs (Hasan 2026) somatic-hg008-20261011-protocol-primary-snv Aggregation: Not reported Prospectively frozen external benchmarking reveals benchmark-context dependence in somatic variant calling; AmbioSpire P003/T001 publication source data and reproducibility package v1.0.0 (Zenodo) · Zenodo tables/Table2_HG008_variant_class_metrics.tsv, row 'Union', Class 'SNV', column 'Recall'
Configuration: Union of Mutect2, Strelka2 and DeepSomatic (at least one caller) (Hasan 2026)	Protocol: HG008 primary region (nogermlineinterference), SNVs, Mutect2, Strelka2, DeepSomatic and ensembles (Hasan 2026 Table 2, Class 'SNV') Dataset: NIST/GIAB HG008 tumour-normal WGS (HG008-T pancreatic cancer cell line, matched normal), HG008-T draft somatic small-variant benchmark v0.3	8970 True positives (SNV only, HG008 primary region) count · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source Union on HG008 primary region (nogermlineinterference), SNVs (Hasan 2026) somatic-hg008-20261011-protocol-primary-snv Aggregation: Not reported Prospectively frozen external benchmarking reveals benchmark-context dependence in somatic variant calling; AmbioSpire P003/T001 publication source data and reproducibility package v1.0.0 (Zenodo) · Zenodo tables/Table2_HG008_variant_class_metrics.tsv, row 'Union', Class 'SNV', column 'TP'

Source checking is not independent reproduction. Release 2026-10-22-1b7cf027e4f6.

Use this configuration

How it works, versions and access

Strengths, limitations and unresolved questions

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-10-22-1b7cf027e4f6
Property and statement	Original source and location	Review and provenance

No evidence rows match these filters. Choose another scope or clear the search.

How to read the evidence

Sources and history

Release 2026-10-22-1b7cf027e4f6 · Record review: source checked

2 source records and release history

Prospectively frozen external benchmarking reveals benchmark-context dependence in somatic variant calling · Original source · Research Square preprint rs-11210923 version 1, posted 2026-10-05; manuscript PDF (16 pages)
AmbioSpire P003/T001 publication source data and reproducibility package v1.0.0 (Zenodo) · Original source · Zenodo record 22998005, version 1.0.0, published 2026-09-27; file P003-T001-publication-data-v1.0.0-zenodo-final.zip (1,934,562 bytes, md5 a1fdab6108197602f07f72db77d9f996)

Download this release (gzip)

Technical metadata and extraction receipts

Stable ID: somatic-hg008-20261011-config-union

areas: dna-genomes
contexts: clinical_research
method types: conventional_pipeline
reported name: Union
foundation model eligible: false
parameters: Variant kept when at least one of Mutect2, Strelka2 and DeepSomatic reports it
access reuse: Ensemble rule defined in the source; no released implementation (Zenodo archive holds no executable code)
source locator: Online Methods 'Variant callers and retained software identities' and 'Consensus definitions and metrics'; Zenodo metadata/software_versions.tsv
missing metadata: version: reason: inapplicable; note: Deterministic ensemble rule over the three versioned callers
provenance note: Union as run in the cited HG008 evaluation.

Related records

Suggest a correction