rewirebio.iobenchmarks

Use caseDNA and genomesResearch and clinical research

Reanalyse unresolved rare-disease cases

Which reanalysis methods find new diagnoses or reduce review effort when given the same updated information?

What the evidence shows

No study gives two reanalysis methods the same updated information and compares their new diagnoses, so this evidence cannot show which method finds more.

One preprint compares methods on the same unresolved cases: in Kaschta et al. 2026, manual expert reanalysis and the automated tool Talos were applied to 219 genomes without a prior pathogenic or likely pathogenic finding. The arms had unequal inputs: the manual arm re-called the original reads with a newer DRAGEN version while Talos used the archived calls, and Talos was scored against the manual findings, so findings only Talos might have made were not counted. Each arm added the same three pathogenic or likely pathogenic cases, taking the cohort from 158 to 161 of 377 cases (42.7%), and manual reanalysis classified two new VUS cases, one of which Talos returned.

Manual review took a mean of 81 minutes per case and Talos returned about three variants per case on average, but no analyst time was printed for reviewing the Talos output, so the two effort figures cannot be compared. The numbers are small, from one centre with a high initial yield, and Illumina, which makes the manual arm's software, supported the study. The other printed comparisons measure review workload, or recovery of diagnoses that were already known.

In the Solve-RD CNV reanalysis of unsolved exomes, three callers returned different numbers of calls for expert review: ExomeDepth 4205, ClinCNV 2782 and CoNIFER 862. These counts overlap where callers found the same CNV, thresholds differ by caller, and ClinCNV was developed by the study's first author. In 100,000 Genomes Project cases diagnosed after a new disease-gene association, the Exomiser developers' recommended flagging rule (phenotype score increase 0.2, variant score 0.8) flagged 31 of the 37 diagnostic variants and 23 other variants, while the loosest rule tested flagged all 37 and 182 others; the rules were chosen on these same cases.

In the Talos developers' ACG trio cohort, strict phenotype filtering returned 403 candidate variants instead of 487 and recovered 164 known diagnoses instead of 177. The known diagnoses come from each cohort's earlier analysis, and Talos recovery counts only diagnoses its own calling pipeline could detect. Recall on known diagnoses is not new diagnostic yield, each comparison was reported by the developers of at least one method compared, and none is clinical validation.

You bring
  • Original ES/GS calls, coverage, report, filters and analysis date
  • Updated phenotype, pedigree and gene–disease or variant evidence
  • Dated changes to calling and interpretation methods
You want
A prioritised queue of new or changed findings, their evidence history and the review or confirmation needed to resolve each case.
Evidence in this release
6 comparisons shown · 6 tools · 91 configurations
Kept up to date
Evidence last checked 14 October 2026 · re-checked monthly, next due 14 November 2026

Baseline

Manual expert reanalysis and Exomiser. Kaschta et al. 2026 judge automated reanalysis against laboratory experts repeating the diagnostic review, a manual workflow rather than an algorithm. Exomiser rerun with updated annotations is the established automated comparator, used for reanalysis in the 100,000 Genomes Project (Vestito et al. 2024).

No linked comparison scores a machine-learning method against the baseline on the same data yet, so this evidence cannot say whether machine learning beats it.

Tools compared

Comparisons

Each table is one study or protocol with its own truth set and scoring. Compare tools within a table, not across tables.

CNV calls to review per caller, Solve-RD exome reanalysis (Demidov et al. 2024)

Proxy evidenceIndependent studyAuthor-reported

Number of CNV calls each of three callers (ClinCNV, CoNIFER, ExomeDepth) returned to clinical experts for interpretation, by copy number and type, on the same 9171 unsolved exomes from 5757 families

Sorted by Count (direction not stated).

Scroll sideways to see all 21 columns.

ToolCount (all CNVs returned for interpretation)Count (CNV calls returned for interpretation, all classes, all chromosomes)Count (CNV calls returned for interpretation, all classes, sex chromosomes)Count (CNV calls returned for interpretation, copy number >4, all chromosomes)Count (CNV calls returned for interpretation, copy number >4, sex chromosomes)Count (CNV calls returned for interpretation, copy number 0, all chromosomes)Count (CNV calls returned for interpretation, copy number 0, sex chromosomes)Count (CNV calls returned for interpretation, copy number 1, all chromosomes)Count (CNV calls returned for interpretation, copy number 1, sex chromosomes)Count (CNV calls returned for interpretation, copy number 2, all chromosomes)Count (CNV calls returned for interpretation, copy number 2, sex chromosomes)Count (CNV calls returned for interpretation, copy number 3, all chromosomes)Count (CNV calls returned for interpretation, copy number 3, sex chromosomes)Count (CNV calls returned for interpretation, copy number 4, all chromosomes)Count (CNV calls returned for interpretation, copy number 4, sex chromosomes)Count (CNV calls returned for interpretation, long CNVs, all chromosomes)Count (CNV calls returned for interpretation, long CNVs, sex chromosomes)Count (deletions returned for interpretation)Count (duplications returned for interpretation)Proportion (share of all CNV calls contributed by this caller)Proportion (share of this caller's calls that are duplications)
ExomeDepthconventional4.2054,205 (264)4,205 (264)23 (9)23 (9)218 (28)218 (28)1342 (90)1342 (90)38 (38)38 (38)1948 (64)1948 (64)134 (4)134 (4)502 (31)502 (31)1.6932.51254%60%
ClinCNVconventional2.7822,782 (469)2,782 (469)28 (2)28 (2)283 (206)283 (206)1,203 (64)1,203 (64)99 (99)99 (99)776 (29)776 (29)145 (1)145 (1)248 (68)248 (68)1.5611.22135%44%
Coniferconventional862862 (43)862 (43)0 (0)0 (0)5 (4)5 (4)65 (0)65 (0)20 (20)20 (20)246 (5)246 (5)0 (0)0 (0)526 (14)526 (14)23362911%73%
Caveats and method
  • Workload only: the tables count calls returned to experts per caller, not new diagnoses per caller. Per-caller detection of the 77 confirmed pathogenic CNVs is printed only in the Results text (claim on the protocol).
  • A CNV found by more than one caller was returned once per caller (Supplementary Table 2, 'Tool' annotation), so per-caller counts overlap and their sum (7849) counts calls, not distinct CNVs.
  • Primary call thresholds differ by caller. ExomeDepth's Bayes factor threshold is printed as BF > 15 (Methods 'Alignment and definition of capture regions of interest' paragraph 2) and as discarding BF < 0.15 ('ExomeDepth workflow' paragraph 2).
  • ClinCNV was developed by the paper's first author (ref. 47; Author contributions), so its row is author_reported.
  • CNV reanalysis only; no SNV or indel reanalysis method is compared. Expert time is reported only as a mean of 5 minutes per CNV, pooled over callers (Methods 'Clinical interpretation').

Protocol: CNV calls returned to clinical experts per caller after filtering, Solve-RD exome reanalysis (Demidov et al. 2024 Table 1, Supplementary Table 4)

Talos default and strict filtering on known diagnoses (Talos 2026)

Proxy evidenceAuthor-reported

Candidates per case (direction not stated), with the other metrics below each value.

Scroll sideways to see all 6 columns.

ToolACG trioACG singletonACG fullRGP trioRGP singletonRGP full
Talos default filtering, 2026 studyconventional1.3Count (candidate variants flagged) 487Candidates per diagnosis 2.8True positives 177R 90%1.8Count (candidate variants flagged) 729Candidates per diagnosis 4.3True positives 170R 82%1.3Count (candidate variants flagged) 523Candidates per diagnosis 2.8True positives 186R 89%1.3Count (candidate variants flagged) 519Candidates per diagnosis 11.0True positives 47R 87%2.2Count (candidate variants flagged) 1,491Candidates per diagnosis 18.4True positives 81R 87%1.6Count (candidate variants flagged) 1,095Candidates per diagnosis 13.7True positives 80R 86%
Talos strict phenotype-match filtering, 2026 studyconventional1.1Count (candidate variants flagged) 403Candidates per diagnosis 2.5True positives 164R 83%1.2Count (candidate variants flagged) 491Candidates per diagnosis 3.0True positives 160R 77%1.0Count (candidate variants flagged) 419Candidates per diagnosis 2.4True positives 173R 83%0.9Count (candidate variants flagged) 335Candidates per diagnosis 7.4True positives 45R 83%1.1Count (candidate variants flagged) 777Candidates per diagnosis 9.9True positives 78R 84%0.8Count (candidate variants flagged) 582Candidates per diagnosis 7.6True positives 77R 83%

R recall.

Caveats and method

What each column measures:

  • ACG trio: Known diagnoses recovered and candidate variants returned per proband by Talos default and strict (phenotype-match) filtering, ACG trio cohort
  • ACG singleton: Known diagnoses recovered and candidate variants returned per proband by Talos default and strict (phenotype-match) filtering, ACG singleton cohort
  • ACG full: Known diagnoses recovered and candidate variants returned per proband by Talos default and strict (phenotype-match) filtering, ACG full cohort
  • RGP trio: Known diagnoses recovered and candidate variants returned per proband by Talos default and strict (phenotype-match) filtering, RGP trio cohort
  • RGP singleton: Known diagnoses recovered and candidate variants returned per proband by Talos default and strict (phenotype-match) filtering, RGP singleton cohort
  • RGP full: Known diagnoses recovered and candidate variants returned per proband by Talos default and strict (phenotype-match) filtering, RGP full cohort
  • Recall here is recovery of diagnoses that were already known. It is not new diagnostic yield.
  • Only known diagnoses detectable by the standardised GATK, GATK-SV and GATK-gCNV pipeline form the recovery denominator (Table 1 footnote).
  • Talos developers' own evaluation (author_reported).
  • Candidates per proband is the ratio of table totals; the text calls such values medians (stored protocol limitation).
  • The same evaluations are also mapped as proxy for use-case-rare-disease-candidate-ranking.

Protocols: Talos diagnosis recovery and workload: ACG trio, Talos diagnosis recovery and workload: ACG singleton, Talos diagnosis recovery and workload: ACG full, Talos diagnosis recovery and workload: RGP trio, Talos diagnosis recovery and workload: RGP singleton, Talos diagnosis recovery and workload: RGP full

Exomiser reanalysis flag thresholds, later-diagnosed 100kGP cases (Vestito et al. 2024)

Proxy evidenceAuthor-reported

Variant-level TP, FN, FP, TN, recall, precision, F1 and F2 for 81 combinations of human phenotype score increase and variant score threshold, flagging new candidates between Exomiser database releases in 37 later-diagnosed cases

Sorted by F-beta (higher is better). Showing the top 10 of 81 rows. The best value in each column is highlighted.

Scroll sideways to see all 8 columns.

ToolF-beta (F2 (beta = 2))F1False negatives (diagnosed variants not flagged)False positives (non-diagnostic variants flagged for review)PrecisionRecallTrue negatives (non-diagnostic variants not flagged)True positives (diagnosed variants flagged)
Diff human score 0.2, Var score 0.8conventional0.7673 (best in column)0.6816230.574183.8%178631
Diff human score 0.3, Var score 0.8conventional0.76140.6987190.612281.1%179030
Diff human score 0.1, Var score 0.8conventional0.75240.6536270.534583.8%178231
Diff human score 0.4, Var score 0.8conventional0.74070.7189130.682975.7%179628
Diff human score 0.2, Var score 0.9conventional0.72970.73010100.729773.0%179927
Diff human score 0.1, Var score 0.9conventional0.72580.72010110.710573.0%179827
Diff human score 0.3, Var score 0.7conventional0.72430.6026350.469783.8%177431
Diff human score 0.3, Var score 0.6conventional0.72370.5644470.412589.2%176233
Diff human score 0.5, Var score 0.6conventional0.71790.6679190.595775.7%179028
Diff human score 0.4, Var score 0.6conventional0.71760.5906370.455983.8%177231
Diff human score 0.3, Var score 0.9conventional0.71430.732 (best in column)1180.764770.3%180126
Diff human score 0.4, Var score 0.7conventional0.71430.6308260.527378.4%178329
Diff human score 0.5, Var score 0.5conventional0.71430.6308260.527378.4%178329
Diff human score 0.2, Var score 0.6conventional0.71130.5313570.373691.9%175234
Diff human score 0.2, Var score 0.7conventional0.71110.5615450.415686.5%176432
Diff human score 0.5, Var score 0.4conventional0.70750.5947340.468881.1%177530
Diff human score 0.4, Var score 0.5conventional0.69570.5385500.390286.5%175932
Diff human score 0.5, Var score 0.8conventional0.69440.7251270.781367.6%180225
Diff human score 0.1, Var score 0.6conventional0.69390.5073630.350591.9%174634
Diff human score 0.4, Var score 0.4conventional0.69390.5073630.350591.9%174634
Diff human score 0.1, Var score 0.7conventional0.69260.5335510.385586.5%175832
Diff human score 0.3, Var score 0.5conventional0.69110.5043640.346991.9%174534
Diff human score 0.5, Var score 0.7conventional0.68420.65811160.619070.3%179326
Diff human score 0.3, Var score 0.4conventional0.67920.4681810.307797.3%172836
Diff human score 0.5, Var score 0.3conventional0.67870.5457430.411081.1%176630
Diff human score 0.2, Var score 0.5conventional0.67570.4732760.315394.6%173335
Diff human score 0.4, Var score 0.9conventional0.67420.7161360.800064.9%180324
Diff human score 0.5, Var score 0.2conventional0.66370.5227480.384681.1%176130
Diff human score 0.4, Var score 0.3conventional0.65890.4633760.309191.9%173334
Diff human score 0.1, Var score 0.5conventional0.65790.4522830.296694.6%172635
Diff human score 0.2, Var score 0.4conventional0.65370.4300 (best in column)980.2741100.0% (best in column)171137 (best in column)
Diff human score 0.3, Var score 0.3conventional0.64060.4241970.270797.3%171236
Diff human score 0.5, Var score 0.9conventional0.63580.7101530.880059.5%180622
Diff human score 0.1, Var score 0.4conventional0.63570.4110 (best in column)1060.2587100.0% (best in column)170337 (best in column)
Diff human score 0.5, Var score 0.1conventional0.63560.4807580.340981.1%175130
Diff human score 0.4, Var score 0.2conventional0.63430.4333860.283391.9%172334
Diff human score 0.2, Var score 0.3conventional0.61060.3850 (best in column)1180.2387100.0% (best in column)169137 (best in column)
Diff human score 0.3, Var score 0.2conventional0.60610.38711130.241697.3%169636
Diff human score 0.4, Var score 0.1conventional0.60500.4003990.255691.9%171034
Diff human score 0.1, Var score 0.3conventional0.59290.3680 (best in column)1270.2256100.0% (best in column)168237 (best in column)
Diff human score 0.6, Var score 0.6conventional0.58660.61816100.677456.8%179921
Diff human score 0.2, Var score 0.2conventional0.57450.3510 (best in column)1370.2126100.0% (best in column)167237 (best in column)
Diff human score 0.6, Var score 0.5conventional0.57070.57516150.583356.8%179421
Diff human score 0.3, Var score 0.1conventional0.56780.35011330.213097.3%167636
Diff human score 0.6, Var score 0.4conventional0.55850.54516190.525056.8%179021
Diff human score 0.1, Var score 0.2conventional0.55560.3330 (best in column)1480.2000100.0% (best in column)166137 (best in column)
Diff human score 0.6, Var score 0.3conventional0.54690.51916230.477356.8%178621
Diff human score 0.6, Var score 0.2conventional0.54120.50616250.456556.8%178421
Diff human score 0.6, Var score 0.7conventional0.53980.5851890.678651.4%180019
Diff human score 0.6, Var score 0.8conventional0.52940.6101940.818248.6%180518
Diff human score 0.2, Var score 0.1conventional0.52860.3100 (best in column)1650.1832100.0% (best in column)164437 (best in column)
Diff human score 0.6, Var score 0.1conventional0.52760.47716300.411856.8%177921
Diff human score 0.1, Var score 0.1conventional0.50410.2890 (best in column)1820.1689100.0% (best in column)162737 (best in column)
Diff human score 0.6, Var score 0.9conventional0.48190.5822120.8889 (best in column)43.2%180716
Diff human score 0.7, Var score 0.6conventional0.44120.5082270.681840.5%180215
Diff human score 0.7, Var score 0.5conventional0.43350.48422100.600040.5%179915
Diff human score 0.7, Var score 0.4conventional0.42610.46222130.535740.5%179615
Diff human score 0.7, Var score 0.3conventional0.41900.44122160.483940.5%179315
Diff human score 0.7, Var score 0.2conventional0.41670.43522170.468840.5%179215
Diff human score 0.7, Var score 0.1conventional0.40760.41122210.416740.5%178815
Diff human score 0.7, Var score 0.7conventional0.38920.4642460.684235.1%180313
Diff human score 0.7, Var score 0.9conventional0.37040.4712520.857132.4%180712
Diff human score 0.7, Var score 0.8conventional0.36810.4622530.800032.4%180612
Diff human score 0.8, Var score 0.9conventional0.19350.273311 (best in column)0.857116.2%1808 (best in column)6
Diff human score 0.8, Var score 0.8conventional0.19230.2673120.750016.2%18076
Diff human score 0.8, Var score 0.6conventional0.18990.2553140.600016.2%18056
Diff human score 0.8, Var score 0.7conventional0.18990.2553140.600016.2%18056
Diff human score 0.8, Var score 0.5conventional0.18750.2453160.500016.2%18036
Diff human score 0.8, Var score 0.4conventional0.18630.2403170.461516.2%18026
Diff human score 0.8, Var score 0.2conventional0.18290.22631100.375016.2%17996
Diff human score 0.8, Var score 0.3conventional0.18290.22631100.375016.2%17996
Diff human score 0.8, Var score 0.1conventional0.17960.21431130.315816.2%17966
Diff human score 0.9, Var score 0.9conventional0.16230.233321 (best in column)0.833313.5%1808 (best in column)5
Diff human score 0.9, Var score 0.8conventional0.16130.2273220.714313.5%18075
Diff human score 0.9, Var score 0.6conventional0.15920.2173240.555613.5%18055
Diff human score 0.9, Var score 0.7conventional0.15920.2173240.555613.5%18055
Diff human score 0.9, Var score 0.4conventional0.15720.2083260.454513.5%18035
Diff human score 0.9, Var score 0.5conventional0.15720.2083260.454513.5%18035
Diff human score 0.9, Var score 0.2conventional0.15530.2003280.384613.5%18015
Diff human score 0.9, Var score 0.3conventional0.15530.2003280.384613.5%18015
Diff human score 0.9, Var score 0.1conventional0.15340.19232100.333313.5%17995
Show all 81 rowsShow the top 10 rows only
Caveats and method
  • The 37 cases were already diagnosed, so this measures recovery of known later diagnoses. It is not new diagnostic yield.
  • Run by the Exomiser developers on their own tool (author_reported).
  • Supplementary Table 1 does not name the database releases compared. The 0.2/0.8 row (TP 31, FP 23) matches the Results comparison of the February 2019 and February 2022 databases; reading the whole table as that comparison is an inference (claim on the protocol).
  • The thresholds were chosen by F2 on the same 37 cases, so the 0.2/0.8 row, which is the recommended setting and the highest F2, overstates expected performance on new cases. The other 80 rows are as printed.

Protocol: Flagging new reanalysis candidates from Exomiser score changes across database releases (Vestito et al. 2024 Supplementary Table 1)

Manual versus Talos reanalysis on one cohort (Kaschta et al. 2026)

Proxy evidenceAuthor-reportedIndependent study

Count (higher is better), with the other metrics below each value. The best value in each column is highlighted.

Scroll sideways to see all 3 columns.

ToolReanalysis of 219 unresolved casesTalos benchmark, singletonsTalos benchmark, trios
Manual reanalysis (Illumina Emedgene)Baselineconventionalfive (best in column)cases with newly reported findings (P/LP or VUS)Count (cases with a new P/LP finding) threeCount (cases newly classified as VUS findings) twoCount (cohort cases without a reported clinically relevant finding after reanalysis (170 before)) 166Count (cohort cases with a reported P/LP finding after reanalysis (158 before)) 161
3 more valuesReview time per case 81 min minutesDiagnostic yield 42.7%Count (cohort cases with VUS findings after reanalysis (49 before)) 50
Not reportedNot reported
Talosconventionalthreecases with a new P/LP findingCandidates per case threeCount (of the two cases newly classified as VUS by manual reanalysis, cases also prioritised) oneCount (cohort cases without a prioritised finding after reanalysis (170 before)) 167Count (cohort cases with a reported P/LP finding after reanalysis (158 before)) 161Count (cohort cases with VUS findings after reanalysis (49 before)) 49twoProportion (pipeline conversion errors) 8.6%Proportion (HPO annotation gaps) 11.4%R 80.0%SixProportion (missed: pipeline conversion errors) 6.2%Proportion (missed: HPO annotation gaps) 6.2%Proportion (not prioritised because of trio inheritance filtering) 7.6%Proportion (missed: large copy-number variants not processed) 2.1%
2 more valuesProportion (missed: out-of-scope variant classes) 2.8%R 75.2%
Talos (proband-only mode)conventionalNot reportedNot reportedNot reportedR 82.8%

R recall.

Caveats and method

What each column measures:

  • Reanalysis of 219 unresolved cases: New P/LP and VUS case findings, case-category counts, manual review time and Talos candidates per case for manual and Talos reanalysis of the same 219 unresolved genomes
  • Talos benchmark, singletons: Share of 35 known P/LP variants and count of 21 known VUS that Talos prioritised in 45 singleton cases, with failure modes
  • Talos benchmark, trios: Share of 145 known P/LP variants Talos prioritised in 162 trio cases in trio mode and proband-only mode, VUS captured and failure modes
  • Unequal inputs: the manual arm re-aligned and re-called the raw reads with DRAGEN v4.2.4 and used Emedgene; Talos used the archived DRAGEN v3.7.5 VCFs. Differences cannot be attributed to the method alone.
  • This does not meet the question's condition of the same updated information: the arms had different variant calls and partly different knowledge dates, so a difference between them cannot be attributed to the method.
  • The reference is the manual arm's own result: Talos is scored on whether it returned what manual reanalysis found, so findings that only Talos might have made are not counted. Talos can only match or miss what manual reanalysis found; candidates only Talos returned were not adjudicated. Talos found all three new P/LP cases from the archived v3.7.5 calls, so none of the P/LP gains depended on the manual arm's re-calling.
  • Very small numbers: three new P/LP cases in each arm.
  • The Talos total diagnostic yield is printed as 41.9% in a sentence that also gives 158 to 161 cases and calls it identical to the manual result; 161 of 377 is 42.7%, and 41.9% is the initial yield. That one result is disputed and not shown; the Talos count of 161 is stored.
  • Talos output per case is printed as an average of three variants (Results; Discussion P3) and as a median of approximately three (Discussion P1); the stored value is the average. It is a rounded word, and the cases it averages over (219 or the whole cohort) are not stated.
  • Manual time excludes report writing and preparation of evidence for secondary review; no hands-on time is printed for Talos.
  • Single centre, high initial yield (41.9%), one reanalysis round after a mean of 660 days.
  • A new candidate or classification is not a confirmed diagnosis; per-case confirmation details are in the supplement, which was not read.
  • Review effort is measured in different units: mean analyst minutes per case for the manual arm, candidate variants per case for Talos. No analyst time is printed for reviewing the Talos output, so the two cannot be compared as effort.
  • Manual reanalysis ran from October 2024 to December 2025 and Talos once in October 2025, so the knowledge available to each arm differed by case.
  • Illumina, which makes DRAGEN and Emedgene, provided sequencing reagents, software licences and technical support and supported the study (Competing interests; Funding statement).
  • Positive controls are known findings from the initial analysis; recovering them does not establish new diagnostic yield.
  • Concordance is per variant against the initial report, not per case. Methods 'Benchmarking of Automated Reanalysis' P1 defines the detection rate per case; the Results report concordance per variant (for example 28 of 35 P/LP variants), which is what is stored.
  • The pipeline conversion share for singletons is 8.6% in the text but 9.6% in the Figure 2 legend; the text value is stored (3 of 35 is 8.6%).
  • Strict inheritance filtering in trio mode excluded 11 P/LP variants that proband-only mode recovered.

Protocols: Manual versus Talos reanalysis of 219 unresolved genomes after a mean 660 days (Kaschta et al. 2026), Talos recovery of known P/LP and VUS variants in 45 singleton cases (Kaschta et al. 2026), Talos recovery of known P/LP and VUS variants in 162 trio cases (Kaschta et al. 2026)

Talos programme reanalysis yield

Direct evidenceAuthor-reported

New confirmed diagnoses and review workload during monthly reanalysis

Single reported result.

Talos monthly iterative reanalysis with clinical confirmationconventional

Count (diagnoses: first cycle)
221
Count (diagnoses: improved analysis)
109
Count (diagnoses: later cycles)
20
Count (diagnoses: new confirmed)
241
Count (diagnoses: new gene-disease evidence)
78
Count (diagnoses: new variant evidence)
54
Count (newly diagnosed individuals)
238
Diagnostic yield (additional yield from reanalysis)
5.1%
New candidates per 1000 cases per cycle
5
Proportion (diagnoses: first cycle)
92%
Proportion (diagnoses: improved analysis)
45%
Proportion (diagnoses: later cycles)
8%
Proportion (diagnoses: new gene-disease evidence)
32%
Proportion (diagnoses: new variant evidence)
22%
Caveats and method
  • No equal-input refreshed conventional control.
  • No randomization/blinding; updated calls and knowledge contribute to yield.

Protocol: Talos programme reanalysis yield

Exomiser v14 rank budget on known ACG trio diagnoses (Talos 2026)

Proxy evidenceAuthor-reported

Known ACG trio diagnoses recovered by Exomiser v14 within all, top 10, top 5 and top 1 ranks, as the comparator to Talos

Single reported result.

Exomiser v14 default, Talos 2026 comparisonBaselineconventional

Recall (rank: any)
89%
Count (rank: any)
172
Count (rank: top 1)
127
Count (rank: top 10)
164
Count (rank: top 5)
157
Top-1 accuracy
65%
Top-10 accuracy
85%
Top-5 accuracy
81%
Caveats and method
  • Recall here is recovery of diagnoses that were already known. It is not new diagnostic yield.
  • The Results text gives 194 trio families with SNV or indel diagnoses, and every printed percentage matches 194 (172/194 = 88.7%, printed 89%; 127/194 = 65.5%, printed 65%). Only the Extended Data Fig. 1 legend gives N = 190, for the paired panels, which are not extracted.
  • Talos Table 1 uses 196 known ACG trio diagnoses of all variant types, so Talos and Exomiser recall have different denominators and sit in separate comparison groups.
  • Exomiser v14 with default configuration; data release, phenotype input and pathogenicity sources not stated.
  • A rank budget (top 1, 5 or 10) is not measured analyst effort.

Protocol: Exomiser rank-budget recovery in ACG trios

Not covered yet

  • Equal updated calls, phenotypes and knowledge with matched review effort are not established in the extracted peer-reviewed programme.
  • Kaschta et al. 2026 (medRxiv 10.64898/2026.05.16.26352295, version 1) is the only study found that compares two reanalysis methods by new findings on the same unresolved cases, and it prints its values only in prose. Its Table 1 is an image of individual variants, its supplement is per-patient data and was not read, and its licence reserves all rights, so the source is pinned by hash and not archived.
  • In Kaschta et al. 2026 the arms did not receive the same updated information: manual reanalysis re-called the reads with DRAGEN v4.2.4 while Talos used the archived v3.7.5 calls, the arms ran at different times, and Talos was scored against the manual findings. Review effort was measured as analyst minutes per case for the manual arm and candidate variants per case for Talos. Its automated total yield is printed as 41.9% where 161 of 377 is 42.7%; that value is disputed and not shown.
  • False alerts, review time, retracted diagnoses and source denominator inconsistencies need adjudication.
  • Qualified human scientific review remains outstanding; automated source transcription does not establish experimental replication.
  • No printed table compares several reanalysis methods by new confirmed diagnoses on the same unsolved cohort.
  • The Solve-RD CNV reanalysis (Demidov et al. 2024) tables count the calls each caller returned for review. Calls found by more than one caller are counted once per caller, and per-caller detection of the confirmed pathogenic CNVs is printed only in the text.
  • The Exomiser flagging thresholds (Vestito et al. 2024) and the Talos evaluation cohorts are scored on diagnoses already known, which the first exclusion keeps out of new-yield evidence. The Exomiser thresholds were also chosen on the same 37 cases they are scored on.
  • AMELIE 3 (medRxiv 2020.12.29.20248974) reports alerts per patient per year, but its tables are images; not extracted.
  • Genet Med 2022 (Moon versus Exomiser on 80 nondiagnostic exomes) and J Mol Diagn 2019 (automated exome reanalysis) were not open access and were not retrieved.
  • No machine-learning method has been compared with manual expert reanalysis or Exomiser on the same data in the linked evidence.

Contribute evidence or propose a correction

Question, sources and review

Who this is for, setting and exclusions

Choose a workflow that identifies previously unresolved cases worth reopening and explains the evidence changes that warrant review.

Who this is for
  • Clinical genomics services responsible for unresolved cases
  • Laboratory reanalysis leads
Biological setting
A defined cohort remaining unresolved after an earlier ES/GS analysis, followed over a stated interval. Variant reevaluation and whole-case reanalysis are recorded separately.
Clinical research scope
Clinical research on reanalysis support. Programme-level yield and the added value of a method require different comparisons; diagnoses and diagnosed individuals have separate denominators.

Outside this use case

  • Reranking known solved cases does not establish new diagnostic yield.
  • New knowledge, phenotypes or variant calls must not be counted automatically as algorithmic improvement.
  • A changed database label or new candidate is not a confirmed diagnosis.
Evidence collection plan
Evidence collection planCollecting evidence

Already on record: 6 comparisons shown · 6 tools, in the evaluated evidence above. The status above describes only the specific comparison in this plan, which remains open; it does not mean no evidence has been collected. The plan defines a comparison to investigate; it does not establish model performance or suitability.

Comparison question

Does a proposed reanalysis method improve confirmed diagnoses or reduce review burden relative to refreshed conventional analysis using identical updated knowledge, phenotypes and calls?

Baselines, outcomes and validation requirements

Baselines to include

  • Refreshed conventional analysis with the same updated information
  • The original unresolved cohort for programme-level incremental yield, reported separately

Outcomes to measure

  • New confirmed diagnoses per eligible case over a stated interval
  • Added method benefit under equal updated inputs
  • False alerts, review time and the reason for each resolved case

Validation requirements

  • Record original and update dates; exclude future knowledge at each analysis time.
  • Separate benefit from new information, calling changes and prioritisation changes.
  • Audit family/site overlap and originating-laboratory label circularity.
  • Count diagnoses and diagnosed individuals separately; distinguish first and repeated cycles.
  • Use independent qualified clinical-genetics review to confirm outcomes.

Next collection task

Close the remaining endpoint, independence and comparator gaps documented in the 30 September 2026 audit and linked article issue; obtain qualified scientific review.

Sources, review and downloads

Automated source review · 2026-09-30 · Codex source curation, independent worker cross-review and root integration review

Source-backed literature curation with independent automated transcription and scope checks. No new model execution, independent experimental replication, qualified human scientific review or clinical validation.

Release 2026-11-02-a7f03c9e55a5 · question use-case-unresolved-rare-disease-reanalysis

Use-case input digest 43a80aef5473f1a49c013b6d46b720b850ff5a0d18dcbb741dcdeed1ed082db1

Download questions and review metadata (JSON) (gzip) · Verify release checksums (gzip)