rewirebio.iobenchmarks
Protocol

Manual versus Talos reanalysis of 219 unresolved genomes after a mean 660 days (Kaschta et al. 2026)

New P/LP and VUS findings, case-category counts and review effort from manual and automated reanalysis of the same unresolved cases.

2 evaluations · 14 results

Overview

An explanatory profile has not yet been reviewed for this record.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

2 recorded evaluations, 14 metric rows. A comparison chart has not yet been validated for these results. The table retains the individual findings and their sources.

View coverage and remaining gaps across all benchmarks

Results

Results are available, but no reviewed comparison panel is linked in this release.

All evaluations

2 evaluations · 14 results. Different protocols are not a single leaderboard.

Protocol: Manual versus Talos reanalysis of 219 unresolved genomes after a mean 660 days (Kaschta et al. 2026) · Dataset: UKSH rare-disease genomes without a prior P/LP finding: 219 cases (Kaschta et al. 2026)

Sorted by Count (cases with a new P/LP finding) (higher is better). The best value in each column is highlighted. Decimals are rounded for display; each value links to the printed value and its source.

Tested configurationCount (cases with a new P/LP finding)Count (cohort cases with a reported P/LP finding after reanalysis (158 before))Candidates per case (average variants returned per case, singleton and trio cases)Count (cases with newly reported findings (P/LP or VUS))Count (cohort cases without a prioritised finding after reanalysis (170 before))Count (cohort cases without a reported clinically relevant finding after reanalysis (170 before))Count (of the two cases newly classified as VUS by manual reanalysis, cases also prioritised)Diagnostic yield (total P/LP diagnostic rate in the 377-case cohort after reanalysis)Review time per case (mean hands-on time for full manual case reanalysis, excluding report writing and secondary-review preparation)Count (cohort cases with VUS findings after reanalysis (49 before))Count (cases newly classified as VUS findings)
Manual reanalysis in Illumina Emedgene with DRAGEN v4.2.4 re-calling (Kaschta et al. 2026)Evaluationthree (best in column)161 (best in column)Not reportedfiveNot reported166Not reported42.7%81 minutes50two
Talos 8.2.0 on archived DRAGEN v3.7.5 VCFs, pedigree where available (Kaschta et al. 2026)Evaluationthree (best in column)161 (best in column)threeNot reported167Not reportedoneNot reportedNot reported49Not reported
All 14 result rows with coverage, uncertainty and sources
Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: Manual reanalysis in Illumina Emedgene with DRAGEN v4.2.4 re-calling (Kaschta et al. 2026)Protocol: Manual versus Talos reanalysis of 219 unresolved genomes after a mean 660 days (Kaschta et al. 2026)
Dataset: UKSH rare-disease genomes without a prior P/LP finding: 219 cases (Kaschta et al. 2026)
five Count (cases with newly reported findings (P/LP or VUS))
count · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

Manual reanalysis of 219 unresolved genomes

reanalysis-kaschta-20261010-protocol-manual-vs-talos-219-reanalysis

Aggregation: Not reported

Automated versus manual reanalysis in rare disease genomics · Results, Reanalysis Diagnostic Yield: Manual Reanalysis P1, 'identified five cases with newly reported findings'
Configuration: Manual reanalysis in Illumina Emedgene with DRAGEN v4.2.4 re-calling (Kaschta et al. 2026)Protocol: Manual versus Talos reanalysis of 219 unresolved genomes after a mean 660 days (Kaschta et al. 2026)
Dataset: UKSH rare-disease genomes without a prior P/LP finding: 219 cases (Kaschta et al. 2026)
three Count (cases with a new P/LP finding)
count · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

Manual reanalysis of 219 unresolved genomes

reanalysis-kaschta-20261010-protocol-manual-vs-talos-219-reanalysis

Aggregation: Not reported

Automated versus manual reanalysis in rare disease genomics · Abstract P3, 'Manual reanalysis identified three additional P/LP cases'
Configuration: Manual reanalysis in Illumina Emedgene with DRAGEN v4.2.4 re-calling (Kaschta et al. 2026)Protocol: Manual versus Talos reanalysis of 219 unresolved genomes after a mean 660 days (Kaschta et al. 2026)
Dataset: UKSH rare-disease genomes without a prior P/LP finding: 219 cases (Kaschta et al. 2026)
two Count (cases newly classified as VUS findings)
count · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

Manual reanalysis of 219 unresolved genomes

reanalysis-kaschta-20261010-protocol-manual-vs-talos-219-reanalysis

Aggregation: Not reported

Automated versus manual reanalysis in rare disease genomics · Abstract P3, 'two newly classified as VUS'
Configuration: Manual reanalysis in Illumina Emedgene with DRAGEN v4.2.4 re-calling (Kaschta et al. 2026)Protocol: Manual versus Talos reanalysis of 219 unresolved genomes after a mean 660 days (Kaschta et al. 2026)
Dataset: UKSH rare-disease genomes without a prior P/LP finding: 219 cases (Kaschta et al. 2026)
166 Count (cohort cases without a reported clinically relevant finding after reanalysis (170 before))
count · lower

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

Manual reanalysis of 219 unresolved genomes

reanalysis-kaschta-20261010-protocol-manual-vs-talos-219-reanalysis

Aggregation: Not reported

Automated versus manual reanalysis in rare disease genomics · Results, Reanalysis Diagnostic Yield: Manual Reanalysis P3, 'decreased from 170 to 166'
Configuration: Manual reanalysis in Illumina Emedgene with DRAGEN v4.2.4 re-calling (Kaschta et al. 2026)Protocol: Manual versus Talos reanalysis of 219 unresolved genomes after a mean 660 days (Kaschta et al. 2026)
Dataset: UKSH rare-disease genomes without a prior P/LP finding: 219 cases (Kaschta et al. 2026)
161 Count (cohort cases with a reported P/LP finding after reanalysis (158 before))
count · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

Manual reanalysis of 219 unresolved genomes

reanalysis-kaschta-20261010-protocol-manual-vs-talos-219-reanalysis

Aggregation: Not reported

Automated versus manual reanalysis in rare disease genomics · Results, Reanalysis Diagnostic Yield: Manual Reanalysis P3, 'increased the number of cases with a reported P/LP finding from 158 to 161'
Configuration: Manual reanalysis in Illumina Emedgene with DRAGEN v4.2.4 re-calling (Kaschta et al. 2026)Protocol: Manual versus Talos reanalysis of 219 unresolved genomes after a mean 660 days (Kaschta et al. 2026)
Dataset: UKSH rare-disease genomes without a prior P/LP finding: 219 cases (Kaschta et al. 2026)
81 minutes Review time per case (mean hands-on time for full manual case reanalysis, excluding report writing and secondary-review preparation)
minute · lower

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

Manual reanalysis of 219 unresolved genomes

reanalysis-kaschta-20261010-protocol-manual-vs-talos-219-reanalysis

Aggregation: Not reported

Automated versus manual reanalysis in rare disease genomics · Results, Reanalysis Diagnostic Yield: Manual Reanalysis P3, 'The mean reanalysis time was 81 minutes per case'
Configuration: Manual reanalysis in Illumina Emedgene with DRAGEN v4.2.4 re-calling (Kaschta et al. 2026)Protocol: Manual versus Talos reanalysis of 219 unresolved genomes after a mean 660 days (Kaschta et al. 2026)
Dataset: UKSH rare-disease genomes without a prior P/LP finding: 219 cases (Kaschta et al. 2026)
42.7% Diagnostic yield (total P/LP diagnostic rate in the 377-case cohort after reanalysis)
percent · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

Manual reanalysis of 219 unresolved genomes

reanalysis-kaschta-20261010-protocol-manual-vs-talos-219-reanalysis

Aggregation: Not reported

Automated versus manual reanalysis in rare disease genomics · Results, Reanalysis Diagnostic Yield: Manual Reanalysis P3, 'yielding a total diagnostic rate of 42.7%'
Configuration: Manual reanalysis in Illumina Emedgene with DRAGEN v4.2.4 re-calling (Kaschta et al. 2026)Protocol: Manual versus Talos reanalysis of 219 unresolved genomes after a mean 660 days (Kaschta et al. 2026)
Dataset: UKSH rare-disease genomes without a prior P/LP finding: 219 cases (Kaschta et al. 2026)
50 Count (cohort cases with VUS findings after reanalysis (49 before))
count · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

Manual reanalysis of 219 unresolved genomes

reanalysis-kaschta-20261010-protocol-manual-vs-talos-219-reanalysis

Aggregation: Not reported

Automated versus manual reanalysis in rare disease genomics · Results, Reanalysis Diagnostic Yield: Manual Reanalysis P3, 'The number of cases with VUS findings increased from 49 to 50'
Configuration: Talos 8.2.0 on archived DRAGEN v3.7.5 VCFs, pedigree where available (Kaschta et al. 2026)Protocol: Manual versus Talos reanalysis of 219 unresolved genomes after a mean 660 days (Kaschta et al. 2026)
Dataset: UKSH rare-disease genomes without a prior P/LP finding: 219 cases (Kaschta et al. 2026)
three Candidates per case (average variants returned per case, singleton and trio cases)
variants-per-proband · lower

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Talos reanalysis of 219 unresolved genomes

reanalysis-kaschta-20261010-protocol-manual-vs-talos-219-reanalysis

Aggregation: Not reported

Automated versus manual reanalysis in rare disease genomics · Results, Reanalysis Diagnostic Yield: Automated Reanalysis P1, 'On average, Talos returned three variants per case'
Configuration: Talos 8.2.0 on archived DRAGEN v3.7.5 VCFs, pedigree where available (Kaschta et al. 2026)Protocol: Manual versus Talos reanalysis of 219 unresolved genomes after a mean 660 days (Kaschta et al. 2026)
Dataset: UKSH rare-disease genomes without a prior P/LP finding: 219 cases (Kaschta et al. 2026)
three Count (cases with a new P/LP finding)
count · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Talos reanalysis of 219 unresolved genomes

reanalysis-kaschta-20261010-protocol-manual-vs-talos-219-reanalysis

Aggregation: Not reported

Automated versus manual reanalysis in rare disease genomics · Results, Reanalysis Diagnostic Yield: Automated Reanalysis P1, 'also identified the three new P/LP cases'
Configuration: Talos 8.2.0 on archived DRAGEN v3.7.5 VCFs, pedigree where available (Kaschta et al. 2026)Protocol: Manual versus Talos reanalysis of 219 unresolved genomes after a mean 660 days (Kaschta et al. 2026)
Dataset: UKSH rare-disease genomes without a prior P/LP finding: 219 cases (Kaschta et al. 2026)
one Count (of the two cases newly classified as VUS by manual reanalysis, cases also prioritised)
count · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Talos reanalysis of 219 unresolved genomes

reanalysis-kaschta-20261010-protocol-manual-vs-talos-219-reanalysis

Aggregation: Not reported

Automated versus manual reanalysis in rare disease genomics · Abstract P3, 'only identified one of the two new VUS findings'
Configuration: Talos 8.2.0 on archived DRAGEN v3.7.5 VCFs, pedigree where available (Kaschta et al. 2026)Protocol: Manual versus Talos reanalysis of 219 unresolved genomes after a mean 660 days (Kaschta et al. 2026)
Dataset: UKSH rare-disease genomes without a prior P/LP finding: 219 cases (Kaschta et al. 2026)
167 Count (cohort cases without a prioritised finding after reanalysis (170 before))
count · lower

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Talos reanalysis of 219 unresolved genomes

reanalysis-kaschta-20261010-protocol-manual-vs-talos-219-reanalysis

Aggregation: Not reported

Automated versus manual reanalysis in rare disease genomics · Results, Reanalysis Diagnostic Yield: Automated Reanalysis P1, 'decreased from 170 to 167'
Configuration: Talos 8.2.0 on archived DRAGEN v3.7.5 VCFs, pedigree where available (Kaschta et al. 2026)Protocol: Manual versus Talos reanalysis of 219 unresolved genomes after a mean 660 days (Kaschta et al. 2026)
Dataset: UKSH rare-disease genomes without a prior P/LP finding: 219 cases (Kaschta et al. 2026)
161 Count (cohort cases with a reported P/LP finding after reanalysis (158 before))
count · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Talos reanalysis of 219 unresolved genomes

reanalysis-kaschta-20261010-protocol-manual-vs-talos-219-reanalysis

Aggregation: Not reported

Automated versus manual reanalysis in rare disease genomics · Results, Reanalysis Diagnostic Yield: Automated Reanalysis P1, 'increased the number of cases with a P/LP finding from 158 to 161'
Configuration: Talos 8.2.0 on archived DRAGEN v3.7.5 VCFs, pedigree where available (Kaschta et al. 2026)Protocol: Manual versus Talos reanalysis of 219 unresolved genomes after a mean 660 days (Kaschta et al. 2026)
Dataset: UKSH rare-disease genomes without a prior P/LP finding: 219 cases (Kaschta et al. 2026)
49 Count (cohort cases with VUS findings after reanalysis (49 before))
count · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Talos reanalysis of 219 unresolved genomes

reanalysis-kaschta-20261010-protocol-manual-vs-talos-219-reanalysis

Aggregation: Not reported

Automated versus manual reanalysis in rare disease genomics · Results, Reanalysis Diagnostic Yield: Automated Reanalysis P1, 'The number of cases based on results with VUS findings remained at 49'

Source checking is not independent reproduction. Release 2026-10-10-cbb3da59bc08.

Methods and evaluation design

Procedure, tasks and evaluated configurations

Recorded evaluations

Each evaluation records what was tested and under which conditions.

Baseline coverage

Reference methods help show what a model adds beyond simple controls. We track a null control and a conventional method for each protocol.

0 of 2 active baseline roles have published Rewire measurements in this release. Measurements on a selected protocol do not establish coverage of an entire suite.

No execution recipe linked to this protocol. Recipe availability does not establish a completed evaluation.

Author-reported evaluations
1
External evaluations
1

Literature evidence is not a Rewire measurement. Executed but unpublished runs and private review status are not included.

Null control

Proposed control: requires review

Select a task-valid null control after reviewing inputs and metric

Protocol-specific applicability, permitted inputs, access, split, evaluator and execution requirements need review before implementation or execution.

This is a suggested selection rule, not a validated method or a measured score.

Conventional reference

Proposed control: requires review

Select an upstream conventional reference after reviewing the full protocol

Protocol-specific applicability, permitted inputs, access, split, evaluator and execution requirements need review before implementation or execution.

This is a suggested selection rule, not a validated method or a measured score.

Protocol coverage CSV (gzip) · Model evaluation matrix (gzip) · Source table (gzip) · Release and checksums (gzip)

Coverage is derived from release 2026-10-10-cbb3da59bc08. Source citations describe the original records; they do not validate an unreviewed baseline proposal. No results have been generated by this audit.

Run instructions

No runnable recipe has been reviewed for this protocol. Dataset access, model requirements, licences and compute requirements must be checked against its sources before execution.

Strengths, limitations and unresolved questions

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-10-10-cbb3da59bc08
Property and statementOriginal source and locationReview and provenance

No evidence rows match these filters. Choose another scope or clear the search.

Sources and history

Release 2026-10-10-cbb3da59bc08 · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: reanalysis-kaschta-20261010-protocol-manual-vs-talos-219-reanalysis

areas
dna-genomes
contexts
clinical_research
protocol
Manual reanalysis of all 219 cases without a prior P/LP finding (October 2024 to December 2025); Talos applied to the whole cohort (October 2025); concordance defined as Talos returning the variants found or reclassified by manual reanalysis; outcomes counted at case level in the 377-case cohort.
version
medRxiv v1
source locator
Methods 'Study Cohort and Reanalysis Design', 'Manual Reanalysis', 'Automated Reanalysis Using Talos', 'Concordance Analysis and Error Types'; Results 'Reanalysis Diagnostic Yield'
limitations
Unequal inputs: the manual arm re-aligned and re-called the raw reads with DRAGEN v4.2.4 and used Emedgene; Talos used the archived DRAGEN v3.7.5 VCFs. Differences cannot be attributed to the method alone.; The reference is the manual arm's own result: Talos is scored on whether it returned what manual reanalysis found, so findings that only Talos might have made are not counted.; Very small numbers: three new P/LP cases in each arm.; The Talos total diagnostic yield is printed as 41.9% in a sentence that also gives 158 to 161 cases and calls it identical to the manual result; 161 of 377 is 42.7%, and 41.9% is the initial yield. That one result is disputed and not shown; the Talos count of 161 is stored.; Talos output per case is printed as an average of three variants (Results; Discussion P3) and as a median of approximately three (Discussion P1); the stored value is the average. It is a rounded word, and the cases it averages over (219 or the whole cohort) are not stated.; Manual time excludes report writing and preparation of evidence for secondary review; no hands-on time is printed for Talos.; Single centre, high initial yield (41.9%), one reanalysis round after a mean of 660 days.; A new candidate or classification is not a confirmed diagnosis; per-case confirmation details are in the supplement, which was not read.; Review effort is measured in different units: mean analyst minutes per case for the manual arm, candidate variants per case for Talos. No analyst time is printed for reviewing the Talos output, so the two cannot be compared as effort.; Manual reanalysis ran from October 2024 to December 2025 and Talos once in October 2025, so the knowledge available to each arm differed by case.; Illumina, which makes DRAGEN and Emedgene, provided sequencing reagents, software licences and technical support and supported the study (Competing interests; Funding statement).
Related records

Suggest a correction