Talos 2026 evaluation and reanalysis study
Published-study grouping of the catalogued evaluation protocols. This grouping does not claim an executable suite, full-paper extraction or independent clinical validation.
Overview
An explanatory profile has not yet been reviewed for this record.
Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.
14 recorded evaluations, 82 metric rows. A comparison chart has not yet been validated for these results. The table retains the individual findings and their sources.
Results
Results are available, but no reviewed comparison panel is linked in this release.
All evaluations
14 evaluations · 82 results. Different protocols are not a single leaderboard.
Filter evaluations
Applied filters: All linked evaluations
| Tested configuration | Protocol and dataset | Finding | Evidence and details |
|---|---|---|---|
| Configuration: Exomiser v14 default, Talos 2026 comparison | Protocol: Exomiser rank-budget recovery in ACG trios Dataset: ACG trios: Exomiser SNV/indel comparison as reported in Results | 172 Count (rank: any) count · unknown Uncertainty: Not reported by the source: not reported for this endpoint Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceExomiser v14 ACG trio rank-budget evaluation Not reported Aggregation: Not reported Automated reanalysis of genomic data for rare disease diagnostics at scale · Results, Comparison with other tools, rank all |
| Configuration: Exomiser v14 default, Talos 2026 comparison | Protocol: Exomiser rank-budget recovery in ACG trios Dataset: ACG trios: Exomiser SNV/indel comparison as reported in Results | 89% Recall (rank: any) percent · higher Uncertainty: Not reported by the source: not reported for this endpoint Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceExomiser v14 ACG trio rank-budget evaluation Not reported Aggregation: Not reported Automated reanalysis of genomic data for rare disease diagnostics at scale · Results, Comparison with other tools, rank all |
| Configuration: Exomiser v14 default, Talos 2026 comparison | Protocol: Exomiser rank-budget recovery in ACG trios Dataset: ACG trios: Exomiser SNV/indel comparison as reported in Results | 127 Count (rank: top 1) count · unknown Uncertainty: Not reported by the source: not reported for this endpoint Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceExomiser v14 ACG trio rank-budget evaluation Not reported Aggregation: Not reported Automated reanalysis of genomic data for rare disease diagnostics at scale · Results, Comparison with other tools, rank top1 |
| Configuration: Exomiser v14 default, Talos 2026 comparison | Protocol: Exomiser rank-budget recovery in ACG trios Dataset: ACG trios: Exomiser SNV/indel comparison as reported in Results | 65% Top-1 accuracy percent · higher Uncertainty: Not reported by the source: not reported for this endpoint Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceExomiser v14 ACG trio rank-budget evaluation Not reported Aggregation: Not reported Automated reanalysis of genomic data for rare disease diagnostics at scale · Results, Comparison with other tools, rank top1 |
| Configuration: Exomiser v14 default, Talos 2026 comparison | Protocol: Exomiser rank-budget recovery in ACG trios Dataset: ACG trios: Exomiser SNV/indel comparison as reported in Results | 164 Count (rank: top 10) count · unknown Uncertainty: Not reported by the source: not reported for this endpoint Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceExomiser v14 ACG trio rank-budget evaluation Not reported Aggregation: Not reported Automated reanalysis of genomic data for rare disease diagnostics at scale · Results, Comparison with other tools, rank top10 |
| Configuration: Exomiser v14 default, Talos 2026 comparison | Protocol: Exomiser rank-budget recovery in ACG trios Dataset: ACG trios: Exomiser SNV/indel comparison as reported in Results | 85% Top-10 accuracy percent · higher Uncertainty: Not reported by the source: not reported for this endpoint Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceExomiser v14 ACG trio rank-budget evaluation Not reported Aggregation: Not reported Automated reanalysis of genomic data for rare disease diagnostics at scale · Results, Comparison with other tools, rank top10 |
| Configuration: Exomiser v14 default, Talos 2026 comparison | Protocol: Exomiser rank-budget recovery in ACG trios Dataset: ACG trios: Exomiser SNV/indel comparison as reported in Results | 157 Count (rank: top 5) count · unknown Uncertainty: Not reported by the source: not reported for this endpoint Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceExomiser v14 ACG trio rank-budget evaluation Not reported Aggregation: Not reported Automated reanalysis of genomic data for rare disease diagnostics at scale · Results, Comparison with other tools, rank top5 |
| Configuration: Exomiser v14 default, Talos 2026 comparison | Protocol: Exomiser rank-budget recovery in ACG trios Dataset: ACG trios: Exomiser SNV/indel comparison as reported in Results | 81% Top-5 accuracy percent · higher Uncertainty: Not reported by the source: not reported for this endpoint Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceExomiser v14 ACG trio rank-budget evaluation Not reported Aggregation: Not reported Automated reanalysis of genomic data for rare disease diagnostics at scale · Results, Comparison with other tools, rank top5 |
| Configuration: Talos monthly iterative reanalysis with clinical confirmation | Protocol: Talos programme reanalysis yield Dataset: Talos 4,735 unresolved individuals | 5.1% Diagnostic yield (additional yield from reanalysis) percent · higher Uncertainty: Not reported by the source: not reported for this endpoint Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceTalos monthly reanalysis programme Not reported Aggregation: Not reported Automated reanalysis of genomic data for rare disease diagnostics at scale · Results, Iterative reanalysis, paragraph beginning Review of Talos output |
| Configuration: Talos monthly iterative reanalysis with clinical confirmation | Protocol: Talos programme reanalysis yield Dataset: Talos 4,735 unresolved individuals | 221 Count (diagnoses: first cycle) count · unknown Uncertainty: Not reported by the source: not reported for this endpoint Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceTalos monthly reanalysis programme Not reported Aggregation: Not reported Automated reanalysis of genomic data for rare disease diagnostics at scale · Results, Iterative reanalysis, paragraph beginning Twenty-nine cycles |
| Configuration: Talos monthly iterative reanalysis with clinical confirmation | Protocol: Talos programme reanalysis yield Dataset: Talos 4,735 unresolved individuals | 92% Proportion (diagnoses: first cycle) percent · unknown Uncertainty: Not reported by the source: not reported for this endpoint Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceTalos monthly reanalysis programme Not reported Aggregation: Not reported Automated reanalysis of genomic data for rare disease diagnostics at scale · Results, Iterative reanalysis, paragraph beginning Twenty-nine cycles |
| Configuration: Talos monthly iterative reanalysis with clinical confirmation | Protocol: Talos programme reanalysis yield Dataset: Talos 4,735 unresolved individuals | 109 Count (diagnoses: improved analysis) count · unknown Uncertainty: Not reported by the source: not reported for this endpoint Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceTalos monthly reanalysis programme Not reported Aggregation: Not reported Automated reanalysis of genomic data for rare disease diagnostics at scale · Results, Iterative reanalysis, paragraph beginning More than half |
| Configuration: Talos monthly iterative reanalysis with clinical confirmation | Protocol: Talos programme reanalysis yield Dataset: Talos 4,735 unresolved individuals | 45% Proportion (diagnoses: improved analysis) percent · unknown Uncertainty: Not reported by the source: not reported for this endpoint Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceTalos monthly reanalysis programme Not reported Aggregation: Not reported Automated reanalysis of genomic data for rare disease diagnostics at scale · Results, Iterative reanalysis, paragraph beginning More than half |
| Configuration: Talos monthly iterative reanalysis with clinical confirmation | Protocol: Talos programme reanalysis yield Dataset: Talos 4,735 unresolved individuals | 20 Count (diagnoses: later cycles) count · unknown Uncertainty: Not reported by the source: not reported for this endpoint Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceTalos monthly reanalysis programme Not reported Aggregation: Not reported Automated reanalysis of genomic data for rare disease diagnostics at scale · Results, Iterative reanalysis, paragraph beginning Twenty-nine cycles |
| Configuration: Talos monthly iterative reanalysis with clinical confirmation | Protocol: Talos programme reanalysis yield Dataset: Talos 4,735 unresolved individuals | 8% Proportion (diagnoses: later cycles) percent · unknown Uncertainty: Not reported by the source: not reported for this endpoint Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceTalos monthly reanalysis programme Not reported Aggregation: Not reported Automated reanalysis of genomic data for rare disease diagnostics at scale · Results, Iterative reanalysis, paragraph beginning Twenty-nine cycles |
| Configuration: Talos monthly iterative reanalysis with clinical confirmation | Protocol: Talos programme reanalysis yield Dataset: Talos 4,735 unresolved individuals | 5 New candidates per 1000 cases per cycle variants-per-1000-cases-per-cycle · unknown Uncertainty: Not reported by the source: not reported for this endpoint Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceTalos monthly reanalysis programme Not reported Aggregation: Not reported Automated reanalysis of genomic data for rare disease diagnostics at scale · Results, Iterative reanalysis, paragraph beginning During iterative reanalysis |
| Configuration: Talos monthly iterative reanalysis with clinical confirmation | Protocol: Talos programme reanalysis yield Dataset: Talos 4,735 unresolved individuals | 241 Count (diagnoses: new confirmed) count · unknown Uncertainty: Not reported by the source: not reported for this endpoint Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceTalos monthly reanalysis programme Not reported Aggregation: Not reported Automated reanalysis of genomic data for rare disease diagnostics at scale · Results, Iterative reanalysis, paragraph beginning Review of Talos output |
| Configuration: Talos monthly iterative reanalysis with clinical confirmation | Protocol: Talos programme reanalysis yield Dataset: Talos 4,735 unresolved individuals | 78 Count (diagnoses: new gene-disease evidence) count · unknown Uncertainty: Not reported by the source: not reported for this endpoint Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceTalos monthly reanalysis programme Not reported Aggregation: Not reported Automated reanalysis of genomic data for rare disease diagnostics at scale · Results, Iterative reanalysis, paragraph beginning More than half |
| Configuration: Talos monthly iterative reanalysis with clinical confirmation | Protocol: Talos programme reanalysis yield Dataset: Talos 4,735 unresolved individuals | 32% Proportion (diagnoses: new gene-disease evidence) percent · unknown Uncertainty: Not reported by the source: not reported for this endpoint Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceTalos monthly reanalysis programme Not reported Aggregation: Not reported Automated reanalysis of genomic data for rare disease diagnostics at scale · Results, Iterative reanalysis, paragraph beginning More than half |
| Configuration: Talos monthly iterative reanalysis with clinical confirmation | Protocol: Talos programme reanalysis yield Dataset: Talos 4,735 unresolved individuals | 54 Count (diagnoses: new variant evidence) count · unknown Uncertainty: Not reported by the source: not reported for this endpoint Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceTalos monthly reanalysis programme Not reported Aggregation: Not reported Automated reanalysis of genomic data for rare disease diagnostics at scale · Results, Iterative reanalysis, paragraph beginning More than half |
| Configuration: Talos monthly iterative reanalysis with clinical confirmation | Protocol: Talos programme reanalysis yield Dataset: Talos 4,735 unresolved individuals | 22% Proportion (diagnoses: new variant evidence) percent · unknown Uncertainty: Not reported by the source: not reported for this endpoint Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceTalos monthly reanalysis programme Not reported Aggregation: Not reported Automated reanalysis of genomic data for rare disease diagnostics at scale · Results, Iterative reanalysis, paragraph beginning More than half |
| Configuration: Talos monthly iterative reanalysis with clinical confirmation | Protocol: Talos programme reanalysis yield Dataset: Talos 4,735 unresolved individuals | 238 Count (newly diagnosed individuals) count · unknown Uncertainty: Not reported by the source: not reported for this endpoint Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceTalos monthly reanalysis programme Not reported Aggregation: Not reported Automated reanalysis of genomic data for rare disease diagnostics at scale · Results, Iterative reanalysis, paragraph beginning Review of Talos output |
| Configuration: Talos default filtering, 2026 study | Protocol: Talos diagnosis recovery and workload: ACG full Dataset: Talos ACG full evaluation cohort | 523 Count (candidate variants flagged) count · unknown Uncertainty: Not reported by the source: not reported for this endpoint Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceNot reported Aggregation: total Talos Table 1: complete evaluation cohort outcomes · Table 1, ACG full, default, Candidate variants |
| Configuration: Talos default filtering, 2026 study | Protocol: Talos diagnosis recovery and workload: ACG full Dataset: Talos ACG full evaluation cohort | 1.3 Candidates per case variants-per-proband · unknown Uncertainty: Not reported by the source: not reported for this endpoint Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceNot reported Aggregation: table ratio Talos Table 1: complete evaluation cohort outcomes · Table 1, ACG full, default, Candidates per proband |
| Configuration: Talos default filtering, 2026 study | Protocol: Talos diagnosis recovery and workload: ACG full Dataset: Talos ACG full evaluation cohort | 2.8 Candidates per diagnosis variants-per-diagnosis · unknown Uncertainty: Not reported by the source: not reported for this endpoint Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceNot reported Aggregation: table ratio Talos Table 1: complete evaluation cohort outcomes · Table 1, ACG full, default, Candidates per diagnoses |
Source checking is not independent reproduction. Release 2026-11-21-c8bea25e5abb.
Methods and evaluation design
Procedure, tasks and evaluated configurations
Evaluation design
Benchmarks bring together tasks and protocols. A task describes the biological question; a protocol defines a particular test.
Protocols
- Exomiser rank-budget recovery in ACG trios
- Talos programme reanalysis yield
- Talos diagnosis recovery and workload: ACG full
- Talos diagnosis recovery and workload: ACG singleton
- Talos diagnosis recovery and workload: ACG trio
- Talos diagnosis recovery and workload: RGP full
- Talos diagnosis recovery and workload: RGP singleton
- Talos diagnosis recovery and workload: RGP trio
These source-backed links do not make different protocols or scores interchangeable.
Baseline coverage
Reference methods help show what a model adds beyond simple controls. We track a null control and a conventional method for each protocol.
0 of 16 active baseline roles have published Rewire measurements in this release. Measurements on a selected protocol do not establish coverage of an entire suite.
Baseline status by linked protocol
- Exomiser rank-budget recovery in ACG trios · 0/2 roles measured
- Talos programme reanalysis yield · 0/2 roles measured
- Talos diagnosis recovery and workload: ACG full · 0/2 roles measured
- Talos diagnosis recovery and workload: ACG singleton · 0/2 roles measured
- Talos diagnosis recovery and workload: ACG trio · 0/2 roles measured
- Talos diagnosis recovery and workload: RGP full · 0/2 roles measured
- Talos diagnosis recovery and workload: RGP singleton · 0/2 roles measured
- Talos diagnosis recovery and workload: RGP trio · 0/2 roles measured
Protocol coverage CSV (gzip) · Model evaluation matrix (gzip) · Source table (gzip) · Release and checksums (gzip)
Coverage is derived from release 2026-11-21-c8bea25e5abb. Source citations describe the original records; they do not validate an unreviewed baseline proposal. No results have been generated by this audit.
Run this benchmark
Choose a concrete protocol before running an evaluation. Its inputs, split and scoring rules determine which results can be compared.
- Exomiser rank-budget recovery in ACG trios
- Talos programme reanalysis yield
- Talos diagnosis recovery and workload: ACG full
- Talos diagnosis recovery and workload: ACG singleton
- Talos diagnosis recovery and workload: ACG trio
- Talos diagnosis recovery and workload: RGP full
- Talos diagnosis recovery and workload: RGP singleton
- Talos diagnosis recovery and workload: RGP trio
Run instructions
No runnable recipe has been reviewed for this benchmark. Dataset access, model requirements, licences and compute requirements must be checked against its sources before execution.
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
0 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|
No evidence rows match these filters. Choose another scope or clear the search.
Sources and history
Release 2026-11-21-c8bea25e5abb · Record review: source checked
2 source records and release history
- Automated reanalysis of genomic data for rare disease diagnostics at scale · Original source · Nature Medicine 2026 final publication, 24 June 2026
- Talos Table 1: complete evaluation cohort outcomes · Original source · Table 1 in final 2026 article
Technical metadata and record identifiers
Technical metadata for this record is tracked under stable ID uc-clinical-20260930-benchmark-talos-study.
Source locator: Table1; Results comparison with other tools and iterative reanalysis
Related records
- part of: Exomiser rank-budget recovery in ACG trios
- part of: Talos programme reanalysis yield
- part of: Talos diagnosis recovery and workload: ACG full
- part of: Talos diagnosis recovery and workload: ACG singleton
- part of: Talos diagnosis recovery and workload: ACG trio
- part of: Talos diagnosis recovery and workload: RGP full
- part of: Talos diagnosis recovery and workload: RGP singleton
- part of: Talos diagnosis recovery and workload: RGP trio