rewirebio.iobenchmarks
Evidence claim

Relevance of Exomiser v14 rank-budget recovery of known diagnoses in ACG trios (Talos 2026) to "Reanalyse unresolved rare-disease cases"

Use case
Reanalyse unresolved rare-disease cases
Assessed by
Exomiser rank-budget recovery in ACG trios
Relevance
Proxy evidence
Endpoint
Known ACG trio diagnoses recovered by Exomiser v14 within all, top 10, top 5 and top 1 ranks, as the comparator to Talos

A ranked-list reanalysis comparator on the same ACG trios shows how many candidates must be reviewed to recover known diagnoses, set against Talos's unranked short list. It is proxy evidence: the diagnoses were known, a rank budget is not measured reviewer effort, and the denominator conflict (194 in the text, 190 in the Extended Data Fig. 1 legend) is unresolved.

1 reviewed evaluation

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

18 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Citation locations
1 values
  • source id
    uc-clinical-20260930-source-talos
    locator
    Results 'Comparison with other tools'; Methods 'Exomiser comparison'; Extended Data Fig. 1 legend
Context-only references
Automated reanalysis of genomic data for rare disease diagnostics at scale

Original source ↗

uc-clinical-20260930-source-talos: Results 'Comparison with other tools'; Methods 'Exomiser comparison'; Extended Data Fig. 1 legend

Version: Nature Medicine 2026 final publication, 24 June 2026
Retrieved: 2026-09-30T21:24:16Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.citation_locators

Source artifact SHA-256: 629b9578ac42717245256feca69dc9c9d5442deb7d282dd1bdc5a6c1a1efd2ec

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Comparison group
talos2026-exomiser-acg
Context-only references
Automated reanalysis of genomic data for rare disease diagnostics at scale

Original source ↗

uc-clinical-20260930-source-talos: Results 'Comparison with other tools'; Methods 'Exomiser comparison'; Extended Data Fig. 1 legend

Version: Nature Medicine 2026 final publication, 24 June 2026
Retrieved: 2026-09-30T21:24:16Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.comparison_group

Source artifact SHA-256: 629b9578ac42717245256feca69dc9c9d5442deb7d282dd1bdc5a6c1a1efd2ec

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Comparison title
Exomiser v14 rank budget on known ACG trio diagnoses (Talos 2026)
Context-only references
Automated reanalysis of genomic data for rare disease diagnostics at scale

Original source ↗

uc-clinical-20260930-source-talos: Results 'Comparison with other tools'; Methods 'Exomiser comparison'; Extended Data Fig. 1 legend

Version: Nature Medicine 2026 final publication, 24 June 2026
Retrieved: 2026-09-30T21:24:16Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.comparison_title

Source artifact SHA-256: 629b9578ac42717245256feca69dc9c9d5442deb7d282dd1bdc5a6c1a1efd2ec

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Constraints
2 values
  • Inspect every linked evaluation's source locator and preserved limitations before citing a result.
  • Do not combine these results with another protocol's results; cohorts, inputs and scoring units differ between sources.
Context-only references
Automated reanalysis of genomic data for rare disease diagnostics at scale

Original source ↗

uc-clinical-20260930-source-talos: Results 'Comparison with other tools'; Methods 'Exomiser comparison'; Extended Data Fig. 1 legend

Version: Nature Medicine 2026 final publication, 24 June 2026
Retrieved: 2026-09-30T21:24:16Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.constraints

Source artifact SHA-256: 629b9578ac42717245256feca69dc9c9d5442deb7d282dd1bdc5a6c1a1efd2ec

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Endpoint
Known ACG trio diagnoses recovered by Exomiser v14 within all, top 10, top 5 and top 1 ranks, as the comparator to Talos
Context-only references
Automated reanalysis of genomic data for rare disease diagnostics at scale

Original source ↗

uc-clinical-20260930-source-talos: Results 'Comparison with other tools'; Methods 'Exomiser comparison'; Extended Data Fig. 1 legend

Version: Nature Medicine 2026 final publication, 24 June 2026
Retrieved: 2026-09-30T21:24:16Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.endpoint

Source artifact SHA-256: 629b9578ac42717245256feca69dc9c9d5442deb7d282dd1bdc5a6c1a1efd2ec

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Claimed field
links:assessed_by:uc-clinical-20260930-exomiser-acg-protocol
Context-only references
Automated reanalysis of genomic data for rare disease diagnostics at scale

Original source ↗

uc-clinical-20260930-source-talos: Results 'Comparison with other tools'; Methods 'Exomiser comparison'; Extended Data Fig. 1 legend

Version: Nature Medicine 2026 final publication, 24 June 2026
Retrieved: 2026-09-30T21:24:16Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.field

Source artifact SHA-256: 629b9578ac42717245256feca69dc9c9d5442deb7d282dd1bdc5a6c1a1efd2ec

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Headline metric
recall
Context-only references
Automated reanalysis of genomic data for rare disease diagnostics at scale

Original source ↗

uc-clinical-20260930-source-talos: Results 'Comparison with other tools'; Methods 'Exomiser comparison'; Extended Data Fig. 1 legend

Version: Nature Medicine 2026 final publication, 24 June 2026
Retrieved: 2026-09-30T21:24:16Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.headline_metric

Source artifact SHA-256: 629b9578ac42717245256feca69dc9c9d5442deb7d282dd1bdc5a6c1a1efd2ec

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Limitations
5 values
  • Recall here is recovery of diagnoses that were already known. It is not new diagnostic yield.
  • The Results text gives 194 trio families with SNV or indel diagnoses, and every printed percentage matches 194 (172/194 = 88.7%, printed 89%; 127/194 = 65.5%, printed 65%). Only the Extended Data Fig. 1 legend gives N = 190, for the paired panels, which are not extracted.
  • Talos Table 1 uses 196 known ACG trio diagnoses of all variant types, so Talos and Exomiser recall have different denominators and sit in separate comparison groups.
  • Exomiser v14 with default configuration; data release, phenotype input and pathogenicity sources not stated.
  • A rank budget (top 1, 5 or 10) is not measured analyst effort.
Context-only references
Automated reanalysis of genomic data for rare disease diagnostics at scale

Original source ↗

uc-clinical-20260930-source-talos: Results 'Comparison with other tools'; Methods 'Exomiser comparison'; Extended Data Fig. 1 legend

Version: Nature Medicine 2026 final publication, 24 June 2026
Retrieved: 2026-09-30T21:24:16Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.limitations

Source artifact SHA-256: 629b9578ac42717245256feca69dc9c9d5442deb7d282dd1bdc5a6c1a1efd2ec

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Pinned records
12 values
  • record id
    uc-clinical-20260930-exomiser-acg-evaluation
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    a0b507a5681c853818c304870863bd062ce3e8ebc9973099cab1daa02b286869
  • record id
    uc-clinical-20260930-exomiser-acg-protocol
    fields
    • status
    • name
    • description
    • facets
    • source_ids
    • links
    • attributes
    sha256
    c5e64ad3ccf51866981f4f5ea0100a923e4d986718560dd24ac9bae3997c8668
  • record id
    uc-clinical-20260930-exomiser-all-count
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    3712aa7628bf47df0707f34ab2e13a0479eb3750e0df72b3880bccd9f64a1c3f
  • record id
    uc-clinical-20260930-exomiser-all-percent
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    6b7de867d5564022be68c4db741ed70c99365d8a68fad244dad54c7dd509b365
  • record id
    uc-clinical-20260930-exomiser-top1-count
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    18c0388c3e0288b2283376d0967d6d9b07fb8d2d031dcef732cbd54229f313fa
  • record id
    uc-clinical-20260930-exomiser-top1-percent
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    758f49479e05f7162070f1556212ed8d23c643858cbda1e032bb67663fa647b7
  • record id
    uc-clinical-20260930-exomiser-top10-count
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    36d4acb9169aae509747568ad78b84309102c81bd3fb084813b4ad068d032613
  • record id
    uc-clinical-20260930-exomiser-top10-percent
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    b2b21db036e212bc5cf3baa7cfeab0de8eecc2304ab5113ae8c33f1e4e46172d
  • record id
    uc-clinical-20260930-exomiser-top5-count
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    84dc4922c6af03bfbf3a7344b2a860c833d386bf5e8381cb76ffd5777f59d7d4
  • record id
    uc-clinical-20260930-exomiser-top5-percent
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    c850ef0636b387de09df465fff8c3bb80aab7304fa38da68d0c4b310fc5fac22
  • record id
    uc-clinical-20260930-source-talos
    fields
    • status
    • attributes.artifact_sha256
    sha256
    90df8425bea523bb170910a4e057d9c3d0132ce74c82212e202b6114f188b4f3
  • record id
    use-case-unresolved-rare-disease-reanalysis
    fields
    • status
    • name
    • description
    • facets
    • attributes.question
    • attributes.decision
    • attributes.inputs
    • attributes.output
    • attributes.exclusions
    • attributes.setting
    • attributes.clinical_scope
    • attributes.intended_users
    sha256
    7a34a11b2cbb377f490c4a4a0cb9bedc53fdc88b132b4c695cdd7b612f97476e
Context-only references
Automated reanalysis of genomic data for rare disease diagnostics at scale

Original source ↗

uc-clinical-20260930-source-talos: Results 'Comparison with other tools'; Methods 'Exomiser comparison'; Extended Data Fig. 1 legend

Version: Nature Medicine 2026 final publication, 24 June 2026
Retrieved: 2026-09-30T21:24:16Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.pins

Source artifact SHA-256: 629b9578ac42717245256feca69dc9c9d5442deb7d282dd1bdc5a6c1a1efd2ec

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Rationale
A ranked-list reanalysis comparator on the same ACG trios shows how many candidates must be reviewed to recover known diagnoses, set against Talos's unranked short list. It is proxy evidence: the diagnoses were known, a rank budget is not measured reviewer effort, and the denominator conflict (194 in the text, 190 in the Extended Data Fig. 1 legend) is unresolved.
Context-only references
Automated reanalysis of genomic data for rare disease diagnostics at scale

Original source ↗

uc-clinical-20260930-source-talos: Results 'Comparison with other tools'; Methods 'Exomiser comparison'; Extended Data Fig. 1 legend

Version: Nature Medicine 2026 final publication, 24 June 2026
Retrieved: 2026-09-30T21:24:16Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.rationale

Source artifact SHA-256: 629b9578ac42717245256feca69dc9c9d5442deb7d282dd1bdc5a6c1a1efd2ec

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: use-case-mapping-rare-reanalysis-20261009-talos2026-exomiser-acg

field
links:assessed_by:uc-clinical-20260930-exomiser-acg-protocol
value
uc-clinical-20260930-exomiser-acg-protocol
relevance
proxy
endpoint
Known ACG trio diagnoses recovered by Exomiser v14 within all, top 10, top 5 and top 1 ranks, as the comparator to Talos
rationale
A ranked-list reanalysis comparator on the same ACG trios shows how many candidates must be reviewed to recover known diagnoses, set against Talos's unranked short list. It is proxy evidence: the diagnoses were known, a rank budget is not measured reviewer effort, and the denominator conflict (194 in the text, 190 in the Extended Data Fig. 1 legend) is unresolved.
constraints
Inspect every linked evaluation's source locator and preserved limitations before citing a result.; Do not combine these results with another protocol's results; cohorts, inputs and scoring units differ between sources.
limitations
Recall here is recovery of diagnoses that were already known. It is not new diagnostic yield.; The Results text gives 194 trio families with SNV or indel diagnoses, and every printed percentage matches 194 (172/194 = 88.7%, printed 89%; 127/194 = 65.5%, printed 65%). Only the Extended Data Fig. 1 legend gives N = 190, for the paired panels, which are not extracted.; Talos Table 1 uses 196 known ACG trio diagnoses of all variant types, so Talos and Exomiser recall have different denominators and sit in separate comparison groups.; Exomiser v14 with default configuration; data release, phenotype input and pathogenicity sources not stated.; A rank budget (top 1, 5 or 10) is not measured analyst effort.
citation locators
source id: uc-clinical-20260930-source-talos; locator: Results 'Comparison with other tools'; Methods 'Exomiser comparison'; Extended Data Fig. 1 legend
source locator
uc-clinical-20260930-source-talos: Results 'Comparison with other tools'; Methods 'Exomiser comparison'; Extended Data Fig. 1 legend
revision
1
reason
Recorded from the rare-disease reanalysis use-case pass 2026-10-09 (data/omics/use-case-coverage-rare-reanalysis-20261009). Independently reviewed 2026-10-09 (docs/reviews/use-cases/unresolved-rare-disease-reanalysis-2026-10-09.md).
comparison group
talos2026-exomiser-acg
comparison title
Exomiser v14 rank budget on known ACG trio diagnoses (Talos 2026)
headline metric
recall
reviewed evaluations
uc-clinical-20260930-exomiser-acg-evaluation
review
method: source-hash-verification; ai-assisted-source-review; method note: Checked the endpoint against the use case's question, inputs, output and exclusions; checked proxy against the relevance definitions; checked the limitations against the source's stated caveats; checked the page grouping (comparison group, stratum order, headline metric) against the source tables. Checked every evaluation on the protocol (listed in reviewed_evaluations); none excluded.; reviewer: claude; reviewer note: Separate Claude review agent, independent of the extractor; no human review claimed; date: 2026-10-09; artifact sha256: 219ba75789e767341d642128750be600433764d5f271db8d7c0ffb5aa6a4d1dd; retrieval url: https://www.ebi.ac.uk/europepmc/webservices/rest/PMC13472938/fullTextXML; note: Proxy relevance confirmed. The 194 versus 190 conflict is narrowed to the Extended Data Fig. 1 legend; no stored result depends on 190. Not human scientific review and not clinical validation. The stored Talos source pins the publisher page; this review compared Table 1 and the Exomiser comparison text with the PMC copy (PMC13472938 full-text XML, SHA-256 219ba75789e767341d642128750be600433764d5f271db8d7c0ffb5aa6a4d1dd), and all 60 Talos Table 1 values and the 8 Exomiser counts and percentages match the stored results.
pins
record id: uc-clinical-20260930-exomiser-acg-evaluation; fields: status; links; attributes.origin; attributes.comparison; sha256: a0b507a5681c853818c304870863bd062ce3e8ebc9973099cab1daa02b286869; record id: uc-clinical-20260930-exomiser-acg-protocol; fields: status; name; description; facets; source_ids; links; attributes; sha256: c5e64ad3ccf51866981f4f5ea0100a923e4d986718560dd24ac9bae3997c8668; record id: uc-clinical-20260930-exomiser-all-count; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 3712aa7628bf47df0707f34ab2e13a0479eb3750e0df72b3880bccd9f64a1c3f; record id: uc-clinical-20260930-exomiser-all-percent; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 6b7de867d5564022be68c4db741ed70c99365d8a68fad244dad54c7dd509b365; record id: uc-clinical-20260930-exomiser-top1-count; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 18c0388c3e0288b2283376d0967d6d9b07fb8d2d031dcef732cbd54229f313fa; record id: uc-clinical-20260930-exomiser-top1-percent; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 758f49479e05f7162070f1556212ed8d23c643858cbda1e032bb67663fa647b7; record id: uc-clinical-20260930-exomiser-top10-count; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 36d4acb9169aae509747568ad78b84309102c81bd3fb084813b4ad068d032613; record id: uc-clinical-20260930-exomiser-top10-percent; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: b2b21db036e212bc5cf3baa7cfeab0de8eecc2304ab5113ae8c33f1e4e46172d; record id: uc-clinical-20260930-exomiser-top5-count; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 84dc4922c6af03bfbf3a7344b2a860c833d386bf5e8381cb76ffd5777f59d7d4; record id: uc-clinical-20260930-exomiser-top5-percent; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: c850ef0636b387de09df465fff8c3bb80aab7304fa38da68d0c4b310fc5fac22; record id: uc-clinical-20260930-source-talos; fields: status; attributes.artifact_sha256; sha256: 90df8425bea523bb170910a4e057d9c3d0132ce74c82212e202b6114f188b4f3; record id: use-case-unresolved-rare-disease-reanalysis; fields: status; name; description; facets; attributes.question; attributes.decision; attributes.inputs; attributes.output; attributes.exclusions; attributes.setting; attributes.clinical_scope; attributes.intended_users; sha256: 7a34a11b2cbb377f490c4a4a0cb9bedc53fdc88b132b4c695cdd7b612f97476e
Related records

Suggest a correction