rewirebio.iobenchmarks
Evidence claim

Relevance of So 2024 VarSome-vs-CanVIG-UK agreement on conflicting BRCA1 missense variants to "Interpret BRCA1/BRCA2 germline variants"

Use case
Interpret BRCA1/BRCA2 germline variants
Assessed by
So 2024 VarSome-vs-CanVIG-UK agreement on conflicting BRCA1 missense variants
Relevance
Proxy evidence
Endpoint
Tool-vs-tool concordance between VarSome and the CanVIG-UK BRCA1/BRCA2 gene-specific guidance, each consolidated to a three-category scheme, on 450 BRCA1 missense variants with conflicting ClinVar interpretations

Measures agreement between two interpretation tools on a conflicting-classification subset; this is tool-vs-tool agreement on disputed BRCA1 missense variants, not accuracy against independent ground truth.

1 reviewed evaluation

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

15 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Citation locations
1 values
  • source id
    uc-clinical-20261005-source-so-2024
    locator
    Results, Section 3.3, Comparison of Classification Results Between Varsome and CanVIG-UK
Context-only references
Reinterpretation of Conflicting ClinVar BRCA1 Missense Variants Using VarSome and CanVIG-UK Gene-Specific Guidance

Original source ↗

uc-clinical-20261005-source-so-2024: Results, Section 3.3, Comparison of Classification Results Between Varsome and CanVIG-UK

Version: 2024 published article (Diagnostics (Basel)); CanVIG-UK gene-specific guidance v1.17 / consensus specification v2.17 applied
Retrieved: 2026-10-05T14:02:27Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.citation_locators

Source artifact SHA-256: 1c38f665dab61743881dcb40302e0e5e0583aa72e106c95a3939a21d6213beda

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Constraints
1 values
  • 450 BRCA1 missense variants with conflicting ClinVar interpretations as of 20 December 2022.
Context-only references
Reinterpretation of Conflicting ClinVar BRCA1 Missense Variants Using VarSome and CanVIG-UK Gene-Specific Guidance

Original source ↗

uc-clinical-20261005-source-so-2024: Results, Section 3.3, Comparison of Classification Results Between Varsome and CanVIG-UK

Version: 2024 published article (Diagnostics (Basel)); CanVIG-UK gene-specific guidance v1.17 / consensus specification v2.17 applied
Retrieved: 2026-10-05T14:02:27Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.constraints

Source artifact SHA-256: 1c38f665dab61743881dcb40302e0e5e0583aa72e106c95a3939a21d6213beda

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Endpoint
Tool-vs-tool concordance between VarSome and the CanVIG-UK BRCA1/BRCA2 gene-specific guidance, each consolidated to a three-category scheme, on 450 BRCA1 missense variants with conflicting ClinVar interpretations
Context-only references
Reinterpretation of Conflicting ClinVar BRCA1 Missense Variants Using VarSome and CanVIG-UK Gene-Specific Guidance

Original source ↗

uc-clinical-20261005-source-so-2024: Results, Section 3.3, Comparison of Classification Results Between Varsome and CanVIG-UK

Version: 2024 published article (Diagnostics (Basel)); CanVIG-UK gene-specific guidance v1.17 / consensus specification v2.17 applied
Retrieved: 2026-10-05T14:02:27Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.endpoint

Source artifact SHA-256: 1c38f665dab61743881dcb40302e0e5e0583aa72e106c95a3939a21d6213beda

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Claimed field
links:assessed_by:uc-clinical-20261005-so-2024-protocol
Context-only references
Reinterpretation of Conflicting ClinVar BRCA1 Missense Variants Using VarSome and CanVIG-UK Gene-Specific Guidance

Original source ↗

uc-clinical-20261005-source-so-2024: Results, Section 3.3, Comparison of Classification Results Between Varsome and CanVIG-UK

Version: 2024 published article (Diagnostics (Basel)); CanVIG-UK gene-specific guidance v1.17 / consensus specification v2.17 applied
Retrieved: 2026-10-05T14:02:27Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.field

Source artifact SHA-256: 1c38f665dab61743881dcb40302e0e5e0583aa72e106c95a3939a21d6213beda

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Limitations
3 values
  • Tool-vs-tool agreement on conflicting-classification variants, not accuracy against independent ground truth.
  • The source's ground-truth-anchored comparator covers only 17/450 (3.8%) of variants and is not used in this mapping.
  • No reviewer time or serious-error adjudication reported.
Context-only references
Reinterpretation of Conflicting ClinVar BRCA1 Missense Variants Using VarSome and CanVIG-UK Gene-Specific Guidance

Original source ↗

uc-clinical-20261005-source-so-2024: Results, Section 3.3, Comparison of Classification Results Between Varsome and CanVIG-UK

Version: 2024 published article (Diagnostics (Basel)); CanVIG-UK gene-specific guidance v1.17 / consensus specification v2.17 applied
Retrieved: 2026-10-05T14:02:27Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.limitations

Source artifact SHA-256: 1c38f665dab61743881dcb40302e0e5e0583aa72e106c95a3939a21d6213beda

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Pinned records
6 values
  • record id
    uc-clinical-20261005-so-2024-concordance-rate
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    354577d98401406c7ac887dc7812efa8cd61091c34de5b692bcfa7b262d7cd2f
  • record id
    uc-clinical-20261005-so-2024-concordant-count
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    4236f2636ed5da1350b89dc7b821fb4a5c65865ebd427ea771cded9e2c715ea9
  • record id
    uc-clinical-20261005-so-2024-evaluation
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    d518be73e4b3ea5c85152bdca51dbea80fa27dca49aaba974c6b0dbe45289991
  • record id
    uc-clinical-20261005-so-2024-protocol
    fields
    • status
    • name
    • description
    • facets
    • source_ids
    • links
    • attributes
    sha256
    c443b9cd6fc25f2939772a45878da344928e91a8d301e199dcaf616e8534f487
  • record id
    uc-clinical-20261005-source-so-2024
    fields
    • status
    • attributes.artifact_sha256
    sha256
    99e23ac5df4df3e92d1f76f7aa908b8e3fd695aa63d68652f34ac94cd069a410
  • record id
    use-case-brca1-brca2-germline-interpretation
    fields
    • status
    • name
    • description
    • facets
    • attributes.question
    • attributes.decision
    • attributes.inputs
    • attributes.output
    • attributes.exclusions
    • attributes.setting
    • attributes.clinical_scope
    • attributes.intended_users
    sha256
    9681ae92e727dde7a801aec8d4884ec28b009d134a52d806a266f7d3b64bd5bd
Context-only references
Reinterpretation of Conflicting ClinVar BRCA1 Missense Variants Using VarSome and CanVIG-UK Gene-Specific Guidance

Original source ↗

uc-clinical-20261005-source-so-2024: Results, Section 3.3, Comparison of Classification Results Between Varsome and CanVIG-UK

Version: 2024 published article (Diagnostics (Basel)); CanVIG-UK gene-specific guidance v1.17 / consensus specification v2.17 applied
Retrieved: 2026-10-05T14:02:27Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.pins

Source artifact SHA-256: 1c38f665dab61743881dcb40302e0e5e0583aa72e106c95a3939a21d6213beda

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Rationale
Measures agreement between two interpretation tools on a conflicting-classification subset; this is tool-vs-tool agreement on disputed BRCA1 missense variants, not accuracy against independent ground truth.
Context-only references
Reinterpretation of Conflicting ClinVar BRCA1 Missense Variants Using VarSome and CanVIG-UK Gene-Specific Guidance

Original source ↗

uc-clinical-20261005-source-so-2024: Results, Section 3.3, Comparison of Classification Results Between Varsome and CanVIG-UK

Version: 2024 published article (Diagnostics (Basel)); CanVIG-UK gene-specific guidance v1.17 / consensus specification v2.17 applied
Retrieved: 2026-10-05T14:02:27Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.rationale

Source artifact SHA-256: 1c38f665dab61743881dcb40302e0e5e0583aa72e106c95a3939a21d6213beda

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Reason
Add independently checked primary-source protocol evidence from the additive 2026-10-05 BRCA1/BRCA2 evidence intake (issue #343); scope the endpoint to tool-vs-tool agreement on conflicting BRCA1 missense variants, not accuracy.
Context-only references
Reinterpretation of Conflicting ClinVar BRCA1 Missense Variants Using VarSome and CanVIG-UK Gene-Specific Guidance

Original source ↗

uc-clinical-20261005-source-so-2024: Results, Section 3.3, Comparison of Classification Results Between Varsome and CanVIG-UK

Version: 2024 published article (Diagnostics (Basel)); CanVIG-UK gene-specific guidance v1.17 / consensus specification v2.17 applied
Retrieved: 2026-10-05T14:02:27Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.reason

Source artifact SHA-256: 1c38f665dab61743881dcb40302e0e5e0583aa72e106c95a3939a21d6213beda

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Relevance
proxy
Context-only references
Reinterpretation of Conflicting ClinVar BRCA1 Missense Variants Using VarSome and CanVIG-UK Gene-Specific Guidance

Original source ↗

uc-clinical-20261005-source-so-2024: Results, Section 3.3, Comparison of Classification Results Between Varsome and CanVIG-UK

Version: 2024 published article (Diagnostics (Basel)); CanVIG-UK gene-specific guidance v1.17 / consensus specification v2.17 applied
Retrieved: 2026-10-05T14:02:27Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.relevance

Source artifact SHA-256: 1c38f665dab61743881dcb40302e0e5e0583aa72e106c95a3939a21d6213beda

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Revision
1
Context-only references
Reinterpretation of Conflicting ClinVar BRCA1 Missense Variants Using VarSome and CanVIG-UK Gene-Specific Guidance

Original source ↗

uc-clinical-20261005-source-so-2024: Results, Section 3.3, Comparison of Classification Results Between Varsome and CanVIG-UK

Version: 2024 published article (Diagnostics (Basel)); CanVIG-UK gene-specific guidance v1.17 / consensus specification v2.17 applied
Retrieved: 2026-10-05T14:02:27Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.revision

Source artifact SHA-256: 1c38f665dab61743881dcb40302e0e5e0583aa72e106c95a3939a21d6213beda

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: use-case-mapping-20261005-343-1d76c37513fa

field
links:assessed_by:uc-clinical-20261005-so-2024-protocol
value
uc-clinical-20261005-so-2024-protocol
relevance
proxy
endpoint
Tool-vs-tool concordance between VarSome and the CanVIG-UK BRCA1/BRCA2 gene-specific guidance, each consolidated to a three-category scheme, on 450 BRCA1 missense variants with conflicting ClinVar interpretations
rationale
Measures agreement between two interpretation tools on a conflicting-classification subset; this is tool-vs-tool agreement on disputed BRCA1 missense variants, not accuracy against independent ground truth.
constraints
450 BRCA1 missense variants with conflicting ClinVar interpretations as of 20 December 2022.
limitations
Tool-vs-tool agreement on conflicting-classification variants, not accuracy against independent ground truth.; The source's ground-truth-anchored comparator covers only 17/450 (3.8%) of variants and is not used in this mapping.; No reviewer time or serious-error adjudication reported.
revision
1
reason
Add independently checked primary-source protocol evidence from the additive 2026-10-05 BRCA1/BRCA2 evidence intake (issue #343); scope the endpoint to tool-vs-tool agreement on conflicting BRCA1 missense variants, not accuracy.
citation locators
source id: uc-clinical-20261005-source-so-2024; locator: Results, Section 3.3, Comparison of Classification Results Between Varsome and CanVIG-UK
source locator
uc-clinical-20261005-source-so-2024: Results, Section 3.3, Comparison of Classification Results Between Varsome and CanVIG-UK
review
method: automated-source-review; reviewer: claude-sonnet; reviewer note: Claude Sonnet clinical coverage worker (research-evidence intake), root integration review; reviewed at: 2026-10-05T17:39:47.679Z; note: Source-backed literature curation with independent automated transcription and scope checks against the additive 2026-10-05 BRCA1/BRCA2 evidence intake (issue #343). No new model execution, independent experimental replication, qualified human scientific review or clinical validation.
reviewed evaluations
uc-clinical-20261005-so-2024-evaluation
pins
record id: uc-clinical-20261005-so-2024-concordance-rate; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 354577d98401406c7ac887dc7812efa8cd61091c34de5b692bcfa7b262d7cd2f; record id: uc-clinical-20261005-so-2024-concordant-count; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 4236f2636ed5da1350b89dc7b821fb4a5c65865ebd427ea771cded9e2c715ea9; record id: uc-clinical-20261005-so-2024-evaluation; fields: status; links; attributes.origin; attributes.comparison; sha256: d518be73e4b3ea5c85152bdca51dbea80fa27dca49aaba974c6b0dbe45289991; record id: uc-clinical-20261005-so-2024-protocol; fields: status; name; description; facets; source_ids; links; attributes; sha256: c443b9cd6fc25f2939772a45878da344928e91a8d301e199dcaf616e8534f487; record id: uc-clinical-20261005-source-so-2024; fields: status; attributes.artifact_sha256; sha256: 99e23ac5df4df3e92d1f76f7aa908b8e3fd695aa63d68652f34ac94cd069a410; record id: use-case-brca1-brca2-germline-interpretation; fields: status; name; description; facets; attributes.question; attributes.decision; attributes.inputs; attributes.output; attributes.exclusions; attributes.setting; attributes.clinical_scope; attributes.intended_users; sha256: 9681ae92e727dde7a801aec8d4884ec28b009d134a52d806a266f7d3b64bd5bd
Related records

Suggest a correction