rewirebio.iobenchmarks
Evidence claim

Relevance of HECTOR vs. ENIGMA Evidence Repository (eRepo) agreement to "Interpret BRCA1/BRCA2 germline variants"

Use case
Interpret BRCA1/BRCA2 germline variants
Assessed by
HECTOR vs. ENIGMA Evidence Repository (eRepo) agreement
Relevance
Proxy evidence
Endpoint
Classification-level and evidence-code-level agreement between the HECTOR automated classifier and the ENIGMA VCEP's expert-curated calls on the 143-variant ClinGen Evidence Repository (eRepo) reference set

An unreviewed preprint's measured agreement between an automated classifier and ClinGen eRepo expert-panel submissions; this is agreement with eRepo submissions, not independent accuracy, and the result is not peer reviewed.

1 reviewed evaluation

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

15 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Citation locations
1 values
  • source id
    uc-clinical-20261005-source-hector-preprint
    locator
    Results, Evidence Repository
Context-only references
HECTOR: A Web-Based Tool for Automated BRCA1/BRCA2 Variant Classification Under the ClinGen ENIGMA Specifications

Original source ↗

uc-clinical-20261005-source-hector-preprint: Results, Evidence Repository

Version: medRxiv preprint v1, posted 2026-07-06
Retrieved: 2026-10-05T13:55:48Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.citation_locators

Source artifact SHA-256: 9e32765476c5d6c61fcb408420916c712890bec3fb1e672f58bedca69142abc0

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Constraints
2 values
  • medRxiv preprint v1, posted 2026-07-06; not peer reviewed.
  • 143-variant ENIGMA Evidence Repository reference set; 413 evidence codes.
Context-only references
HECTOR: A Web-Based Tool for Automated BRCA1/BRCA2 Variant Classification Under the ClinGen ENIGMA Specifications

Original source ↗

uc-clinical-20261005-source-hector-preprint: Results, Evidence Repository

Version: medRxiv preprint v1, posted 2026-07-06
Retrieved: 2026-10-05T13:55:48Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.constraints

Source artifact SHA-256: 9e32765476c5d6c61fcb408420916c712890bec3fb1e672f58bedca69142abc0

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Endpoint
Classification-level and evidence-code-level agreement between the HECTOR automated classifier and the ENIGMA VCEP's expert-curated calls on the 143-variant ClinGen Evidence Repository (eRepo) reference set
Context-only references
HECTOR: A Web-Based Tool for Automated BRCA1/BRCA2 Variant Classification Under the ClinGen ENIGMA Specifications

Original source ↗

uc-clinical-20261005-source-hector-preprint: Results, Evidence Repository

Version: medRxiv preprint v1, posted 2026-07-06
Retrieved: 2026-10-05T13:55:48Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.endpoint

Source artifact SHA-256: 9e32765476c5d6c61fcb408420916c712890bec3fb1e672f58bedca69142abc0

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Claimed field
links:assessed_by:uc-clinical-20261005-hector-erepo-protocol
Context-only references
HECTOR: A Web-Based Tool for Automated BRCA1/BRCA2 Variant Classification Under the ClinGen ENIGMA Specifications

Original source ↗

uc-clinical-20261005-source-hector-preprint: Results, Evidence Repository

Version: medRxiv preprint v1, posted 2026-07-06
Retrieved: 2026-10-05T13:55:48Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.field

Source artifact SHA-256: 9e32765476c5d6c61fcb408420916c712890bec3fb1e672f58bedca69142abc0

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Limitations
3 values
  • Unreviewed preprint: agreement with the ENIGMA VCEP's expert-curated classifications and evidence-code assignments in the ClinGen Evidence Repository (eRepo), not independent accuracy against separately adjudicated ground truth.
  • Not peer reviewed; no independent adjudication of either the automated classifier's or the expert panel's calls.
  • No reviewer time measured.
Context-only references
HECTOR: A Web-Based Tool for Automated BRCA1/BRCA2 Variant Classification Under the ClinGen ENIGMA Specifications

Original source ↗

uc-clinical-20261005-source-hector-preprint: Results, Evidence Repository

Version: medRxiv preprint v1, posted 2026-07-06
Retrieved: 2026-10-05T13:55:48Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.limitations

Source artifact SHA-256: 9e32765476c5d6c61fcb408420916c712890bec3fb1e672f58bedca69142abc0

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Pinned records
6 values
  • record id
    uc-clinical-20261005-hector-erepo-classification-agreement
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    1bdd8652e6332aa5ea6fcc6332463d782df21579cdde01207e8dd250b9ae60b1
  • record id
    uc-clinical-20261005-hector-erepo-criteria-agreement
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    6910267894808a2650b10e53c7558f0d5fdca4201800930d1fbdd95dc4f0e05d
  • record id
    uc-clinical-20261005-hector-erepo-evaluation
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    9e338fe46889a4a890f7244b903742da928545d369df0a17cc07cd96960cd2de
  • record id
    uc-clinical-20261005-hector-erepo-protocol
    fields
    • status
    • name
    • description
    • facets
    • source_ids
    • links
    • attributes
    sha256
    6b6407339a3e0cfc814bef7922959a5432292d54fe1a81a1c59af30beccaf523
  • record id
    uc-clinical-20261005-source-hector-preprint
    fields
    • status
    • attributes.artifact_sha256
    sha256
    925ab27f63678b217dd3a8f66423aa0e5f5ee8744cf814eb95c2c544e6b4a62b
  • record id
    use-case-brca1-brca2-germline-interpretation
    fields
    • status
    • name
    • description
    • facets
    • attributes.question
    • attributes.decision
    • attributes.inputs
    • attributes.output
    • attributes.exclusions
    • attributes.setting
    • attributes.clinical_scope
    • attributes.intended_users
    sha256
    9681ae92e727dde7a801aec8d4884ec28b009d134a52d806a266f7d3b64bd5bd
Context-only references
HECTOR: A Web-Based Tool for Automated BRCA1/BRCA2 Variant Classification Under the ClinGen ENIGMA Specifications

Original source ↗

uc-clinical-20261005-source-hector-preprint: Results, Evidence Repository

Version: medRxiv preprint v1, posted 2026-07-06
Retrieved: 2026-10-05T13:55:48Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.pins

Source artifact SHA-256: 9e32765476c5d6c61fcb408420916c712890bec3fb1e672f58bedca69142abc0

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Rationale
An unreviewed preprint's measured agreement between an automated classifier and ClinGen eRepo expert-panel submissions; this is agreement with eRepo submissions, not independent accuracy, and the result is not peer reviewed.
Context-only references
HECTOR: A Web-Based Tool for Automated BRCA1/BRCA2 Variant Classification Under the ClinGen ENIGMA Specifications

Original source ↗

uc-clinical-20261005-source-hector-preprint: Results, Evidence Repository

Version: medRxiv preprint v1, posted 2026-07-06
Retrieved: 2026-10-05T13:55:48Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.rationale

Source artifact SHA-256: 9e32765476c5d6c61fcb408420916c712890bec3fb1e672f58bedca69142abc0

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Reason
Add independently checked primary-source protocol evidence from the additive 2026-10-05 BRCA1/BRCA2 evidence intake (issue #343); scope the endpoint to agreement with eRepo submissions from an unreviewed preprint, not independent accuracy. Corrected 2026-10-06: the comparator was re-verified live against the preprint and relabelled from "ClinVar expert-panel" to the ENIGMA VCEP's expert-curated classifications and evidence-code assignments in the ClinGen Evidence Repository (eRepo); the 108/143 and 326/413 figures are unchanged.
Context-only references
HECTOR: A Web-Based Tool for Automated BRCA1/BRCA2 Variant Classification Under the ClinGen ENIGMA Specifications

Original source ↗

uc-clinical-20261005-source-hector-preprint: Results, Evidence Repository

Version: medRxiv preprint v1, posted 2026-07-06
Retrieved: 2026-10-05T13:55:48Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.reason

Source artifact SHA-256: 9e32765476c5d6c61fcb408420916c712890bec3fb1e672f58bedca69142abc0

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Relevance
proxy
Context-only references
HECTOR: A Web-Based Tool for Automated BRCA1/BRCA2 Variant Classification Under the ClinGen ENIGMA Specifications

Original source ↗

uc-clinical-20261005-source-hector-preprint: Results, Evidence Repository

Version: medRxiv preprint v1, posted 2026-07-06
Retrieved: 2026-10-05T13:55:48Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.relevance

Source artifact SHA-256: 9e32765476c5d6c61fcb408420916c712890bec3fb1e672f58bedca69142abc0

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Revision
1
Context-only references
HECTOR: A Web-Based Tool for Automated BRCA1/BRCA2 Variant Classification Under the ClinGen ENIGMA Specifications

Original source ↗

uc-clinical-20261005-source-hector-preprint: Results, Evidence Repository

Version: medRxiv preprint v1, posted 2026-07-06
Retrieved: 2026-10-05T13:55:48Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.revision

Source artifact SHA-256: 9e32765476c5d6c61fcb408420916c712890bec3fb1e672f58bedca69142abc0

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: use-case-mapping-20261005-343-9a16ffea921e

field
links:assessed_by:uc-clinical-20261005-hector-erepo-protocol
value
uc-clinical-20261005-hector-erepo-protocol
relevance
proxy
endpoint
Classification-level and evidence-code-level agreement between the HECTOR automated classifier and the ENIGMA VCEP's expert-curated calls on the 143-variant ClinGen Evidence Repository (eRepo) reference set
rationale
An unreviewed preprint's measured agreement between an automated classifier and ClinGen eRepo expert-panel submissions; this is agreement with eRepo submissions, not independent accuracy, and the result is not peer reviewed.
constraints
medRxiv preprint v1, posted 2026-07-06; not peer reviewed.; 143-variant ENIGMA Evidence Repository reference set; 413 evidence codes.
limitations
Unreviewed preprint: agreement with the ENIGMA VCEP's expert-curated classifications and evidence-code assignments in the ClinGen Evidence Repository (eRepo), not independent accuracy against separately adjudicated ground truth.; Not peer reviewed; no independent adjudication of either the automated classifier's or the expert panel's calls.; No reviewer time measured.
revision
1
reason
Add independently checked primary-source protocol evidence from the additive 2026-10-05 BRCA1/BRCA2 evidence intake (issue #343); scope the endpoint to agreement with eRepo submissions from an unreviewed preprint, not independent accuracy. Corrected 2026-10-06: the comparator was re-verified live against the preprint and relabelled from "ClinVar expert-panel" to the ENIGMA VCEP's expert-curated classifications and evidence-code assignments in the ClinGen Evidence Repository (eRepo); the 108/143 and 326/413 figures are unchanged.
citation locators
source id: uc-clinical-20261005-source-hector-preprint; locator: Results, Evidence Repository
source locator
uc-clinical-20261005-source-hector-preprint: Results, Evidence Repository
review
method: automated-source-review; reviewer: claude-sonnet; reviewer note: Claude Sonnet clinical coverage worker (research-evidence intake), root integration review; reviewed at: 2026-10-06T09:38:06.000Z; note: Source-backed literature curation with independent automated transcription and scope checks against the additive 2026-10-05 BRCA1/BRCA2 evidence intake (issue #343). No new model execution, independent experimental replication, qualified human scientific review or clinical validation. Corrected 2026-10-06: re-verified live against the preprint full text and relabelled the eRepo comparator; evidence_sha256 refreshed to match the corrected protocol and result records.
reviewed evaluations
uc-clinical-20261005-hector-erepo-evaluation
pins
record id: uc-clinical-20261005-hector-erepo-classification-agreement; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 1bdd8652e6332aa5ea6fcc6332463d782df21579cdde01207e8dd250b9ae60b1; record id: uc-clinical-20261005-hector-erepo-criteria-agreement; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 6910267894808a2650b10e53c7558f0d5fdca4201800930d1fbdd95dc4f0e05d; record id: uc-clinical-20261005-hector-erepo-evaluation; fields: status; links; attributes.origin; attributes.comparison; sha256: 9e338fe46889a4a890f7244b903742da928545d369df0a17cc07cd96960cd2de; record id: uc-clinical-20261005-hector-erepo-protocol; fields: status; name; description; facets; source_ids; links; attributes; sha256: 6b6407339a3e0cfc814bef7922959a5432292d54fe1a81a1c59af30beccaf523; record id: uc-clinical-20261005-source-hector-preprint; fields: status; attributes.artifact_sha256; sha256: 925ab27f63678b217dd3a8f66423aa0e5f5ee8744cf814eb95c2c544e6b4a62b; record id: use-case-brca1-brca2-germline-interpretation; fields: status; name; description; facets; attributes.question; attributes.decision; attributes.inputs; attributes.output; attributes.exclusions; attributes.setting; attributes.clinical_scope; attributes.intended_users; sha256: 9681ae92e727dde7a801aec8d4884ec28b009d134a52d806a266f7d3b64bd5bd
Related records

Suggest a correction