rewirebio.iobenchmarks
Evidence claim

Relevance of Feng pathogenic-versus-common SNP classification to "Rank rare-disease variants for review"

Use case
Rank rare-disease variants for review
Assessed by
Feng pathogenic-versus-common SNP classification
Relevance
Proxy evidence
Endpoint
Pathogenic-versus-common SNP discrimination (AUC, Cohen's d) for eleven DNA foundation-model/genomic-comparator configurations, across separate short- and long-window scored populations

Genome-wide pathogenic-versus-common SNP discrimination is a proxy for rare-disease candidate variant ranking; it is not disease-specific (no BRCA subgroup claim) and is not a complete clinical classification.

11 reviewed evaluations

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

16 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Citation locations
1 values
  • source id
    evidence-expansion-dna-foundation-models-2025-5d8ca9bc
    locator
    See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.citation_locators

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Constraints
2 values
  • Inspect every linked evaluation's source locator and preserved conflicts before citing a result.
  • Do not combine this mapping's evaluations with any other protocol's results.
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.constraints

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Endpoint
Pathogenic-versus-common SNP discrimination (AUC, Cohen's d) for eleven DNA foundation-model/genomic-comparator configurations, across separate short- and long-window scored populations
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.endpoint

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Excluded evaluations
11 values
  • id
    feng-dna-fm-20261014-eval-sd4-pathogenic-common-caduceus-ph
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-pathogenic-common-caduceus-ph-long-sequence
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-pathogenic-common-dnabert-2
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-pathogenic-common-enformer-hidden-states
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-pathogenic-common-enformer-output-tracks
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-pathogenic-common-grover
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-pathogenic-common-hyenadna
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-pathogenic-common-hyenadna-450k-long-sequence
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-pathogenic-common-nt-v2
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-pathogenic-common-sei-hidden-states
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-pathogenic-common-sei-output-tracks
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.excluded_evaluations

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Claimed field
links:assessed_by:amp-feng-20261007-protocol-pathogenic-common-variant-classification
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.field

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Limitations
5 values
  • No disease-specific (e.g. BRCA) subgroup claim is supported by this table.
  • Short-window and long-window populations are separate and must not be pooled; each configuration/dataset records its exact assignment.
  • Sei, Enformer (hidden/output tracks) are non-DNA-foundation specialised genomic comparators per the source's own asterisk notation, not DNA foundation models.
  • Supplementary Data 4 gives each configuration's AUC on each of the three held-out chromosome groups. These are stored as separate per-group evaluations and excluded here, so each configuration is shown once, at the three-group mean the paper reports. The three group AUCs differ by 0.0014 to 0.057 within a configuration, and NT-v2 has the highest AUC in every group (0.7312, 0.7318, 0.7326).
  • No independent reproduction or qualified human scientific review.
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.limitations

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Pinned records
36 values
  • record id
    amp-feng-20261007-eval-variant-caduceus-ph
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    bf43dc32396f10deb97b069cc721ef9e18916f16bae17423e7d02fe97c92d393
  • record id
    amp-feng-20261007-eval-variant-caduceus-ph-long-sequence
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    6b4e220f0ac057244ecdc60ee3dcb3c1fe3b92c0d3571ccbea1e3331ce86345b
  • record id
    amp-feng-20261007-eval-variant-dnabert-2
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    f6188116d0edcfaaaaac00ec9e66f865bb393edb13e0673803cdf8c99c565ab1
  • record id
    amp-feng-20261007-eval-variant-enformer-hidden-states
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    d69305099989333751ab6451c8b2ac8e648e7061bf3f5deb3312d8d256d2258b
  • record id
    amp-feng-20261007-eval-variant-enformer-output-tracks
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    d3d3e31c2ef0f1388464850f121c67b058cac001eba4501e24c716f93add528d
  • record id
    amp-feng-20261007-eval-variant-grover
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    fe1e469b1456c9e1a6c6349eb14254025612d76c5f4ca889c03d08b439ee8617
  • record id
    amp-feng-20261007-eval-variant-hyenadna
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    448aa09fcb6c2656ff14527c1a2adc4ea40d4543b2855a47ae74892d06e5d4e4
  • record id
    amp-feng-20261007-eval-variant-hyenadna-450k-long-sequence
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    6bf644b0f6a72380298865cf0ffc22df0ce7ef4b350f48c83e24151c34da8ce4
  • record id
    amp-feng-20261007-eval-variant-nt-v2
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    a0ed36bfa70ae6eaa24329915d0d85e6aa898284268c6a55745c07436612c11f
  • record id
    amp-feng-20261007-eval-variant-sei-hidden-states
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    9fd355cb22d48a75ae4230d31d1fb218600494687bbfe79effc58f7c9642eac0
  • record id
    amp-feng-20261007-eval-variant-sei-output-tracks
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    b9879a76414913ae8c4c7595e9ac2af3e251e1f26cf171acfe6bfb0b1032842a
  • record id
    amp-feng-20261007-protocol-pathogenic-common-variant-classification
    fields
    • status
    • name
    • description
    • facets
    • source_ids
    • links
    • attributes
    sha256
    026fc6a39028dda9cff55ee312569b6c165bc4d5c17a98f810bf9dc9f10efa01
  • record id
    amp-feng-20261007-result-variant-caduceus-ph-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    95fd3c3494dfb24b05af4178304034d3cd925d43a1226dbc20aede177ccb11eb
  • record id
    amp-feng-20261007-result-variant-caduceus-ph-cohend
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    d8e669fe7df5bee4e24d4f647ad80b000685716df5f23e17293ac82b7967b7e1
  • record id
    amp-feng-20261007-result-variant-caduceus-ph-long-sequence-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    3956e1813685e52f063ecc86fb2f20013bbd71f05aa2b9f501f6e4b6ba39eb8c
  • record id
    amp-feng-20261007-result-variant-caduceus-ph-long-sequence-cohend
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    69891e4eeb9c79f920cd32b90ab9f48e4b7bfc62666b114172afdd00fb312ba5
  • record id
    amp-feng-20261007-result-variant-dnabert-2-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    5e2e0b24f01aaa5a5cd215332d7f02f3e77f236b792f6a403f16ef5389260d65
  • record id
    amp-feng-20261007-result-variant-dnabert-2-cohend
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    4d6a160b236343b87574855d0de726dfe938e2ef636388940acd990e5346ccc3
  • record id
    amp-feng-20261007-result-variant-enformer-hidden-states-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    4bbe4c7fec47d123c7f38c8b0671862f2451ddf4da866ec6ef58697fb76771bd
  • record id
    amp-feng-20261007-result-variant-enformer-hidden-states-cohend
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    b510d892aa2c85b5add3d151787f529ac92559cfbd30b2b9c664d8c530420312
  • record id
    amp-feng-20261007-result-variant-enformer-output-tracks-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    3a86a27dd71084819be16e871d1a7aae7566f572681ef041faac85ccf0204ca1
  • record id
    amp-feng-20261007-result-variant-enformer-output-tracks-cohend
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    c1e09680b4940ea95bb822cb6f5e60d1879d8719665cf906ef3f8a0b3d77a75d
  • record id
    amp-feng-20261007-result-variant-grover-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    006aa4e11c15e17fcc5df953fb7ab261e396cb5dafb801a157772dcee039451d
  • record id
    amp-feng-20261007-result-variant-grover-cohend
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    1d7337d96e26c0dde1a8262e219388a15e410f2e25b2aadb42b6ee2abe911fe3
  • record id
    amp-feng-20261007-result-variant-hyenadna-450k-long-sequence-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    df25b4211fa62eb75caa2acfd9322748c4f80f2d104b6129e8d6329f9a330e4d
  • record id
    amp-feng-20261007-result-variant-hyenadna-450k-long-sequence-cohend
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    39a4b127b1e470f5f6e853cee1b5fd063f9d8c5654cd598da38b1500b1da7bf7
  • record id
    amp-feng-20261007-result-variant-hyenadna-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    71f2c72270e31e5cb47a2cdfa4bdb648ad2fd970d114818ec2b5b5d3f28d7e0c
  • record id
    amp-feng-20261007-result-variant-hyenadna-cohend
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    d4dba476467a85e3ed0b3c62684a4975fe9e94f8c3ccae2fd2519b9d65cf34f6
  • record id
    amp-feng-20261007-result-variant-nt-v2-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    dca8c3f8f054f83ecd4cf197b4a43b1d790f5c10241cbf9438326e00e6b95302
  • record id
    amp-feng-20261007-result-variant-nt-v2-cohend
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    02ddc75d9f805c413fc1ebce8f8142da153014997a46dc9c12face9ab56126f0
  • record id
    amp-feng-20261007-result-variant-sei-hidden-states-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    3564087ab98836b420ab8778943fdeda5456d82e6f46b20a6101f05ae5115dbb
  • record id
    amp-feng-20261007-result-variant-sei-hidden-states-cohend
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    7ce8710548ff767fff151a07bd8bd2c2c64281a572cb6d68fb2d6b55417e6e31
  • record id
    amp-feng-20261007-result-variant-sei-output-tracks-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    9ed6e426bde14606b4aa7e38cac4be671134d430ee3fdcefe3abc130565733a0
  • record id
    amp-feng-20261007-result-variant-sei-output-tracks-cohend
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    345d47aa7e479feabcdeec722da463ed15a7e5a1713542cae508534278942f8c
  • record id
    evidence-expansion-dna-foundation-models-2025-5d8ca9bc
    fields
    • status
    • attributes.artifact_sha256
    sha256
    7996f91821054e875cfca234e2e3bca2b25a02af92475d0577cd3dd0a71a8559
  • record id
    use-case-rare-disease-candidate-ranking
    fields
    • status
    • name
    • description
    • facets
    • attributes.question
    • attributes.decision
    • attributes.inputs
    • attributes.output
    • attributes.exclusions
    • attributes.setting
    • attributes.clinical_scope
    • attributes.intended_users
    sha256
    c23eb057b1e65dac505b2a2b94025e4a932c7dcd4ec49c5bf8609c5896ab9aae
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.pins

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Rationale
Genome-wide pathogenic-versus-common SNP discrimination is a proxy for rare-disease candidate variant ranking; it is not disease-specific (no BRCA subgroup claim) and is not a complete clinical classification.
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.rationale

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Reason
Re-reviewed after Feng et al. Supplementary Data 4 per-group evaluations were added on this protocol (PR #157); relevance unchanged. First added: Add Codex-checked primary-source protocol evidence from the bounded AMP intake (rewire.it#365).
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.reason

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Relevance
proxy
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.relevance

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: use-case-mapping-amp-20261007-feng-pathogenic-common-variant

field
links:assessed_by:amp-feng-20261007-protocol-pathogenic-common-variant-classification
value
amp-feng-20261007-protocol-pathogenic-common-variant-classification
relevance
proxy
endpoint
Pathogenic-versus-common SNP discrimination (AUC, Cohen's d) for eleven DNA foundation-model/genomic-comparator configurations, across separate short- and long-window scored populations
rationale
Genome-wide pathogenic-versus-common SNP discrimination is a proxy for rare-disease candidate variant ranking; it is not disease-specific (no BRCA subgroup claim) and is not a complete clinical classification.
constraints
Inspect every linked evaluation's source locator and preserved conflicts before citing a result.; Do not combine this mapping's evaluations with any other protocol's results.
limitations
No disease-specific (e.g. BRCA) subgroup claim is supported by this table.; Short-window and long-window populations are separate and must not be pooled; each configuration/dataset records its exact assignment.; Sei, Enformer (hidden/output tracks) are non-DNA-foundation specialised genomic comparators per the source's own asterisk notation, not DNA foundation models.; Supplementary Data 4 gives each configuration's AUC on each of the three held-out chromosome groups. These are stored as separate per-group evaluations and excluded here, so each configuration is shown once, at the three-group mean the paper reports. The three group AUCs differ by 0.0014 to 0.057 within a configuration, and NT-v2 has the highest AUC in every group (0.7312, 0.7318, 0.7326).; No independent reproduction or qualified human scientific review.
revision
2
reason
Re-reviewed after Feng et al. Supplementary Data 4 per-group evaluations were added on this protocol (PR #157); relevance unchanged. First added: Add Codex-checked primary-source protocol evidence from the bounded AMP intake (rewire.it#365).
citation locators
source id: evidence-expansion-dna-foundation-models-2025-5d8ca9bc; locator: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/
source locator
evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/
review
method: ai-assisted-source-review; scope-review; method note: Re-review: checked the endpoint, relevance and limitations against the new per-group AUCs (Supplementary Data 4) and the Supplementary Data 4 legend; checked that the reviewed evaluations are unchanged and that each new per-group evaluation is excluded with a reason.; reviewer: claude; codex; claude-sonnet; reviewer note: Re-reviewed 2026-10-14 by an independent Claude (Opus 5.5) review agent for PR #157, separate from the extractor of the per-group results. First reviewed 2026-10-07: Claude Sonnet AMP-integration worker, bounded transcription of Codex-checked primary values; independently reviewed by Codex (workbench/amp-supervision/primary-review.md, integration-review-corrections.md). No human review claimed.; reviewed at: 2026-10-14T15:30:00Z; note: Bounded primary-source transcription, independently Codex-checked. No new model execution, independent experimental reproduction, qualified human scientific review or clinical validation. Re-review 2026-10-14: the proxy judgement still holds; per-group AUCs do not change the endpoint or the ranking of the top configuration. See docs/reviews/use-cases/feng-variant-effect-per-group-2026-10-14.md.
reviewed evaluations
amp-feng-20261007-eval-variant-caduceus-ph; amp-feng-20261007-eval-variant-caduceus-ph-long-sequence; amp-feng-20261007-eval-variant-dnabert-2; amp-feng-20261007-eval-variant-enformer-hidden-states; amp-feng-20261007-eval-variant-enformer-output-tracks; amp-feng-20261007-eval-variant-grover; amp-feng-20261007-eval-variant-hyenadna; amp-feng-20261007-eval-variant-hyenadna-450k-long-sequence; amp-feng-20261007-eval-variant-nt-v2; amp-feng-20261007-eval-variant-sei-hidden-states; amp-feng-20261007-eval-variant-sei-output-tracks
pins
record id: amp-feng-20261007-eval-variant-caduceus-ph; fields: status; links; attributes.origin; attributes.comparison; sha256: bf43dc32396f10deb97b069cc721ef9e18916f16bae17423e7d02fe97c92d393; record id: amp-feng-20261007-eval-variant-caduceus-ph-long-sequence; fields: status; links; attributes.origin; attributes.comparison; sha256: 6b4e220f0ac057244ecdc60ee3dcb3c1fe3b92c0d3571ccbea1e3331ce86345b; record id: amp-feng-20261007-eval-variant-dnabert-2; fields: status; links; attributes.origin; attributes.comparison; sha256: f6188116d0edcfaaaaac00ec9e66f865bb393edb13e0673803cdf8c99c565ab1; record id: amp-feng-20261007-eval-variant-enformer-hidden-states; fields: status; links; attributes.origin; attributes.comparison; sha256: d69305099989333751ab6451c8b2ac8e648e7061bf3f5deb3312d8d256d2258b; record id: amp-feng-20261007-eval-variant-enformer-output-tracks; fields: status; links; attributes.origin; attributes.comparison; sha256: d3d3e31c2ef0f1388464850f121c67b058cac001eba4501e24c716f93add528d; record id: amp-feng-20261007-eval-variant-grover; fields: status; links; attributes.origin; attributes.comparison; sha256: fe1e469b1456c9e1a6c6349eb14254025612d76c5f4ca889c03d08b439ee8617; record id: amp-feng-20261007-eval-variant-hyenadna; fields: status; links; attributes.origin; attributes.comparison; sha256: 448aa09fcb6c2656ff14527c1a2adc4ea40d4543b2855a47ae74892d06e5d4e4; record id: amp-feng-20261007-eval-variant-hyenadna-450k-long-sequence; fields: status; links; attributes.origin; attributes.comparison; sha256: 6bf644b0f6a72380298865cf0ffc22df0ce7ef4b350f48c83e24151c34da8ce4; record id: amp-feng-20261007-eval-variant-nt-v2; fields: status; links; attributes.origin; attributes.comparison; sha256: a0ed36bfa70ae6eaa24329915d0d85e6aa898284268c6a55745c07436612c11f; record id: amp-feng-20261007-eval-variant-sei-hidden-states; fields: status; links; attributes.origin; attributes.comparison; sha256: 9fd355cb22d48a75ae4230d31d1fb218600494687bbfe79effc58f7c9642eac0; record id: amp-feng-20261007-eval-variant-sei-output-tracks; fields: status; links; attributes.origin; attributes.comparison; sha256: b9879a76414913ae8c4c7595e9ac2af3e251e1f26cf171acfe6bfb0b1032842a; record id: amp-feng-20261007-protocol-pathogenic-common-variant-classification; fields: status; name; description; facets; source_ids; links; attributes; sha256: 026fc6a39028dda9cff55ee312569b6c165bc4d5c17a98f810bf9dc9f10efa01; record id: amp-feng-20261007-result-variant-caduceus-ph-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 95fd3c3494dfb24b05af4178304034d3cd925d43a1226dbc20aede177ccb11eb; record id: amp-feng-20261007-result-variant-caduceus-ph-cohend; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: d8e669fe7df5bee4e24d4f647ad80b000685716df5f23e17293ac82b7967b7e1; record id: amp-feng-20261007-result-variant-caduceus-ph-long-sequence-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 3956e1813685e52f063ecc86fb2f20013bbd71f05aa2b9f501f6e4b6ba39eb8c; record id: amp-feng-20261007-result-variant-caduceus-ph-long-sequence-cohend; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 69891e4eeb9c79f920cd32b90ab9f48e4b7bfc62666b114172afdd00fb312ba5; record id: amp-feng-20261007-result-variant-dnabert-2-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 5e2e0b24f01aaa5a5cd215332d7f02f3e77f236b792f6a403f16ef5389260d65; record id: amp-feng-20261007-result-variant-dnabert-2-cohend; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 4d6a160b236343b87574855d0de726dfe938e2ef636388940acd990e5346ccc3; record id: amp-feng-20261007-result-variant-enformer-hidden-states-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 4bbe4c7fec47d123c7f38c8b0671862f2451ddf4da866ec6ef58697fb76771bd; record id: amp-feng-20261007-result-variant-enformer-hidden-states-cohend; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: b510d892aa2c85b5add3d151787f529ac92559cfbd30b2b9c664d8c530420312; record id: amp-feng-20261007-result-variant-enformer-output-tracks-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 3a86a27dd71084819be16e871d1a7aae7566f572681ef041faac85ccf0204ca1; record id: amp-feng-20261007-result-variant-enformer-output-tracks-cohend; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: c1e09680b4940ea95bb822cb6f5e60d1879d8719665cf906ef3f8a0b3d77a75d; record id: amp-feng-20261007-result-variant-grover-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 006aa4e11c15e17fcc5df953fb7ab261e396cb5dafb801a157772dcee039451d; record id: amp-feng-20261007-result-variant-grover-cohend; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 1d7337d96e26c0dde1a8262e219388a15e410f2e25b2aadb42b6ee2abe911fe3; record id: amp-feng-20261007-result-variant-hyenadna-450k-long-sequence-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: df25b4211fa62eb75caa2acfd9322748c4f80f2d104b6129e8d6329f9a330e4d; record id: amp-feng-20261007-result-variant-hyenadna-450k-long-sequence-cohend; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 39a4b127b1e470f5f6e853cee1b5fd063f9d8c5654cd598da38b1500b1da7bf7; record id: amp-feng-20261007-result-variant-hyenadna-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 71f2c72270e31e5cb47a2cdfa4bdb648ad2fd970d114818ec2b5b5d3f28d7e0c; record id: amp-feng-20261007-result-variant-hyenadna-cohend; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: d4dba476467a85e3ed0b3c62684a4975fe9e94f8c3ccae2fd2519b9d65cf34f6; record id: amp-feng-20261007-result-variant-nt-v2-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: dca8c3f8f054f83ecd4cf197b4a43b1d790f5c10241cbf9438326e00e6b95302; record id: amp-feng-20261007-result-variant-nt-v2-cohend; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 02ddc75d9f805c413fc1ebce8f8142da153014997a46dc9c12face9ab56126f0; record id: amp-feng-20261007-result-variant-sei-hidden-states-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 3564087ab98836b420ab8778943fdeda5456d82e6f46b20a6101f05ae5115dbb; record id: amp-feng-20261007-result-variant-sei-hidden-states-cohend; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 7ce8710548ff767fff151a07bd8bd2c2c64281a572cb6d68fb2d6b55417e6e31; record id: amp-feng-20261007-result-variant-sei-output-tracks-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 9ed6e426bde14606b4aa7e38cac4be671134d430ee3fdcefe3abc130565733a0; record id: amp-feng-20261007-result-variant-sei-output-tracks-cohend; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 345d47aa7e479feabcdeec722da463ed15a7e5a1713542cae508534278942f8c; record id: evidence-expansion-dna-foundation-models-2025-5d8ca9bc; fields: status; attributes.artifact_sha256; sha256: 7996f91821054e875cfca234e2e3bca2b25a02af92475d0577cd3dd0a71a8559; record id: use-case-rare-disease-candidate-ranking; fields: status; name; description; facets; attributes.question; attributes.decision; attributes.inputs; attributes.output; attributes.exclusions; attributes.setting; attributes.clinical_scope; attributes.intended_users; sha256: c23eb057b1e65dac505b2a2b94025e4a932c7dcd4ec49c5bf8609c5896ab9aae
excluded evaluations
id: feng-dna-fm-20261014-eval-sd4-pathogenic-common-caduceus-ph; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-pathogenic-common-caduceus-ph-long-sequence; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-pathogenic-common-dnabert-2; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-pathogenic-common-enformer-hidden-states; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-pathogenic-common-enformer-output-tracks; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-pathogenic-common-grover; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-pathogenic-common-hyenadna; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-pathogenic-common-hyenadna-450k-long-sequence; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-pathogenic-common-nt-v2; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-pathogenic-common-sei-hidden-states; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-pathogenic-common-sei-output-tracks; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
Related records

Suggest a correction