rewirebio.iobenchmarks
Evidence claim

Relevance of Feng eQTL discrimination to "Select regulatory variants and genes for functional follow-up"

Use case
Select regulatory variants and genes for functional follow-up
Assessed by
Feng eQTL discrimination
Relevance
Proxy evidence
Endpoint
eQTL causal-versus-noncausal variant discrimination (AUC, Cohen's d) for twelve DNA foundation-model/genomic-comparator configurations

eQTL causal-variant discrimination is a proxy for regulatory-variant gene follow-up prioritisation; it is not an experimentally validated follow-up choice and is a separate task from the other three QTL types.

12 reviewed evaluations

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

16 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Citation locations
1 values
  • source id
    evidence-expansion-dna-foundation-models-2025-5d8ca9bc
    locator
    See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.citation_locators

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Constraints
2 values
  • Inspect every linked evaluation's source locator and preserved conflicts before citing a result.
  • Do not combine this mapping's evaluations with any other protocol's results.
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.constraints

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Endpoint
eQTL causal-versus-noncausal variant discrimination (AUC, Cohen's d) for twelve DNA foundation-model/genomic-comparator configurations
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.endpoint

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Excluded evaluations
12 values
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-eqtl-alphagenome-output-tracks
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-eqtl-caduceus-ph
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-eqtl-caduceus-ph-long-sequence
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-eqtl-dnabert-2
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-eqtl-enformer-hidden-states
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-eqtl-enformer-output-tracks
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-eqtl-grover
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-eqtl-hyenadna
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-eqtl-hyenadna-450k-long-sequence
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-eqtl-nt-v2
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-eqtl-sei-hidden-states
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-eqtl-sei-output-tracks
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.excluded_evaluations

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Claimed field
links:assessed_by:amp-feng-20261007-protocol-qtl-eqtl
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.field

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Limitations
5 values
  • Post-window-filter per-model scored denominators are unreported for eQTL; the pre-filter positive count (1896) is not a confirmed denominator.
  • AlphaGenome appears only in this QTL comparison, not the pathogenic/common SNP comparison. It uses the long-window QTL dataset, consuming central 131,072 bp and averaging output tracks over central 2,048 bp.
  • Sei, Enformer (hidden/output tracks) and AlphaGenome (output tracks) are non-DNA-foundation specialised genomic comparators per the source's own asterisk notation, not DNA foundation models.
  • Supplementary Data 4 gives each configuration's AUC on each of the three held-out chromosome groups. These are stored as separate per-group evaluations and excluded here, so each configuration is shown once, at the three-group mean the paper reports. The three group AUCs differ by 0.0066 to 0.0372 within a configuration; AlphaGenome output tracks rank first and Enformer hidden states second in every group.
  • No independent reproduction or qualified human scientific review.
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.limitations

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Pinned records
39 values
  • record id
    amp-feng-20261007-eval-qtl-eqtl-alphagenome-output-tracks
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    33a5c9bb19e8f2742b1f2e4cb3e3b1a3f2f1e6727c09979132d9abb5a7ccf6a9
  • record id
    amp-feng-20261007-eval-qtl-eqtl-caduceus-ph
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    9d0f2a3a2d8a7131bc1459afc7d5a95f81ce947defdd5eab30a3d09ec6ce2cc1
  • record id
    amp-feng-20261007-eval-qtl-eqtl-caduceus-ph-long-sequence
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    cdf01fe44d9ace7d12dc1230573676268f64e36238aa2808499a881389345c00
  • record id
    amp-feng-20261007-eval-qtl-eqtl-dnabert-2
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    cf6097fedfcb03e6a36e4783cfe0ddfd1111d4f208d463d00ea82ab765286462
  • record id
    amp-feng-20261007-eval-qtl-eqtl-enformer-hidden-states
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    0ad3905d7e26aa3ea3d225932aea034b81e3b6a182816f796405ced0d26c0bfa
  • record id
    amp-feng-20261007-eval-qtl-eqtl-enformer-output-tracks
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    cb7034e3501793eae1d20b3def097362d1722ae89825268488bf62d8995eb133
  • record id
    amp-feng-20261007-eval-qtl-eqtl-grover
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    cd0d8a568f9aaab52c86655283dd3e84e9c987a3feb57c1a05d25bd97c31cf9c
  • record id
    amp-feng-20261007-eval-qtl-eqtl-hyenadna
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    1c9d23b4c1c9ed10ef65751e3c14be7f8fb0d7d10b9c7243be4037c7d7b8ed84
  • record id
    amp-feng-20261007-eval-qtl-eqtl-hyenadna-450k-long-sequence
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    425bc067a686ec012ab6e593d445cbf62967646d08cfd1d2d4515b19677893ce
  • record id
    amp-feng-20261007-eval-qtl-eqtl-nt-v2
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    4202ed2763d9046dd735439ae0b23a96cc797144fef4ca95ab9923c68ae6324c
  • record id
    amp-feng-20261007-eval-qtl-eqtl-sei-hidden-states
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    802af8ef89c001c323b1cb4952de68906f5a68987bb0d3e87e5a51cf3b01b536
  • record id
    amp-feng-20261007-eval-qtl-eqtl-sei-output-tracks
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    718012da99dfea8975869e964e56faed6e6f3730f1faaea737d8bebeed39d303
  • record id
    amp-feng-20261007-protocol-qtl-eqtl
    fields
    • status
    • name
    • description
    • facets
    • source_ids
    • links
    • attributes
    sha256
    8b1bd5880da8eff8ccaa700c90c90de14357e6e99813a5ccaec504cc6ba292a2
  • record id
    amp-feng-20261007-result-qtl-eqtl-alphagenome-output-tracks-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    b2d2bb3bc04345fb353722113454ee051ae09b9896ce06100e0a39537089511e
  • record id
    amp-feng-20261007-result-qtl-eqtl-alphagenome-output-tracks-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    19a730fa0a682a53810b11ba015afd1e26d321a36684d03d92ea5cc01cb88aeb
  • record id
    amp-feng-20261007-result-qtl-eqtl-caduceus-ph-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    a97605f41fa5f033788c1fa40816d51d83e9cf052e9351ac8f3251f38374d352
  • record id
    amp-feng-20261007-result-qtl-eqtl-caduceus-ph-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    3159c357358e734adceb619bfa7dacbf0b49486b4ceefd74041b206a5f8079f4
  • record id
    amp-feng-20261007-result-qtl-eqtl-caduceus-ph-long-sequence-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    11e1c7a1e638ecc92c5232bc459c41822fd563ed75f5d14c94471c5651732239
  • record id
    amp-feng-20261007-result-qtl-eqtl-caduceus-ph-long-sequence-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    f0bc1cfce73510d250daa3b2077ea09868dd3fe703ba33d83619e2274a09370b
  • record id
    amp-feng-20261007-result-qtl-eqtl-dnabert-2-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    25a50a7b2e2e3b190f39c90c61fabd0e94b2c50ccbc3342062eaadecb7eded1b
  • record id
    amp-feng-20261007-result-qtl-eqtl-dnabert-2-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    a1e370d90ab8f010fbde0a0e99c3d67e9a96cc72ece97efeef0990fb8901d4dc
  • record id
    amp-feng-20261007-result-qtl-eqtl-enformer-hidden-states-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    55a2670e14299c8c7089452def8a2a293b998e1c509b30d0ccbdd4c15f84b556
  • record id
    amp-feng-20261007-result-qtl-eqtl-enformer-hidden-states-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    950fefa43bdf5a369f338614f82855cb6ccd97b60d4bd9ac5b38a1e422754815
  • record id
    amp-feng-20261007-result-qtl-eqtl-enformer-output-tracks-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    7c0ca4e5780fc4174880224e58b83798c15d93980230c737aee647f03b2b92e7
  • record id
    amp-feng-20261007-result-qtl-eqtl-enformer-output-tracks-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    f9a74324c9ca8e1ff88ac9778747582a7990c6f7f002eee6f615dd679cdaae6b
  • record id
    amp-feng-20261007-result-qtl-eqtl-grover-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    d2acd83b5e413b04065441d5e623ced34d39edb29283a330eb7a3e874f7974e6
  • record id
    amp-feng-20261007-result-qtl-eqtl-grover-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    8a9d4abbca7243a6cbff513e414b0908584f2e6b6989d3b69a7ed344a8e13fa8
  • record id
    amp-feng-20261007-result-qtl-eqtl-hyenadna-450k-long-sequence-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    8cbdfea5d22744b3e4b11786f2b92fd59fa2d4a61cdc74939927e0f8d516e550
  • record id
    amp-feng-20261007-result-qtl-eqtl-hyenadna-450k-long-sequence-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    38341028bfa9598307a9c4881b631fdc3cb92424b5ded54ff712ce659890cea8
  • record id
    amp-feng-20261007-result-qtl-eqtl-hyenadna-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    494623045f3009c955863dfe9ed5577353c9afc76939636e1966a93b9ed690cf
  • record id
    amp-feng-20261007-result-qtl-eqtl-hyenadna-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    4891d1cf55c088d00c20ed1b121dbd4019fb887fd9ebc25c7fda519d51b115c6
  • record id
    amp-feng-20261007-result-qtl-eqtl-nt-v2-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    dea463461041b62d48ee534d8c4400a31157ced7995907b37af6796930725004
  • record id
    amp-feng-20261007-result-qtl-eqtl-nt-v2-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    1c0644e6b4b50d89221cfa1d9e3ee1973cb81ae44146f2186975db27b8677756
  • record id
    amp-feng-20261007-result-qtl-eqtl-sei-hidden-states-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    f44660915108f961c6f1d7b945d707a1b5d18d26a058f34ffb79aeca68ddf1cb
  • record id
    amp-feng-20261007-result-qtl-eqtl-sei-hidden-states-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    658e640c2d848931e02a1345558c52727586d2f3e776fa7ca89530ee21a5d554
  • record id
    amp-feng-20261007-result-qtl-eqtl-sei-output-tracks-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    8a50547a024aa23e3425ca9ffe52d4a09f5645d4b95413ee771ba07c395e2139
  • record id
    amp-feng-20261007-result-qtl-eqtl-sei-output-tracks-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    6a0c84f917e13d570b6bb6d97b473ab8a78655cfcf434644b544eb1c58530c1c
  • record id
    evidence-expansion-dna-foundation-models-2025-5d8ca9bc
    fields
    • status
    • attributes.artifact_sha256
    sha256
    7996f91821054e875cfca234e2e3bca2b25a02af92475d0577cd3dd0a71a8559
  • record id
    use-case-regulatory-variant-gene-follow-up
    fields
    • status
    • name
    • description
    • facets
    • attributes.question
    • attributes.decision
    • attributes.inputs
    • attributes.output
    • attributes.exclusions
    • attributes.setting
    • attributes.clinical_scope
    • attributes.intended_users
    sha256
    0071547e01ccaec30238aea9e4882dd92e6f51be9c967c7fb88bc61d2788b870
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.pins

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Rationale
eQTL causal-variant discrimination is a proxy for regulatory-variant gene follow-up prioritisation; it is not an experimentally validated follow-up choice and is a separate task from the other three QTL types.
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.rationale

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Reason
Re-reviewed after Feng et al. Supplementary Data 4 per-group evaluations were added on this protocol (PR #157); relevance unchanged. First added: Add Codex-checked primary-source protocol evidence from the bounded AMP intake (rewire.it#365).
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.reason

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Relevance
proxy
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.relevance

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: use-case-mapping-amp-20261007-feng-qtl-eqtl

field
links:assessed_by:amp-feng-20261007-protocol-qtl-eqtl
value
amp-feng-20261007-protocol-qtl-eqtl
relevance
proxy
endpoint
eQTL causal-versus-noncausal variant discrimination (AUC, Cohen's d) for twelve DNA foundation-model/genomic-comparator configurations
rationale
eQTL causal-variant discrimination is a proxy for regulatory-variant gene follow-up prioritisation; it is not an experimentally validated follow-up choice and is a separate task from the other three QTL types.
constraints
Inspect every linked evaluation's source locator and preserved conflicts before citing a result.; Do not combine this mapping's evaluations with any other protocol's results.
limitations
Post-window-filter per-model scored denominators are unreported for eQTL; the pre-filter positive count (1896) is not a confirmed denominator.; AlphaGenome appears only in this QTL comparison, not the pathogenic/common SNP comparison. It uses the long-window QTL dataset, consuming central 131,072 bp and averaging output tracks over central 2,048 bp.; Sei, Enformer (hidden/output tracks) and AlphaGenome (output tracks) are non-DNA-foundation specialised genomic comparators per the source's own asterisk notation, not DNA foundation models.; Supplementary Data 4 gives each configuration's AUC on each of the three held-out chromosome groups. These are stored as separate per-group evaluations and excluded here, so each configuration is shown once, at the three-group mean the paper reports. The three group AUCs differ by 0.0066 to 0.0372 within a configuration; AlphaGenome output tracks rank first and Enformer hidden states second in every group.; No independent reproduction or qualified human scientific review.
revision
2
reason
Re-reviewed after Feng et al. Supplementary Data 4 per-group evaluations were added on this protocol (PR #157); relevance unchanged. First added: Add Codex-checked primary-source protocol evidence from the bounded AMP intake (rewire.it#365).
citation locators
source id: evidence-expansion-dna-foundation-models-2025-5d8ca9bc; locator: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/
source locator
evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/
review
method: ai-assisted-source-review; scope-review; method note: Re-review: checked the endpoint, relevance and limitations against the new per-group AUCs (Supplementary Data 4) and the Supplementary Data 4 legend; checked that the reviewed evaluations are unchanged and that each new per-group evaluation is excluded with a reason.; reviewer: claude; codex; claude-sonnet; reviewer note: Re-reviewed 2026-10-14 by an independent Claude (Opus 5.5) review agent for PR #157, separate from the extractor of the per-group results. First reviewed 2026-10-07: Claude Sonnet AMP-integration worker, bounded transcription of Codex-checked primary values; independently reviewed by Codex (workbench/amp-supervision/primary-review.md, integration-review-corrections.md). No human review claimed.; reviewed at: 2026-10-14T15:30:00Z; note: Bounded primary-source transcription, independently Codex-checked. No new model execution, independent experimental reproduction, qualified human scientific review or clinical validation. Re-review 2026-10-14: the proxy judgement still holds; per-group AUCs do not change the endpoint or the ranking of the top configuration. See docs/reviews/use-cases/feng-variant-effect-per-group-2026-10-14.md.
reviewed evaluations
amp-feng-20261007-eval-qtl-eqtl-alphagenome-output-tracks; amp-feng-20261007-eval-qtl-eqtl-caduceus-ph; amp-feng-20261007-eval-qtl-eqtl-caduceus-ph-long-sequence; amp-feng-20261007-eval-qtl-eqtl-dnabert-2; amp-feng-20261007-eval-qtl-eqtl-enformer-hidden-states; amp-feng-20261007-eval-qtl-eqtl-enformer-output-tracks; amp-feng-20261007-eval-qtl-eqtl-grover; amp-feng-20261007-eval-qtl-eqtl-hyenadna; amp-feng-20261007-eval-qtl-eqtl-hyenadna-450k-long-sequence; amp-feng-20261007-eval-qtl-eqtl-nt-v2; amp-feng-20261007-eval-qtl-eqtl-sei-hidden-states; amp-feng-20261007-eval-qtl-eqtl-sei-output-tracks
pins
record id: amp-feng-20261007-eval-qtl-eqtl-alphagenome-output-tracks; fields: status; links; attributes.origin; attributes.comparison; sha256: 33a5c9bb19e8f2742b1f2e4cb3e3b1a3f2f1e6727c09979132d9abb5a7ccf6a9; record id: amp-feng-20261007-eval-qtl-eqtl-caduceus-ph; fields: status; links; attributes.origin; attributes.comparison; sha256: 9d0f2a3a2d8a7131bc1459afc7d5a95f81ce947defdd5eab30a3d09ec6ce2cc1; record id: amp-feng-20261007-eval-qtl-eqtl-caduceus-ph-long-sequence; fields: status; links; attributes.origin; attributes.comparison; sha256: cdf01fe44d9ace7d12dc1230573676268f64e36238aa2808499a881389345c00; record id: amp-feng-20261007-eval-qtl-eqtl-dnabert-2; fields: status; links; attributes.origin; attributes.comparison; sha256: cf6097fedfcb03e6a36e4783cfe0ddfd1111d4f208d463d00ea82ab765286462; record id: amp-feng-20261007-eval-qtl-eqtl-enformer-hidden-states; fields: status; links; attributes.origin; attributes.comparison; sha256: 0ad3905d7e26aa3ea3d225932aea034b81e3b6a182816f796405ced0d26c0bfa; record id: amp-feng-20261007-eval-qtl-eqtl-enformer-output-tracks; fields: status; links; attributes.origin; attributes.comparison; sha256: cb7034e3501793eae1d20b3def097362d1722ae89825268488bf62d8995eb133; record id: amp-feng-20261007-eval-qtl-eqtl-grover; fields: status; links; attributes.origin; attributes.comparison; sha256: cd0d8a568f9aaab52c86655283dd3e84e9c987a3feb57c1a05d25bd97c31cf9c; record id: amp-feng-20261007-eval-qtl-eqtl-hyenadna; fields: status; links; attributes.origin; attributes.comparison; sha256: 1c9d23b4c1c9ed10ef65751e3c14be7f8fb0d7d10b9c7243be4037c7d7b8ed84; record id: amp-feng-20261007-eval-qtl-eqtl-hyenadna-450k-long-sequence; fields: status; links; attributes.origin; attributes.comparison; sha256: 425bc067a686ec012ab6e593d445cbf62967646d08cfd1d2d4515b19677893ce; record id: amp-feng-20261007-eval-qtl-eqtl-nt-v2; fields: status; links; attributes.origin; attributes.comparison; sha256: 4202ed2763d9046dd735439ae0b23a96cc797144fef4ca95ab9923c68ae6324c; record id: amp-feng-20261007-eval-qtl-eqtl-sei-hidden-states; fields: status; links; attributes.origin; attributes.comparison; sha256: 802af8ef89c001c323b1cb4952de68906f5a68987bb0d3e87e5a51cf3b01b536; record id: amp-feng-20261007-eval-qtl-eqtl-sei-output-tracks; fields: status; links; attributes.origin; attributes.comparison; sha256: 718012da99dfea8975869e964e56faed6e6f3730f1faaea737d8bebeed39d303; record id: amp-feng-20261007-protocol-qtl-eqtl; fields: status; name; description; facets; source_ids; links; attributes; sha256: 8b1bd5880da8eff8ccaa700c90c90de14357e6e99813a5ccaec504cc6ba292a2; record id: amp-feng-20261007-result-qtl-eqtl-alphagenome-output-tracks-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: b2d2bb3bc04345fb353722113454ee051ae09b9896ce06100e0a39537089511e; record id: amp-feng-20261007-result-qtl-eqtl-alphagenome-output-tracks-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 19a730fa0a682a53810b11ba015afd1e26d321a36684d03d92ea5cc01cb88aeb; record id: amp-feng-20261007-result-qtl-eqtl-caduceus-ph-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: a97605f41fa5f033788c1fa40816d51d83e9cf052e9351ac8f3251f38374d352; record id: amp-feng-20261007-result-qtl-eqtl-caduceus-ph-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 3159c357358e734adceb619bfa7dacbf0b49486b4ceefd74041b206a5f8079f4; record id: amp-feng-20261007-result-qtl-eqtl-caduceus-ph-long-sequence-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 11e1c7a1e638ecc92c5232bc459c41822fd563ed75f5d14c94471c5651732239; record id: amp-feng-20261007-result-qtl-eqtl-caduceus-ph-long-sequence-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: f0bc1cfce73510d250daa3b2077ea09868dd3fe703ba33d83619e2274a09370b; record id: amp-feng-20261007-result-qtl-eqtl-dnabert-2-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 25a50a7b2e2e3b190f39c90c61fabd0e94b2c50ccbc3342062eaadecb7eded1b; record id: amp-feng-20261007-result-qtl-eqtl-dnabert-2-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: a1e370d90ab8f010fbde0a0e99c3d67e9a96cc72ece97efeef0990fb8901d4dc; record id: amp-feng-20261007-result-qtl-eqtl-enformer-hidden-states-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 55a2670e14299c8c7089452def8a2a293b998e1c509b30d0ccbdd4c15f84b556; record id: amp-feng-20261007-result-qtl-eqtl-enformer-hidden-states-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 950fefa43bdf5a369f338614f82855cb6ccd97b60d4bd9ac5b38a1e422754815; record id: amp-feng-20261007-result-qtl-eqtl-enformer-output-tracks-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 7c0ca4e5780fc4174880224e58b83798c15d93980230c737aee647f03b2b92e7; record id: amp-feng-20261007-result-qtl-eqtl-enformer-output-tracks-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: f9a74324c9ca8e1ff88ac9778747582a7990c6f7f002eee6f615dd679cdaae6b; record id: amp-feng-20261007-result-qtl-eqtl-grover-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: d2acd83b5e413b04065441d5e623ced34d39edb29283a330eb7a3e874f7974e6; record id: amp-feng-20261007-result-qtl-eqtl-grover-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 8a9d4abbca7243a6cbff513e414b0908584f2e6b6989d3b69a7ed344a8e13fa8; record id: amp-feng-20261007-result-qtl-eqtl-hyenadna-450k-long-sequence-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 8cbdfea5d22744b3e4b11786f2b92fd59fa2d4a61cdc74939927e0f8d516e550; record id: amp-feng-20261007-result-qtl-eqtl-hyenadna-450k-long-sequence-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 38341028bfa9598307a9c4881b631fdc3cb92424b5ded54ff712ce659890cea8; record id: amp-feng-20261007-result-qtl-eqtl-hyenadna-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 494623045f3009c955863dfe9ed5577353c9afc76939636e1966a93b9ed690cf; record id: amp-feng-20261007-result-qtl-eqtl-hyenadna-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 4891d1cf55c088d00c20ed1b121dbd4019fb887fd9ebc25c7fda519d51b115c6; record id: amp-feng-20261007-result-qtl-eqtl-nt-v2-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: dea463461041b62d48ee534d8c4400a31157ced7995907b37af6796930725004; record id: amp-feng-20261007-result-qtl-eqtl-nt-v2-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 1c0644e6b4b50d89221cfa1d9e3ee1973cb81ae44146f2186975db27b8677756; record id: amp-feng-20261007-result-qtl-eqtl-sei-hidden-states-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: f44660915108f961c6f1d7b945d707a1b5d18d26a058f34ffb79aeca68ddf1cb; record id: amp-feng-20261007-result-qtl-eqtl-sei-hidden-states-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 658e640c2d848931e02a1345558c52727586d2f3e776fa7ca89530ee21a5d554; record id: amp-feng-20261007-result-qtl-eqtl-sei-output-tracks-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 8a50547a024aa23e3425ca9ffe52d4a09f5645d4b95413ee771ba07c395e2139; record id: amp-feng-20261007-result-qtl-eqtl-sei-output-tracks-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 6a0c84f917e13d570b6bb6d97b473ab8a78655cfcf434644b544eb1c58530c1c; record id: evidence-expansion-dna-foundation-models-2025-5d8ca9bc; fields: status; attributes.artifact_sha256; sha256: 7996f91821054e875cfca234e2e3bca2b25a02af92475d0577cd3dd0a71a8559; record id: use-case-regulatory-variant-gene-follow-up; fields: status; name; description; facets; attributes.question; attributes.decision; attributes.inputs; attributes.output; attributes.exclusions; attributes.setting; attributes.clinical_scope; attributes.intended_users; sha256: 0071547e01ccaec30238aea9e4882dd92e6f51be9c967c7fb88bc61d2788b870
excluded evaluations
id: feng-dna-fm-20261014-eval-sd4-qtl-eqtl-alphagenome-output-tracks; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-eqtl-caduceus-ph; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-eqtl-caduceus-ph-long-sequence; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-eqtl-dnabert-2; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-eqtl-enformer-hidden-states; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-eqtl-enformer-output-tracks; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-eqtl-grover; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-eqtl-hyenadna; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-eqtl-hyenadna-450k-long-sequence; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-eqtl-nt-v2; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-eqtl-sei-hidden-states; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-eqtl-sei-output-tracks; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
Related records

Suggest a correction