rewirebio.iobenchmarks
Evidence claim

Relevance of Feng sQTL discrimination to "Select regulatory variants and genes for functional follow-up"

Use case
Select regulatory variants and genes for functional follow-up
Assessed by
Feng sQTL discrimination
Relevance
Proxy evidence
Endpoint
sQTL causal-versus-noncausal variant discrimination (AUC, Cohen's d) for twelve DNA foundation-model/genomic-comparator configurations

sQTL causal-variant discrimination is a proxy for regulatory-variant gene follow-up prioritisation; it is not an experimentally validated follow-up choice and is a separate task from the other three QTL types.

12 reviewed evaluations

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

16 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Citation locations
1 values
  • source id
    evidence-expansion-dna-foundation-models-2025-5d8ca9bc
    locator
    See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.citation_locators

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Constraints
2 values
  • Inspect every linked evaluation's source locator and preserved conflicts before citing a result.
  • Do not combine this mapping's evaluations with any other protocol's results.
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.constraints

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Endpoint
sQTL causal-versus-noncausal variant discrimination (AUC, Cohen's d) for twelve DNA foundation-model/genomic-comparator configurations
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.endpoint

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Excluded evaluations
12 values
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-sqtl-alphagenome-output-tracks
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-sqtl-caduceus-ph
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-sqtl-caduceus-ph-long-sequence
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-sqtl-dnabert-2
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-sqtl-enformer-hidden-states
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-sqtl-enformer-output-tracks
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-sqtl-grover
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-sqtl-hyenadna
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-sqtl-hyenadna-450k-long-sequence
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-sqtl-nt-v2
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-sqtl-sei-hidden-states
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-sqtl-sei-output-tracks
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.excluded_evaluations

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Claimed field
links:assessed_by:amp-feng-20261007-protocol-qtl-sqtl
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.field

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Limitations
5 values
  • Post-window-filter per-model scored denominators are unreported for sQTL; the pre-filter positive count (540) is not a confirmed denominator.
  • AlphaGenome appears only in this QTL comparison, not the pathogenic/common SNP comparison. It uses the long-window QTL dataset, consuming central 131,072 bp and averaging output tracks over central 2,048 bp.
  • Sei, Enformer (hidden/output tracks) and AlphaGenome (output tracks) are non-DNA-foundation specialised genomic comparators per the source's own asterisk notation, not DNA foundation models.
  • Supplementary Data 4 gives each configuration's AUC on each of the three held-out chromosome groups. These are stored as separate per-group evaluations and excluded here, so each configuration is shown once, at the three-group mean the paper reports. The three group AUCs differ by 0.0085 to 0.0886 within a configuration; AlphaGenome output tracks rank first in every group.
  • No independent reproduction or qualified human scientific review.
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.limitations

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Pinned records
39 values
  • record id
    amp-feng-20261007-eval-qtl-sqtl-alphagenome-output-tracks
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    c7e92813f207dc4bab9a157b8707c75cbbc91130b698d5a27d15d1c680e4c132
  • record id
    amp-feng-20261007-eval-qtl-sqtl-caduceus-ph
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    72c69d8d49f08af0f43bfe19fe23f6d3131c874c6875fe54a579874e671760b7
  • record id
    amp-feng-20261007-eval-qtl-sqtl-caduceus-ph-long-sequence
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    77aba5c3899ee1a5a235132c8139e35b34df5eb206292d077ac04b10f065ceb9
  • record id
    amp-feng-20261007-eval-qtl-sqtl-dnabert-2
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    7097f98fafa75ff7929fc21d4f4d155b6e8445c1b300820120db248e30a0ab96
  • record id
    amp-feng-20261007-eval-qtl-sqtl-enformer-hidden-states
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    f6a8d70d31bde826a1df5bed1fd395df8d065589756e0d54d0f66c872361582d
  • record id
    amp-feng-20261007-eval-qtl-sqtl-enformer-output-tracks
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    54300e55aa087190267d7087a2b2f4c8c00ed2e17b74c4711a6ade3ea5fee5e8
  • record id
    amp-feng-20261007-eval-qtl-sqtl-grover
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    75dd44ba9c8b86b3896142588d29d872cd9083751b039928d7a72f9d3bbe249a
  • record id
    amp-feng-20261007-eval-qtl-sqtl-hyenadna
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    3b5372d3f27c62ba553048e06ddf25beddf5e60f3c9020e54f6ec398168d6d57
  • record id
    amp-feng-20261007-eval-qtl-sqtl-hyenadna-450k-long-sequence
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    c1a99bf8d7538e46b165629ecf090c10c46598f5b80807164f7ed6edb1e08eef
  • record id
    amp-feng-20261007-eval-qtl-sqtl-nt-v2
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    ac7d7a0c05aceea674019ab49113552042e23d0f983957202d09a5ce2a65f481
  • record id
    amp-feng-20261007-eval-qtl-sqtl-sei-hidden-states
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    39b4b090492836a349c1cf146837f19dca700bc4bd2f8536bafb88e9f23b95d3
  • record id
    amp-feng-20261007-eval-qtl-sqtl-sei-output-tracks
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    89d381fb226def5bf1a2ccd742fb02b0efd936b6cece3f0bb56267833d055ba5
  • record id
    amp-feng-20261007-protocol-qtl-sqtl
    fields
    • status
    • name
    • description
    • facets
    • source_ids
    • links
    • attributes
    sha256
    f04174a31ebde4042854b2452384e0cea356d1e8c33f72cd0c06d0539fe8b43f
  • record id
    amp-feng-20261007-result-qtl-sqtl-alphagenome-output-tracks-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    1f2048d034f4a5b1ff641b414758d12cf9f5c79a736a47c02cb47b3841b20650
  • record id
    amp-feng-20261007-result-qtl-sqtl-alphagenome-output-tracks-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    36b9b5a9eb39e1cabc5f95b67df692be1a14226bd88af68d9a96ad34a976e194
  • record id
    amp-feng-20261007-result-qtl-sqtl-caduceus-ph-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    991f3ee811367019a16b094bfb266f91734976ffbd4d6c64ea03136e1438400d
  • record id
    amp-feng-20261007-result-qtl-sqtl-caduceus-ph-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    0960ef4f0d3df0dda788e1d40259d2184bdc5179e273c8a0d022d8258306f1bf
  • record id
    amp-feng-20261007-result-qtl-sqtl-caduceus-ph-long-sequence-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    54d2e87c716522bd0edf33ede782aef9fe1d4f11fd1e52b286d8940c49f6bbfd
  • record id
    amp-feng-20261007-result-qtl-sqtl-caduceus-ph-long-sequence-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    898f382086c0b4dbdee43f2d9ce83cbb918d70a3293fa3bb292ca6626a39c162
  • record id
    amp-feng-20261007-result-qtl-sqtl-dnabert-2-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    f15d110deccf713f270f9ff12dcb452077d953c775d92d1f04a10c973997827d
  • record id
    amp-feng-20261007-result-qtl-sqtl-dnabert-2-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    823ab3ef5eec3a42ecefc5c53ac001c6579edf10ce1879e74aa3be02a83fefca
  • record id
    amp-feng-20261007-result-qtl-sqtl-enformer-hidden-states-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    b2de1b755982ce54f39607cf648bb832ca980615c06f3db6a3013d3d8325602f
  • record id
    amp-feng-20261007-result-qtl-sqtl-enformer-hidden-states-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    5512a092928316dcff0a81acf82e02b7cc31da9312c2e1ae1ca0bc0f3875c75f
  • record id
    amp-feng-20261007-result-qtl-sqtl-enformer-output-tracks-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    9c4fbf629d62311ced6a6cd5be6f5c457b16def93325c33903de49eb03ee9aaa
  • record id
    amp-feng-20261007-result-qtl-sqtl-enformer-output-tracks-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    2f7f333b6090fd3f2be5fb0c35270fc54c880389a922124420fc58952cb43571
  • record id
    amp-feng-20261007-result-qtl-sqtl-grover-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    6c8bc97e343d972f00b07e68d4452925270736c787f6242fe6a2f5f584bda3ec
  • record id
    amp-feng-20261007-result-qtl-sqtl-grover-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    5c5061ad4f7a04f6323e8560e5fe3f1972568dd43de45222fb315b23c0d7567e
  • record id
    amp-feng-20261007-result-qtl-sqtl-hyenadna-450k-long-sequence-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    8edfd142803f697e26aa05b47aa1b1d6d246745b12a76924a6bdb2a751217ea1
  • record id
    amp-feng-20261007-result-qtl-sqtl-hyenadna-450k-long-sequence-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    3339edcd02af64fb33d06a887891682d431a76622ce021f70f012749e84530de
  • record id
    amp-feng-20261007-result-qtl-sqtl-hyenadna-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    8ac1f6910ab3bfe76ad36c5e2ea4719a36c19517d1104bb108c2bdf9ac5e82ac
  • record id
    amp-feng-20261007-result-qtl-sqtl-hyenadna-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    ee00be835aaeb183f19ca6f38090ab134b022dea3f1b469f7e9fecc420fcd57d
  • record id
    amp-feng-20261007-result-qtl-sqtl-nt-v2-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    459ce69ce35ee3f33e49912941e6dbf172a80c506f0f3c4b1b4376bbd65fd9c4
  • record id
    amp-feng-20261007-result-qtl-sqtl-nt-v2-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    8b8a4eab4481c6175365eade27e5343c0896568a2641163b6e4658adba87bd00
  • record id
    amp-feng-20261007-result-qtl-sqtl-sei-hidden-states-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    77f95e7524cae4e6d22653b61485cae231b2ac5bd4841f6d7836385d97ae406c
  • record id
    amp-feng-20261007-result-qtl-sqtl-sei-hidden-states-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    00acdc8cbfa3a3bdd2cf7791270013fbdccc78781d64f6ed9f7cef58b39f5bf2
  • record id
    amp-feng-20261007-result-qtl-sqtl-sei-output-tracks-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    0afb0ab6b016a6c7b24033209244f53f6cc478bc34d6fdf6b13b0bcb7f1be2ab
  • record id
    amp-feng-20261007-result-qtl-sqtl-sei-output-tracks-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    03f0cc3c95cd64d3df0fd68a71880f1ca1fc767444b22a72cb65efd364a70809
  • record id
    evidence-expansion-dna-foundation-models-2025-5d8ca9bc
    fields
    • status
    • attributes.artifact_sha256
    sha256
    7996f91821054e875cfca234e2e3bca2b25a02af92475d0577cd3dd0a71a8559
  • record id
    use-case-regulatory-variant-gene-follow-up
    fields
    • status
    • name
    • description
    • facets
    • attributes.question
    • attributes.decision
    • attributes.inputs
    • attributes.output
    • attributes.exclusions
    • attributes.setting
    • attributes.clinical_scope
    • attributes.intended_users
    sha256
    0071547e01ccaec30238aea9e4882dd92e6f51be9c967c7fb88bc61d2788b870
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.pins

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Rationale
sQTL causal-variant discrimination is a proxy for regulatory-variant gene follow-up prioritisation; it is not an experimentally validated follow-up choice and is a separate task from the other three QTL types.
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.rationale

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Reason
Re-reviewed after Feng et al. Supplementary Data 4 per-group evaluations were added on this protocol (PR #157); relevance unchanged. First added: Add Codex-checked primary-source protocol evidence from the bounded AMP intake (rewire.it#365).
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.reason

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Relevance
proxy
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.relevance

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: use-case-mapping-amp-20261007-feng-qtl-sqtl

field
links:assessed_by:amp-feng-20261007-protocol-qtl-sqtl
value
amp-feng-20261007-protocol-qtl-sqtl
relevance
proxy
endpoint
sQTL causal-versus-noncausal variant discrimination (AUC, Cohen's d) for twelve DNA foundation-model/genomic-comparator configurations
rationale
sQTL causal-variant discrimination is a proxy for regulatory-variant gene follow-up prioritisation; it is not an experimentally validated follow-up choice and is a separate task from the other three QTL types.
constraints
Inspect every linked evaluation's source locator and preserved conflicts before citing a result.; Do not combine this mapping's evaluations with any other protocol's results.
limitations
Post-window-filter per-model scored denominators are unreported for sQTL; the pre-filter positive count (540) is not a confirmed denominator.; AlphaGenome appears only in this QTL comparison, not the pathogenic/common SNP comparison. It uses the long-window QTL dataset, consuming central 131,072 bp and averaging output tracks over central 2,048 bp.; Sei, Enformer (hidden/output tracks) and AlphaGenome (output tracks) are non-DNA-foundation specialised genomic comparators per the source's own asterisk notation, not DNA foundation models.; Supplementary Data 4 gives each configuration's AUC on each of the three held-out chromosome groups. These are stored as separate per-group evaluations and excluded here, so each configuration is shown once, at the three-group mean the paper reports. The three group AUCs differ by 0.0085 to 0.0886 within a configuration; AlphaGenome output tracks rank first in every group.; No independent reproduction or qualified human scientific review.
revision
2
reason
Re-reviewed after Feng et al. Supplementary Data 4 per-group evaluations were added on this protocol (PR #157); relevance unchanged. First added: Add Codex-checked primary-source protocol evidence from the bounded AMP intake (rewire.it#365).
citation locators
source id: evidence-expansion-dna-foundation-models-2025-5d8ca9bc; locator: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/
source locator
evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/
review
method: ai-assisted-source-review; scope-review; method note: Re-review: checked the endpoint, relevance and limitations against the new per-group AUCs (Supplementary Data 4) and the Supplementary Data 4 legend; checked that the reviewed evaluations are unchanged and that each new per-group evaluation is excluded with a reason.; reviewer: claude; codex; claude-sonnet; reviewer note: Re-reviewed 2026-10-14 by an independent Claude (Opus 5.5) review agent for PR #157, separate from the extractor of the per-group results. First reviewed 2026-10-07: Claude Sonnet AMP-integration worker, bounded transcription of Codex-checked primary values; independently reviewed by Codex (workbench/amp-supervision/primary-review.md, integration-review-corrections.md). No human review claimed.; reviewed at: 2026-10-14T15:30:00Z; note: Bounded primary-source transcription, independently Codex-checked. No new model execution, independent experimental reproduction, qualified human scientific review or clinical validation. Re-review 2026-10-14: the proxy judgement still holds; per-group AUCs do not change the endpoint or the ranking of the top configuration. See docs/reviews/use-cases/feng-variant-effect-per-group-2026-10-14.md.
reviewed evaluations
amp-feng-20261007-eval-qtl-sqtl-alphagenome-output-tracks; amp-feng-20261007-eval-qtl-sqtl-caduceus-ph; amp-feng-20261007-eval-qtl-sqtl-caduceus-ph-long-sequence; amp-feng-20261007-eval-qtl-sqtl-dnabert-2; amp-feng-20261007-eval-qtl-sqtl-enformer-hidden-states; amp-feng-20261007-eval-qtl-sqtl-enformer-output-tracks; amp-feng-20261007-eval-qtl-sqtl-grover; amp-feng-20261007-eval-qtl-sqtl-hyenadna; amp-feng-20261007-eval-qtl-sqtl-hyenadna-450k-long-sequence; amp-feng-20261007-eval-qtl-sqtl-nt-v2; amp-feng-20261007-eval-qtl-sqtl-sei-hidden-states; amp-feng-20261007-eval-qtl-sqtl-sei-output-tracks
pins
record id: amp-feng-20261007-eval-qtl-sqtl-alphagenome-output-tracks; fields: status; links; attributes.origin; attributes.comparison; sha256: c7e92813f207dc4bab9a157b8707c75cbbc91130b698d5a27d15d1c680e4c132; record id: amp-feng-20261007-eval-qtl-sqtl-caduceus-ph; fields: status; links; attributes.origin; attributes.comparison; sha256: 72c69d8d49f08af0f43bfe19fe23f6d3131c874c6875fe54a579874e671760b7; record id: amp-feng-20261007-eval-qtl-sqtl-caduceus-ph-long-sequence; fields: status; links; attributes.origin; attributes.comparison; sha256: 77aba5c3899ee1a5a235132c8139e35b34df5eb206292d077ac04b10f065ceb9; record id: amp-feng-20261007-eval-qtl-sqtl-dnabert-2; fields: status; links; attributes.origin; attributes.comparison; sha256: 7097f98fafa75ff7929fc21d4f4d155b6e8445c1b300820120db248e30a0ab96; record id: amp-feng-20261007-eval-qtl-sqtl-enformer-hidden-states; fields: status; links; attributes.origin; attributes.comparison; sha256: f6a8d70d31bde826a1df5bed1fd395df8d065589756e0d54d0f66c872361582d; record id: amp-feng-20261007-eval-qtl-sqtl-enformer-output-tracks; fields: status; links; attributes.origin; attributes.comparison; sha256: 54300e55aa087190267d7087a2b2f4c8c00ed2e17b74c4711a6ade3ea5fee5e8; record id: amp-feng-20261007-eval-qtl-sqtl-grover; fields: status; links; attributes.origin; attributes.comparison; sha256: 75dd44ba9c8b86b3896142588d29d872cd9083751b039928d7a72f9d3bbe249a; record id: amp-feng-20261007-eval-qtl-sqtl-hyenadna; fields: status; links; attributes.origin; attributes.comparison; sha256: 3b5372d3f27c62ba553048e06ddf25beddf5e60f3c9020e54f6ec398168d6d57; record id: amp-feng-20261007-eval-qtl-sqtl-hyenadna-450k-long-sequence; fields: status; links; attributes.origin; attributes.comparison; sha256: c1a99bf8d7538e46b165629ecf090c10c46598f5b80807164f7ed6edb1e08eef; record id: amp-feng-20261007-eval-qtl-sqtl-nt-v2; fields: status; links; attributes.origin; attributes.comparison; sha256: ac7d7a0c05aceea674019ab49113552042e23d0f983957202d09a5ce2a65f481; record id: amp-feng-20261007-eval-qtl-sqtl-sei-hidden-states; fields: status; links; attributes.origin; attributes.comparison; sha256: 39b4b090492836a349c1cf146837f19dca700bc4bd2f8536bafb88e9f23b95d3; record id: amp-feng-20261007-eval-qtl-sqtl-sei-output-tracks; fields: status; links; attributes.origin; attributes.comparison; sha256: 89d381fb226def5bf1a2ccd742fb02b0efd936b6cece3f0bb56267833d055ba5; record id: amp-feng-20261007-protocol-qtl-sqtl; fields: status; name; description; facets; source_ids; links; attributes; sha256: f04174a31ebde4042854b2452384e0cea356d1e8c33f72cd0c06d0539fe8b43f; record id: amp-feng-20261007-result-qtl-sqtl-alphagenome-output-tracks-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 1f2048d034f4a5b1ff641b414758d12cf9f5c79a736a47c02cb47b3841b20650; record id: amp-feng-20261007-result-qtl-sqtl-alphagenome-output-tracks-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 36b9b5a9eb39e1cabc5f95b67df692be1a14226bd88af68d9a96ad34a976e194; record id: amp-feng-20261007-result-qtl-sqtl-caduceus-ph-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 991f3ee811367019a16b094bfb266f91734976ffbd4d6c64ea03136e1438400d; record id: amp-feng-20261007-result-qtl-sqtl-caduceus-ph-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 0960ef4f0d3df0dda788e1d40259d2184bdc5179e273c8a0d022d8258306f1bf; record id: amp-feng-20261007-result-qtl-sqtl-caduceus-ph-long-sequence-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 54d2e87c716522bd0edf33ede782aef9fe1d4f11fd1e52b286d8940c49f6bbfd; record id: amp-feng-20261007-result-qtl-sqtl-caduceus-ph-long-sequence-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 898f382086c0b4dbdee43f2d9ce83cbb918d70a3293fa3bb292ca6626a39c162; record id: amp-feng-20261007-result-qtl-sqtl-dnabert-2-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: f15d110deccf713f270f9ff12dcb452077d953c775d92d1f04a10c973997827d; record id: amp-feng-20261007-result-qtl-sqtl-dnabert-2-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 823ab3ef5eec3a42ecefc5c53ac001c6579edf10ce1879e74aa3be02a83fefca; record id: amp-feng-20261007-result-qtl-sqtl-enformer-hidden-states-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: b2de1b755982ce54f39607cf648bb832ca980615c06f3db6a3013d3d8325602f; record id: amp-feng-20261007-result-qtl-sqtl-enformer-hidden-states-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 5512a092928316dcff0a81acf82e02b7cc31da9312c2e1ae1ca0bc0f3875c75f; record id: amp-feng-20261007-result-qtl-sqtl-enformer-output-tracks-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 9c4fbf629d62311ced6a6cd5be6f5c457b16def93325c33903de49eb03ee9aaa; record id: amp-feng-20261007-result-qtl-sqtl-enformer-output-tracks-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 2f7f333b6090fd3f2be5fb0c35270fc54c880389a922124420fc58952cb43571; record id: amp-feng-20261007-result-qtl-sqtl-grover-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 6c8bc97e343d972f00b07e68d4452925270736c787f6242fe6a2f5f584bda3ec; record id: amp-feng-20261007-result-qtl-sqtl-grover-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 5c5061ad4f7a04f6323e8560e5fe3f1972568dd43de45222fb315b23c0d7567e; record id: amp-feng-20261007-result-qtl-sqtl-hyenadna-450k-long-sequence-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 8edfd142803f697e26aa05b47aa1b1d6d246745b12a76924a6bdb2a751217ea1; record id: amp-feng-20261007-result-qtl-sqtl-hyenadna-450k-long-sequence-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 3339edcd02af64fb33d06a887891682d431a76622ce021f70f012749e84530de; record id: amp-feng-20261007-result-qtl-sqtl-hyenadna-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 8ac1f6910ab3bfe76ad36c5e2ea4719a36c19517d1104bb108c2bdf9ac5e82ac; record id: amp-feng-20261007-result-qtl-sqtl-hyenadna-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: ee00be835aaeb183f19ca6f38090ab134b022dea3f1b469f7e9fecc420fcd57d; record id: amp-feng-20261007-result-qtl-sqtl-nt-v2-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 459ce69ce35ee3f33e49912941e6dbf172a80c506f0f3c4b1b4376bbd65fd9c4; record id: amp-feng-20261007-result-qtl-sqtl-nt-v2-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 8b8a4eab4481c6175365eade27e5343c0896568a2641163b6e4658adba87bd00; record id: amp-feng-20261007-result-qtl-sqtl-sei-hidden-states-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 77f95e7524cae4e6d22653b61485cae231b2ac5bd4841f6d7836385d97ae406c; record id: amp-feng-20261007-result-qtl-sqtl-sei-hidden-states-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 00acdc8cbfa3a3bdd2cf7791270013fbdccc78781d64f6ed9f7cef58b39f5bf2; record id: amp-feng-20261007-result-qtl-sqtl-sei-output-tracks-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 0afb0ab6b016a6c7b24033209244f53f6cc478bc34d6fdf6b13b0bcb7f1be2ab; record id: amp-feng-20261007-result-qtl-sqtl-sei-output-tracks-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 03f0cc3c95cd64d3df0fd68a71880f1ca1fc767444b22a72cb65efd364a70809; record id: evidence-expansion-dna-foundation-models-2025-5d8ca9bc; fields: status; attributes.artifact_sha256; sha256: 7996f91821054e875cfca234e2e3bca2b25a02af92475d0577cd3dd0a71a8559; record id: use-case-regulatory-variant-gene-follow-up; fields: status; name; description; facets; attributes.question; attributes.decision; attributes.inputs; attributes.output; attributes.exclusions; attributes.setting; attributes.clinical_scope; attributes.intended_users; sha256: 0071547e01ccaec30238aea9e4882dd92e6f51be9c967c7fb88bc61d2788b870
excluded evaluations
id: feng-dna-fm-20261014-eval-sd4-qtl-sqtl-alphagenome-output-tracks; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-sqtl-caduceus-ph; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-sqtl-caduceus-ph-long-sequence; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-sqtl-dnabert-2; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-sqtl-enformer-hidden-states; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-sqtl-enformer-output-tracks; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-sqtl-grover; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-sqtl-hyenadna; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-sqtl-hyenadna-450k-long-sequence; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-sqtl-nt-v2; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-sqtl-sei-hidden-states; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-sqtl-sei-output-tracks; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
Related records

Suggest a correction