rewirebio.iobenchmarks
Evidence claim

Relevance of Feng paQTL discrimination to "Select regulatory variants and genes for functional follow-up"

Use case
Select regulatory variants and genes for functional follow-up
Assessed by
Feng paQTL discrimination
Relevance
Proxy evidence
Endpoint
paQTL causal-versus-noncausal variant discrimination (AUC, Cohen's d) for twelve DNA foundation-model/genomic-comparator configurations

paQTL causal-variant discrimination is a proxy for regulatory-variant gene follow-up prioritisation; it is not an experimentally validated follow-up choice and is a separate task from the other three QTL types.

12 reviewed evaluations

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

16 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Citation locations
1 values
  • source id
    evidence-expansion-dna-foundation-models-2025-5d8ca9bc
    locator
    See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.citation_locators

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Constraints
2 values
  • Inspect every linked evaluation's source locator and preserved conflicts before citing a result.
  • Do not combine this mapping's evaluations with any other protocol's results.
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.constraints

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Endpoint
paQTL causal-versus-noncausal variant discrimination (AUC, Cohen's d) for twelve DNA foundation-model/genomic-comparator configurations
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.endpoint

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Excluded evaluations
12 values
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-paqtl-alphagenome-output-tracks
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-paqtl-caduceus-ph
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-paqtl-caduceus-ph-long-sequence
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-paqtl-dnabert-2
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-paqtl-enformer-hidden-states
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-paqtl-enformer-output-tracks
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-paqtl-grover
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-paqtl-hyenadna
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-paqtl-hyenadna-450k-long-sequence
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-paqtl-nt-v2
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-paqtl-sei-hidden-states
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-paqtl-sei-output-tracks
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.excluded_evaluations

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Claimed field
links:assessed_by:amp-feng-20261007-protocol-qtl-paqtl
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.field

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Limitations
5 values
  • Post-window-filter per-model scored denominators are unreported for paQTL; the pre-filter positive count (142) is not a confirmed denominator.
  • AlphaGenome appears only in this QTL comparison, not the pathogenic/common SNP comparison. It uses the long-window QTL dataset, consuming central 131,072 bp and averaging output tracks over central 2,048 bp.
  • Sei, Enformer (hidden/output tracks) and AlphaGenome (output tracks) are non-DNA-foundation specialised genomic comparators per the source's own asterisk notation, not DNA foundation models.
  • Supplementary Data 4 gives each configuration's AUC on each of the three held-out chromosome groups. These are stored as separate per-group evaluations and excluded here, so each configuration is shown once, at the three-group mean the paper reports. The source notes 'notable differences between different test sets for paQTL and ipaQTL': the three group AUCs differ by up to 0.1714 within a configuration (AlphaGenome output tracks 0.6781 to 0.8495), so differences between configurations' means of a few hundredths should be read with that spread in mind. AlphaGenome output tracks rank first in every group.
  • No independent reproduction or qualified human scientific review.
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.limitations

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Pinned records
39 values
  • record id
    amp-feng-20261007-eval-qtl-paqtl-alphagenome-output-tracks
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    7e487be16aaddda520a7b9034cf72dac09602218faae8cb0ffc024b4876ef0cc
  • record id
    amp-feng-20261007-eval-qtl-paqtl-caduceus-ph
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    1b07aa1c69b8c5593cfde834c0dd321e562c6a326c3f4be02d34938102b88197
  • record id
    amp-feng-20261007-eval-qtl-paqtl-caduceus-ph-long-sequence
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    50e2514af4034cdd930ac8fb7cb3a842595659c03109020f42abe844a05ce6c8
  • record id
    amp-feng-20261007-eval-qtl-paqtl-dnabert-2
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    596ef512ec1002edba11c6db7f9873b2fbbe17c102268d350c9b163c7ae4dfee
  • record id
    amp-feng-20261007-eval-qtl-paqtl-enformer-hidden-states
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    f94bf81e95d8b49c713148133f83db8f216f3ee4a2c0248335fc6c00b5de1648
  • record id
    amp-feng-20261007-eval-qtl-paqtl-enformer-output-tracks
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    b90c4af77b07a98f6eb8b389f4d682795ebaa8939d0671d586891f3acd0ff379
  • record id
    amp-feng-20261007-eval-qtl-paqtl-grover
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    b28361b530cdf98c920e392f513a68fa26afa43dd75a98d08ec80535d6a43872
  • record id
    amp-feng-20261007-eval-qtl-paqtl-hyenadna
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    462b6a221a0b2884f9514f27280f4de8be80cfdd77cf7a22a7d97460961e2a90
  • record id
    amp-feng-20261007-eval-qtl-paqtl-hyenadna-450k-long-sequence
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    a5967a6d98b323c6c7d1e154e9aa77a99511a4f978ae4b6fd4e6cdcd45e97a92
  • record id
    amp-feng-20261007-eval-qtl-paqtl-nt-v2
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    058c8f4f3e250b8a63c95fe1cf19054a17de75f733d02c10da2b41b1431c3915
  • record id
    amp-feng-20261007-eval-qtl-paqtl-sei-hidden-states
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    787def68f895623728de184197c6e91293fa4146a6c072515a73ae6aa02badb2
  • record id
    amp-feng-20261007-eval-qtl-paqtl-sei-output-tracks
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    2ed01ca5142b1e3becd30f0da0f73d5ac8c485d95c2360e099f1eeb81ea70fc8
  • record id
    amp-feng-20261007-protocol-qtl-paqtl
    fields
    • status
    • name
    • description
    • facets
    • source_ids
    • links
    • attributes
    sha256
    c5ca196088deea1b1fcc8ed1fd9a281a76eca037422cbe555550fc4f7ae0e338
  • record id
    amp-feng-20261007-result-qtl-paqtl-alphagenome-output-tracks-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    433fbc9ab6e9966d28ccdf79d69fb5b818ed8f8490e1c18ab19257726f1f6989
  • record id
    amp-feng-20261007-result-qtl-paqtl-alphagenome-output-tracks-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    d9bed5b7ccfa156943f1025fa9462bb90cb7648264be6de08a649e88f1b85f24
  • record id
    amp-feng-20261007-result-qtl-paqtl-caduceus-ph-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    18a242593c45ee04495ed6b17019ff8e08daeb1c6e226325606e35aa92253b3c
  • record id
    amp-feng-20261007-result-qtl-paqtl-caduceus-ph-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    1c9eface11ea4233b79bfdb144a5c49d318715abbf7a2c817e42fba3f8b76eb6
  • record id
    amp-feng-20261007-result-qtl-paqtl-caduceus-ph-long-sequence-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    a1ec82de025bf76c02f2280199ff33b6ed2e021c15e10fadd4700dc98074b946
  • record id
    amp-feng-20261007-result-qtl-paqtl-caduceus-ph-long-sequence-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    f717c402b4898c6f1b10a96c64fb8edf3ab2728d57cef762a0e6a2289944dfc8
  • record id
    amp-feng-20261007-result-qtl-paqtl-dnabert-2-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    cdca215239cbcfd82012cb83ac57b5b73d0c7665101f7954bba48d8626462e1a
  • record id
    amp-feng-20261007-result-qtl-paqtl-dnabert-2-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    2aea6c76ebbe4adeb60adcad10fca038e7e341e0551c28d71dc290d79de24a8c
  • record id
    amp-feng-20261007-result-qtl-paqtl-enformer-hidden-states-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    560c7a721ce4e3a67eba18c99497245354e70e32e073d86889c3771289142fd8
  • record id
    amp-feng-20261007-result-qtl-paqtl-enformer-hidden-states-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    2faba9582d562243575f80365761bf5c21dba00038be8baa906d3c54e9856e9b
  • record id
    amp-feng-20261007-result-qtl-paqtl-enformer-output-tracks-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    24405f3698d5d19fc4ad585c2b6b6ab5c6278415ee2aa17f663f8837a61d8661
  • record id
    amp-feng-20261007-result-qtl-paqtl-enformer-output-tracks-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    2e78fd845e092babd41240f9a55f901347dab81e270d84f33de9d83545f94d9c
  • record id
    amp-feng-20261007-result-qtl-paqtl-grover-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    cf42a116be4fde77db02510a28052990091495a1b75761ce8ec53c6bd6c25f9a
  • record id
    amp-feng-20261007-result-qtl-paqtl-grover-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    9c18a080a39a2a3a726f535777c75fd3006cbb6cf4749532814ea6223598c759
  • record id
    amp-feng-20261007-result-qtl-paqtl-hyenadna-450k-long-sequence-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    f6a8f142d1c6319d66f7274a6e0c2ccaca17d670de9de53bd486e1e75822d0d1
  • record id
    amp-feng-20261007-result-qtl-paqtl-hyenadna-450k-long-sequence-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    b5a3923d312c7d12e6661fc2afdc1ecfce36f0ca1e46a029be52da678ec62d4d
  • record id
    amp-feng-20261007-result-qtl-paqtl-hyenadna-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    dbc164d1d43b243546c0f3eb600c0649d2c50cda2510133f0e3fbeaa95c8b65b
  • record id
    amp-feng-20261007-result-qtl-paqtl-hyenadna-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    e8f599b77526bf178d96703a2ac02d0db837ffa3201ac3d42f0241682ff211c3
  • record id
    amp-feng-20261007-result-qtl-paqtl-nt-v2-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    9423e8944044cb963510068ef491679174cd6896c564d29c0a5a81877977e523
  • record id
    amp-feng-20261007-result-qtl-paqtl-nt-v2-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    9902294e5d811603405fdb7d17b90dfd1999084715c2db13244c70e05e719d77
  • record id
    amp-feng-20261007-result-qtl-paqtl-sei-hidden-states-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    6032feaf23fbc2df8228a8de47230c7c57fbbd2636f9ef22079ac8c4990ef59d
  • record id
    amp-feng-20261007-result-qtl-paqtl-sei-hidden-states-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    afcf4467c7ddec510452b4c39df6faef153389eba5ade8f01b38c64e58978259
  • record id
    amp-feng-20261007-result-qtl-paqtl-sei-output-tracks-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    6e271ffcf35018ddc79f2382b551f4e1e7e02dbd450e8db726bc2bc8c0ad0ae9
  • record id
    amp-feng-20261007-result-qtl-paqtl-sei-output-tracks-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    287ce0764d9141f8af6529fc8bc4ca025d5cd8896cfa60d6bcf1514bb6571a99
  • record id
    evidence-expansion-dna-foundation-models-2025-5d8ca9bc
    fields
    • status
    • attributes.artifact_sha256
    sha256
    7996f91821054e875cfca234e2e3bca2b25a02af92475d0577cd3dd0a71a8559
  • record id
    use-case-regulatory-variant-gene-follow-up
    fields
    • status
    • name
    • description
    • facets
    • attributes.question
    • attributes.decision
    • attributes.inputs
    • attributes.output
    • attributes.exclusions
    • attributes.setting
    • attributes.clinical_scope
    • attributes.intended_users
    sha256
    0071547e01ccaec30238aea9e4882dd92e6f51be9c967c7fb88bc61d2788b870
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.pins

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Rationale
paQTL causal-variant discrimination is a proxy for regulatory-variant gene follow-up prioritisation; it is not an experimentally validated follow-up choice and is a separate task from the other three QTL types.
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.rationale

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Reason
Re-reviewed after Feng et al. Supplementary Data 4 per-group evaluations were added on this protocol (PR #157); relevance unchanged. First added: Add Codex-checked primary-source protocol evidence from the bounded AMP intake (rewire.it#365).
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.reason

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Relevance
proxy
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.relevance

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: use-case-mapping-amp-20261007-feng-qtl-paqtl

field
links:assessed_by:amp-feng-20261007-protocol-qtl-paqtl
value
amp-feng-20261007-protocol-qtl-paqtl
relevance
proxy
endpoint
paQTL causal-versus-noncausal variant discrimination (AUC, Cohen's d) for twelve DNA foundation-model/genomic-comparator configurations
rationale
paQTL causal-variant discrimination is a proxy for regulatory-variant gene follow-up prioritisation; it is not an experimentally validated follow-up choice and is a separate task from the other three QTL types.
constraints
Inspect every linked evaluation's source locator and preserved conflicts before citing a result.; Do not combine this mapping's evaluations with any other protocol's results.
limitations
Post-window-filter per-model scored denominators are unreported for paQTL; the pre-filter positive count (142) is not a confirmed denominator.; AlphaGenome appears only in this QTL comparison, not the pathogenic/common SNP comparison. It uses the long-window QTL dataset, consuming central 131,072 bp and averaging output tracks over central 2,048 bp.; Sei, Enformer (hidden/output tracks) and AlphaGenome (output tracks) are non-DNA-foundation specialised genomic comparators per the source's own asterisk notation, not DNA foundation models.; Supplementary Data 4 gives each configuration's AUC on each of the three held-out chromosome groups. These are stored as separate per-group evaluations and excluded here, so each configuration is shown once, at the three-group mean the paper reports. The source notes 'notable differences between different test sets for paQTL and ipaQTL': the three group AUCs differ by up to 0.1714 within a configuration (AlphaGenome output tracks 0.6781 to 0.8495), so differences between configurations' means of a few hundredths should be read with that spread in mind. AlphaGenome output tracks rank first in every group.; No independent reproduction or qualified human scientific review.
revision
2
reason
Re-reviewed after Feng et al. Supplementary Data 4 per-group evaluations were added on this protocol (PR #157); relevance unchanged. First added: Add Codex-checked primary-source protocol evidence from the bounded AMP intake (rewire.it#365).
citation locators
source id: evidence-expansion-dna-foundation-models-2025-5d8ca9bc; locator: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/
source locator
evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/
review
method: ai-assisted-source-review; scope-review; method note: Re-review: checked the endpoint, relevance and limitations against the new per-group AUCs (Supplementary Data 4) and the Supplementary Data 4 legend; checked that the reviewed evaluations are unchanged and that each new per-group evaluation is excluded with a reason.; reviewer: claude; codex; claude-sonnet; reviewer note: Re-reviewed 2026-10-14 by an independent Claude (Opus 5.5) review agent for PR #157, separate from the extractor of the per-group results. First reviewed 2026-10-07: Claude Sonnet AMP-integration worker, bounded transcription of Codex-checked primary values; independently reviewed by Codex (workbench/amp-supervision/primary-review.md, integration-review-corrections.md). No human review claimed.; reviewed at: 2026-10-14T15:30:00Z; note: Bounded primary-source transcription, independently Codex-checked. No new model execution, independent experimental reproduction, qualified human scientific review or clinical validation. Re-review 2026-10-14: the proxy judgement still holds; per-group AUCs do not change the endpoint or the ranking of the top configuration. See docs/reviews/use-cases/feng-variant-effect-per-group-2026-10-14.md.
reviewed evaluations
amp-feng-20261007-eval-qtl-paqtl-alphagenome-output-tracks; amp-feng-20261007-eval-qtl-paqtl-caduceus-ph; amp-feng-20261007-eval-qtl-paqtl-caduceus-ph-long-sequence; amp-feng-20261007-eval-qtl-paqtl-dnabert-2; amp-feng-20261007-eval-qtl-paqtl-enformer-hidden-states; amp-feng-20261007-eval-qtl-paqtl-enformer-output-tracks; amp-feng-20261007-eval-qtl-paqtl-grover; amp-feng-20261007-eval-qtl-paqtl-hyenadna; amp-feng-20261007-eval-qtl-paqtl-hyenadna-450k-long-sequence; amp-feng-20261007-eval-qtl-paqtl-nt-v2; amp-feng-20261007-eval-qtl-paqtl-sei-hidden-states; amp-feng-20261007-eval-qtl-paqtl-sei-output-tracks
pins
record id: amp-feng-20261007-eval-qtl-paqtl-alphagenome-output-tracks; fields: status; links; attributes.origin; attributes.comparison; sha256: 7e487be16aaddda520a7b9034cf72dac09602218faae8cb0ffc024b4876ef0cc; record id: amp-feng-20261007-eval-qtl-paqtl-caduceus-ph; fields: status; links; attributes.origin; attributes.comparison; sha256: 1b07aa1c69b8c5593cfde834c0dd321e562c6a326c3f4be02d34938102b88197; record id: amp-feng-20261007-eval-qtl-paqtl-caduceus-ph-long-sequence; fields: status; links; attributes.origin; attributes.comparison; sha256: 50e2514af4034cdd930ac8fb7cb3a842595659c03109020f42abe844a05ce6c8; record id: amp-feng-20261007-eval-qtl-paqtl-dnabert-2; fields: status; links; attributes.origin; attributes.comparison; sha256: 596ef512ec1002edba11c6db7f9873b2fbbe17c102268d350c9b163c7ae4dfee; record id: amp-feng-20261007-eval-qtl-paqtl-enformer-hidden-states; fields: status; links; attributes.origin; attributes.comparison; sha256: f94bf81e95d8b49c713148133f83db8f216f3ee4a2c0248335fc6c00b5de1648; record id: amp-feng-20261007-eval-qtl-paqtl-enformer-output-tracks; fields: status; links; attributes.origin; attributes.comparison; sha256: b90c4af77b07a98f6eb8b389f4d682795ebaa8939d0671d586891f3acd0ff379; record id: amp-feng-20261007-eval-qtl-paqtl-grover; fields: status; links; attributes.origin; attributes.comparison; sha256: b28361b530cdf98c920e392f513a68fa26afa43dd75a98d08ec80535d6a43872; record id: amp-feng-20261007-eval-qtl-paqtl-hyenadna; fields: status; links; attributes.origin; attributes.comparison; sha256: 462b6a221a0b2884f9514f27280f4de8be80cfdd77cf7a22a7d97460961e2a90; record id: amp-feng-20261007-eval-qtl-paqtl-hyenadna-450k-long-sequence; fields: status; links; attributes.origin; attributes.comparison; sha256: a5967a6d98b323c6c7d1e154e9aa77a99511a4f978ae4b6fd4e6cdcd45e97a92; record id: amp-feng-20261007-eval-qtl-paqtl-nt-v2; fields: status; links; attributes.origin; attributes.comparison; sha256: 058c8f4f3e250b8a63c95fe1cf19054a17de75f733d02c10da2b41b1431c3915; record id: amp-feng-20261007-eval-qtl-paqtl-sei-hidden-states; fields: status; links; attributes.origin; attributes.comparison; sha256: 787def68f895623728de184197c6e91293fa4146a6c072515a73ae6aa02badb2; record id: amp-feng-20261007-eval-qtl-paqtl-sei-output-tracks; fields: status; links; attributes.origin; attributes.comparison; sha256: 2ed01ca5142b1e3becd30f0da0f73d5ac8c485d95c2360e099f1eeb81ea70fc8; record id: amp-feng-20261007-protocol-qtl-paqtl; fields: status; name; description; facets; source_ids; links; attributes; sha256: c5ca196088deea1b1fcc8ed1fd9a281a76eca037422cbe555550fc4f7ae0e338; record id: amp-feng-20261007-result-qtl-paqtl-alphagenome-output-tracks-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 433fbc9ab6e9966d28ccdf79d69fb5b818ed8f8490e1c18ab19257726f1f6989; record id: amp-feng-20261007-result-qtl-paqtl-alphagenome-output-tracks-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: d9bed5b7ccfa156943f1025fa9462bb90cb7648264be6de08a649e88f1b85f24; record id: amp-feng-20261007-result-qtl-paqtl-caduceus-ph-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 18a242593c45ee04495ed6b17019ff8e08daeb1c6e226325606e35aa92253b3c; record id: amp-feng-20261007-result-qtl-paqtl-caduceus-ph-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 1c9eface11ea4233b79bfdb144a5c49d318715abbf7a2c817e42fba3f8b76eb6; record id: amp-feng-20261007-result-qtl-paqtl-caduceus-ph-long-sequence-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: a1ec82de025bf76c02f2280199ff33b6ed2e021c15e10fadd4700dc98074b946; record id: amp-feng-20261007-result-qtl-paqtl-caduceus-ph-long-sequence-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: f717c402b4898c6f1b10a96c64fb8edf3ab2728d57cef762a0e6a2289944dfc8; record id: amp-feng-20261007-result-qtl-paqtl-dnabert-2-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: cdca215239cbcfd82012cb83ac57b5b73d0c7665101f7954bba48d8626462e1a; record id: amp-feng-20261007-result-qtl-paqtl-dnabert-2-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 2aea6c76ebbe4adeb60adcad10fca038e7e341e0551c28d71dc290d79de24a8c; record id: amp-feng-20261007-result-qtl-paqtl-enformer-hidden-states-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 560c7a721ce4e3a67eba18c99497245354e70e32e073d86889c3771289142fd8; record id: amp-feng-20261007-result-qtl-paqtl-enformer-hidden-states-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 2faba9582d562243575f80365761bf5c21dba00038be8baa906d3c54e9856e9b; record id: amp-feng-20261007-result-qtl-paqtl-enformer-output-tracks-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 24405f3698d5d19fc4ad585c2b6b6ab5c6278415ee2aa17f663f8837a61d8661; record id: amp-feng-20261007-result-qtl-paqtl-enformer-output-tracks-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 2e78fd845e092babd41240f9a55f901347dab81e270d84f33de9d83545f94d9c; record id: amp-feng-20261007-result-qtl-paqtl-grover-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: cf42a116be4fde77db02510a28052990091495a1b75761ce8ec53c6bd6c25f9a; record id: amp-feng-20261007-result-qtl-paqtl-grover-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 9c18a080a39a2a3a726f535777c75fd3006cbb6cf4749532814ea6223598c759; record id: amp-feng-20261007-result-qtl-paqtl-hyenadna-450k-long-sequence-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: f6a8f142d1c6319d66f7274a6e0c2ccaca17d670de9de53bd486e1e75822d0d1; record id: amp-feng-20261007-result-qtl-paqtl-hyenadna-450k-long-sequence-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: b5a3923d312c7d12e6661fc2afdc1ecfce36f0ca1e46a029be52da678ec62d4d; record id: amp-feng-20261007-result-qtl-paqtl-hyenadna-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: dbc164d1d43b243546c0f3eb600c0649d2c50cda2510133f0e3fbeaa95c8b65b; record id: amp-feng-20261007-result-qtl-paqtl-hyenadna-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: e8f599b77526bf178d96703a2ac02d0db837ffa3201ac3d42f0241682ff211c3; record id: amp-feng-20261007-result-qtl-paqtl-nt-v2-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 9423e8944044cb963510068ef491679174cd6896c564d29c0a5a81877977e523; record id: amp-feng-20261007-result-qtl-paqtl-nt-v2-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 9902294e5d811603405fdb7d17b90dfd1999084715c2db13244c70e05e719d77; record id: amp-feng-20261007-result-qtl-paqtl-sei-hidden-states-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 6032feaf23fbc2df8228a8de47230c7c57fbbd2636f9ef22079ac8c4990ef59d; record id: amp-feng-20261007-result-qtl-paqtl-sei-hidden-states-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: afcf4467c7ddec510452b4c39df6faef153389eba5ade8f01b38c64e58978259; record id: amp-feng-20261007-result-qtl-paqtl-sei-output-tracks-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 6e271ffcf35018ddc79f2382b551f4e1e7e02dbd450e8db726bc2bc8c0ad0ae9; record id: amp-feng-20261007-result-qtl-paqtl-sei-output-tracks-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 287ce0764d9141f8af6529fc8bc4ca025d5cd8896cfa60d6bcf1514bb6571a99; record id: evidence-expansion-dna-foundation-models-2025-5d8ca9bc; fields: status; attributes.artifact_sha256; sha256: 7996f91821054e875cfca234e2e3bca2b25a02af92475d0577cd3dd0a71a8559; record id: use-case-regulatory-variant-gene-follow-up; fields: status; name; description; facets; attributes.question; attributes.decision; attributes.inputs; attributes.output; attributes.exclusions; attributes.setting; attributes.clinical_scope; attributes.intended_users; sha256: 0071547e01ccaec30238aea9e4882dd92e6f51be9c967c7fb88bc61d2788b870
excluded evaluations
id: feng-dna-fm-20261014-eval-sd4-qtl-paqtl-alphagenome-output-tracks; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-paqtl-caduceus-ph; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-paqtl-caduceus-ph-long-sequence; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-paqtl-dnabert-2; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-paqtl-enformer-hidden-states; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-paqtl-enformer-output-tracks; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-paqtl-grover; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-paqtl-hyenadna; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-paqtl-hyenadna-450k-long-sequence; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-paqtl-nt-v2; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-paqtl-sei-hidden-states; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-paqtl-sei-output-tracks; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
Related records

Suggest a correction