rewirebio.iobenchmarks
Evidence claim

Relevance of Feng ipaQTL discrimination to "Select regulatory variants and genes for functional follow-up"

Use case
Select regulatory variants and genes for functional follow-up
Assessed by
Feng ipaQTL discrimination
Relevance
Proxy evidence
Endpoint
ipaQTL causal-versus-noncausal variant discrimination (AUC, Cohen's d) for twelve DNA foundation-model/genomic-comparator configurations

ipaQTL causal-variant discrimination is a proxy for regulatory-variant gene follow-up prioritisation; it is not an experimentally validated follow-up choice and is a separate task from the other three QTL types.

12 reviewed evaluations

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

16 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Citation locations
1 values
  • source id
    evidence-expansion-dna-foundation-models-2025-5d8ca9bc
    locator
    See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.citation_locators

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Constraints
2 values
  • Inspect every linked evaluation's source locator and preserved conflicts before citing a result.
  • Do not combine this mapping's evaluations with any other protocol's results.
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.constraints

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Endpoint
ipaQTL causal-versus-noncausal variant discrimination (AUC, Cohen's d) for twelve DNA foundation-model/genomic-comparator configurations
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.endpoint

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Excluded evaluations
12 values
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-ipaqtl-alphagenome-output-tracks
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-ipaqtl-caduceus-ph
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-ipaqtl-caduceus-ph-long-sequence
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-ipaqtl-dnabert-2
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-ipaqtl-enformer-hidden-states
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-ipaqtl-enformer-output-tracks
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-ipaqtl-grover
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-ipaqtl-hyenadna
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-ipaqtl-hyenadna-450k-long-sequence
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-ipaqtl-nt-v2
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-ipaqtl-sei-hidden-states
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
  • id
    feng-dna-fm-20261014-eval-sd4-qtl-ipaqtl-sei-output-tracks
    reason
    Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.excluded_evaluations

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Claimed field
links:assessed_by:amp-feng-20261007-protocol-qtl-ipaqtl
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.field

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Limitations
5 values
  • Post-window-filter per-model scored denominators are unreported for ipaQTL; the pre-filter positive count (116) is not a confirmed denominator.
  • AlphaGenome appears only in this QTL comparison, not the pathogenic/common SNP comparison. It uses the long-window QTL dataset, consuming central 131,072 bp and averaging output tracks over central 2,048 bp.
  • Sei, Enformer (hidden/output tracks) and AlphaGenome (output tracks) are non-DNA-foundation specialised genomic comparators per the source's own asterisk notation, not DNA foundation models.
  • Supplementary Data 4 gives each configuration's AUC on each of the three held-out chromosome groups. These are stored as separate per-group evaluations and excluded here, so each configuration is shown once, at the three-group mean the paper reports. The source notes 'notable differences between different test sets for paQTL and ipaQTL': the three group AUCs differ by up to 0.1719 within a configuration (Sei output tracks 0.5469 to 0.7188), so differences between configurations' means of a few hundredths should be read with that spread in mind. AlphaGenome output tracks rank first in every group.
  • No independent reproduction or qualified human scientific review.
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.limitations

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Pinned records
39 values
  • record id
    amp-feng-20261007-eval-qtl-ipaqtl-alphagenome-output-tracks
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    f748c05ba0d6e631e1de028cdd05f1c6df652c9ee90c865004711212df1ae784
  • record id
    amp-feng-20261007-eval-qtl-ipaqtl-caduceus-ph
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    c97f103631c10e14d14833748d597e0502fc913aaeaf3cea622d9d792e316a7a
  • record id
    amp-feng-20261007-eval-qtl-ipaqtl-caduceus-ph-long-sequence
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    aa66a6c399ba1ccf0fa23f5b7b374fb274e09f7095235888365856d52a45cd30
  • record id
    amp-feng-20261007-eval-qtl-ipaqtl-dnabert-2
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    e8316a680fa9bc5fe03e0109064024821dc659c4802355490ac7f0f26c690523
  • record id
    amp-feng-20261007-eval-qtl-ipaqtl-enformer-hidden-states
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    902da0c974f6f6c9dd643eb2dabe88bc0fabe01a2c0322eeca351b25ed1f35ef
  • record id
    amp-feng-20261007-eval-qtl-ipaqtl-enformer-output-tracks
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    d624b0dba5c8c22b62a9829eb7e6808b108f907d694bf67b20db15af6ed4391f
  • record id
    amp-feng-20261007-eval-qtl-ipaqtl-grover
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    afa57766a0c6d57da1155897586418b243b6dc4bb3f9af63e2f0e7eaa8b570e5
  • record id
    amp-feng-20261007-eval-qtl-ipaqtl-hyenadna
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    e5645ab745962eea5ef0794c6cb95202396a2ff9058675c67402442fc6111e88
  • record id
    amp-feng-20261007-eval-qtl-ipaqtl-hyenadna-450k-long-sequence
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    b3ad52323785c4051845fb5b4d0a9548b1e00aee25ed3555e88bad4a8e332ea3
  • record id
    amp-feng-20261007-eval-qtl-ipaqtl-nt-v2
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    43b3a6f418f3090a66695fcba828c26d3b32b93c67abf0cb0ae95b300bc44f23
  • record id
    amp-feng-20261007-eval-qtl-ipaqtl-sei-hidden-states
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    cd93a0a76efc335ccf4aa3aa9cbd5725425795667acec0936fc8dfdd4c4da65e
  • record id
    amp-feng-20261007-eval-qtl-ipaqtl-sei-output-tracks
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    48d73f6f41aa8085522d32d650cf6eaa4c342df2569a9ea270f27692d80a8034
  • record id
    amp-feng-20261007-protocol-qtl-ipaqtl
    fields
    • status
    • name
    • description
    • facets
    • source_ids
    • links
    • attributes
    sha256
    3dcc70cb389bfd78a21289b9ca1d5caadca1c847071838f029ed2730a7f6c7b6
  • record id
    amp-feng-20261007-result-qtl-ipaqtl-alphagenome-output-tracks-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    390b7fd31ee7383d66abb69534ddfe53e0f1d5eeb3d29d3d1c427fe4b071182c
  • record id
    amp-feng-20261007-result-qtl-ipaqtl-alphagenome-output-tracks-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    1a7a6daab3fa6e71e6bbad929a5f3fa81a35334e19dc4202c40385dce0709a7c
  • record id
    amp-feng-20261007-result-qtl-ipaqtl-caduceus-ph-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    c3c2ceaef44bc050ff04cdc898a51761a4019d41f1693507612ea7670bccf8ad
  • record id
    amp-feng-20261007-result-qtl-ipaqtl-caduceus-ph-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    c343237bb89ee538b66077549e3f53d585a2b4864f2dc63de956f6b7c5ea274e
  • record id
    amp-feng-20261007-result-qtl-ipaqtl-caduceus-ph-long-sequence-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    bdd3eeb790d88ece7bf59500e3d5df5b4918fd45467398e4ae1441a31cc0e59c
  • record id
    amp-feng-20261007-result-qtl-ipaqtl-caduceus-ph-long-sequence-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    925e2277b8c8ab852312ea51131dcb6aea93831baa048c77ab8018813ae0aee6
  • record id
    amp-feng-20261007-result-qtl-ipaqtl-dnabert-2-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    2a3188ad2218940e7b18df05764342b1c25b34acbc1d523154184d25e7b91b0a
  • record id
    amp-feng-20261007-result-qtl-ipaqtl-dnabert-2-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    ed2515c3880ce80878f953f2225010a56f132daef1088190cfd70e4efc3fcca8
  • record id
    amp-feng-20261007-result-qtl-ipaqtl-enformer-hidden-states-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    650e912b7b9431cc1b3d5f122518144b7175aaaf58f88f6fef4f95df83f707fd
  • record id
    amp-feng-20261007-result-qtl-ipaqtl-enformer-hidden-states-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    dd96e74d66f70a023e4047dec8736984c978885b1b2f37403f3969c4661f7767
  • record id
    amp-feng-20261007-result-qtl-ipaqtl-enformer-output-tracks-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    9eec6a8896ede98afea349a557b076268b70ebc5882b6f0d401339cde46ae1b6
  • record id
    amp-feng-20261007-result-qtl-ipaqtl-enformer-output-tracks-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    30784a6ca3131e508cddab1baddb4daa41f0f381db2371aac37129745baea2f8
  • record id
    amp-feng-20261007-result-qtl-ipaqtl-grover-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    e3096dee74a3ce6d098e184f50b9d08fe8834e3a869d33a4170ed760ba394d9c
  • record id
    amp-feng-20261007-result-qtl-ipaqtl-grover-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    ea7b3a61d69e1062cb605e5f878ae6a6054043b2cb181c031c569623efce66ed
  • record id
    amp-feng-20261007-result-qtl-ipaqtl-hyenadna-450k-long-sequence-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    883c3a7e9b510072b13438684b249d35822eff1f6fbe0d3d233ca69b379c780d
  • record id
    amp-feng-20261007-result-qtl-ipaqtl-hyenadna-450k-long-sequence-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    d4834b155a09a544fdcfa10377b72805e517432c6aac7a8ceca5a8f37a4fc386
  • record id
    amp-feng-20261007-result-qtl-ipaqtl-hyenadna-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    e57307337bbabf5888a8bdc3e898688c72ec9dd7c8efea26cd0537a4393de56b
  • record id
    amp-feng-20261007-result-qtl-ipaqtl-hyenadna-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    63f5a09b3f56e606f2015b9175a0f72b2a0cc7750892940c6012a4dfe93f0282
  • record id
    amp-feng-20261007-result-qtl-ipaqtl-nt-v2-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    5a13052a3617207282287fdfe0c22cdc48cb00d21cb18fb9322aa555826d7e78
  • record id
    amp-feng-20261007-result-qtl-ipaqtl-nt-v2-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    4b12357a1b904b9df746c1473a7c9a43c2b4ce08d9b95bac5c97c9cc556f9b90
  • record id
    amp-feng-20261007-result-qtl-ipaqtl-sei-hidden-states-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    3034d32450ff97252962ba1eb0c83f88619a19eff0f154a12adc2b9c6450e477
  • record id
    amp-feng-20261007-result-qtl-ipaqtl-sei-hidden-states-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    9397c5ef9c75961414361b436d60f9ae78532740ee0ccf783b4df955a8ed929f
  • record id
    amp-feng-20261007-result-qtl-ipaqtl-sei-output-tracks-auc
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    061a61f3ccb361327d249e1431005f4f7e75057831de7f0cfd5fe320cd763a91
  • record id
    amp-feng-20261007-result-qtl-ipaqtl-sei-output-tracks-cohen-s-d
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    61c8fa5412828c5c5a63c4f7e645b010f141b33ae470d86bd0d8e794acd15bd8
  • record id
    evidence-expansion-dna-foundation-models-2025-5d8ca9bc
    fields
    • status
    • attributes.artifact_sha256
    sha256
    7996f91821054e875cfca234e2e3bca2b25a02af92475d0577cd3dd0a71a8559
  • record id
    use-case-regulatory-variant-gene-follow-up
    fields
    • status
    • name
    • description
    • facets
    • attributes.question
    • attributes.decision
    • attributes.inputs
    • attributes.output
    • attributes.exclusions
    • attributes.setting
    • attributes.clinical_scope
    • attributes.intended_users
    sha256
    0071547e01ccaec30238aea9e4882dd92e6f51be9c967c7fb88bc61d2788b870
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.pins

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Rationale
ipaQTL causal-variant discrimination is a proxy for regulatory-variant gene follow-up prioritisation; it is not an experimentally validated follow-up choice and is a separate task from the other three QTL types.
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.rationale

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Reason
Re-reviewed after Feng et al. Supplementary Data 4 per-group evaluations were added on this protocol (PR #157); relevance unchanged. First added: Add Codex-checked primary-source protocol evidence from the bounded AMP intake (rewire.it#365).
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.reason

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Relevance
proxy
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.relevance

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: use-case-mapping-amp-20261007-feng-qtl-ipaqtl

field
links:assessed_by:amp-feng-20261007-protocol-qtl-ipaqtl
value
amp-feng-20261007-protocol-qtl-ipaqtl
relevance
proxy
endpoint
ipaQTL causal-versus-noncausal variant discrimination (AUC, Cohen's d) for twelve DNA foundation-model/genomic-comparator configurations
rationale
ipaQTL causal-variant discrimination is a proxy for regulatory-variant gene follow-up prioritisation; it is not an experimentally validated follow-up choice and is a separate task from the other three QTL types.
constraints
Inspect every linked evaluation's source locator and preserved conflicts before citing a result.; Do not combine this mapping's evaluations with any other protocol's results.
limitations
Post-window-filter per-model scored denominators are unreported for ipaQTL; the pre-filter positive count (116) is not a confirmed denominator.; AlphaGenome appears only in this QTL comparison, not the pathogenic/common SNP comparison. It uses the long-window QTL dataset, consuming central 131,072 bp and averaging output tracks over central 2,048 bp.; Sei, Enformer (hidden/output tracks) and AlphaGenome (output tracks) are non-DNA-foundation specialised genomic comparators per the source's own asterisk notation, not DNA foundation models.; Supplementary Data 4 gives each configuration's AUC on each of the three held-out chromosome groups. These are stored as separate per-group evaluations and excluded here, so each configuration is shown once, at the three-group mean the paper reports. The source notes 'notable differences between different test sets for paQTL and ipaQTL': the three group AUCs differ by up to 0.1719 within a configuration (Sei output tracks 0.5469 to 0.7188), so differences between configurations' means of a few hundredths should be read with that spread in mind. AlphaGenome output tracks rank first in every group.; No independent reproduction or qualified human scientific review.
revision
2
reason
Re-reviewed after Feng et al. Supplementary Data 4 per-group evaluations were added on this protocol (PR #157); relevance unchanged. First added: Add Codex-checked primary-source protocol evidence from the bounded AMP intake (rewire.it#365).
citation locators
source id: evidence-expansion-dna-foundation-models-2025-5d8ca9bc; locator: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/
source locator
evidence-expansion-dna-foundation-models-2025-5d8ca9bc: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/
review
method: ai-assisted-source-review; scope-review; method note: Re-review: checked the endpoint, relevance and limitations against the new per-group AUCs (Supplementary Data 4) and the Supplementary Data 4 legend; checked that the reviewed evaluations are unchanged and that each new per-group evaluation is excluded with a reason.; reviewer: claude; codex; claude-sonnet; reviewer note: Re-reviewed 2026-10-14 by an independent Claude (Opus 5.5) review agent for PR #157, separate from the extractor of the per-group results. First reviewed 2026-10-07: Claude Sonnet AMP-integration worker, bounded transcription of Codex-checked primary values; independently reviewed by Codex (workbench/amp-supervision/primary-review.md, integration-review-corrections.md). No human review claimed.; reviewed at: 2026-10-14T15:30:00Z; note: Bounded primary-source transcription, independently Codex-checked. No new model execution, independent experimental reproduction, qualified human scientific review or clinical validation. Re-review 2026-10-14: the proxy judgement still holds; per-group AUCs do not change the endpoint or the ranking of the top configuration. See docs/reviews/use-cases/feng-variant-effect-per-group-2026-10-14.md.
reviewed evaluations
amp-feng-20261007-eval-qtl-ipaqtl-alphagenome-output-tracks; amp-feng-20261007-eval-qtl-ipaqtl-caduceus-ph; amp-feng-20261007-eval-qtl-ipaqtl-caduceus-ph-long-sequence; amp-feng-20261007-eval-qtl-ipaqtl-dnabert-2; amp-feng-20261007-eval-qtl-ipaqtl-enformer-hidden-states; amp-feng-20261007-eval-qtl-ipaqtl-enformer-output-tracks; amp-feng-20261007-eval-qtl-ipaqtl-grover; amp-feng-20261007-eval-qtl-ipaqtl-hyenadna; amp-feng-20261007-eval-qtl-ipaqtl-hyenadna-450k-long-sequence; amp-feng-20261007-eval-qtl-ipaqtl-nt-v2; amp-feng-20261007-eval-qtl-ipaqtl-sei-hidden-states; amp-feng-20261007-eval-qtl-ipaqtl-sei-output-tracks
pins
record id: amp-feng-20261007-eval-qtl-ipaqtl-alphagenome-output-tracks; fields: status; links; attributes.origin; attributes.comparison; sha256: f748c05ba0d6e631e1de028cdd05f1c6df652c9ee90c865004711212df1ae784; record id: amp-feng-20261007-eval-qtl-ipaqtl-caduceus-ph; fields: status; links; attributes.origin; attributes.comparison; sha256: c97f103631c10e14d14833748d597e0502fc913aaeaf3cea622d9d792e316a7a; record id: amp-feng-20261007-eval-qtl-ipaqtl-caduceus-ph-long-sequence; fields: status; links; attributes.origin; attributes.comparison; sha256: aa66a6c399ba1ccf0fa23f5b7b374fb274e09f7095235888365856d52a45cd30; record id: amp-feng-20261007-eval-qtl-ipaqtl-dnabert-2; fields: status; links; attributes.origin; attributes.comparison; sha256: e8316a680fa9bc5fe03e0109064024821dc659c4802355490ac7f0f26c690523; record id: amp-feng-20261007-eval-qtl-ipaqtl-enformer-hidden-states; fields: status; links; attributes.origin; attributes.comparison; sha256: 902da0c974f6f6c9dd643eb2dabe88bc0fabe01a2c0322eeca351b25ed1f35ef; record id: amp-feng-20261007-eval-qtl-ipaqtl-enformer-output-tracks; fields: status; links; attributes.origin; attributes.comparison; sha256: d624b0dba5c8c22b62a9829eb7e6808b108f907d694bf67b20db15af6ed4391f; record id: amp-feng-20261007-eval-qtl-ipaqtl-grover; fields: status; links; attributes.origin; attributes.comparison; sha256: afa57766a0c6d57da1155897586418b243b6dc4bb3f9af63e2f0e7eaa8b570e5; record id: amp-feng-20261007-eval-qtl-ipaqtl-hyenadna; fields: status; links; attributes.origin; attributes.comparison; sha256: e5645ab745962eea5ef0794c6cb95202396a2ff9058675c67402442fc6111e88; record id: amp-feng-20261007-eval-qtl-ipaqtl-hyenadna-450k-long-sequence; fields: status; links; attributes.origin; attributes.comparison; sha256: b3ad52323785c4051845fb5b4d0a9548b1e00aee25ed3555e88bad4a8e332ea3; record id: amp-feng-20261007-eval-qtl-ipaqtl-nt-v2; fields: status; links; attributes.origin; attributes.comparison; sha256: 43b3a6f418f3090a66695fcba828c26d3b32b93c67abf0cb0ae95b300bc44f23; record id: amp-feng-20261007-eval-qtl-ipaqtl-sei-hidden-states; fields: status; links; attributes.origin; attributes.comparison; sha256: cd93a0a76efc335ccf4aa3aa9cbd5725425795667acec0936fc8dfdd4c4da65e; record id: amp-feng-20261007-eval-qtl-ipaqtl-sei-output-tracks; fields: status; links; attributes.origin; attributes.comparison; sha256: 48d73f6f41aa8085522d32d650cf6eaa4c342df2569a9ea270f27692d80a8034; record id: amp-feng-20261007-protocol-qtl-ipaqtl; fields: status; name; description; facets; source_ids; links; attributes; sha256: 3dcc70cb389bfd78a21289b9ca1d5caadca1c847071838f029ed2730a7f6c7b6; record id: amp-feng-20261007-result-qtl-ipaqtl-alphagenome-output-tracks-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 390b7fd31ee7383d66abb69534ddfe53e0f1d5eeb3d29d3d1c427fe4b071182c; record id: amp-feng-20261007-result-qtl-ipaqtl-alphagenome-output-tracks-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 1a7a6daab3fa6e71e6bbad929a5f3fa81a35334e19dc4202c40385dce0709a7c; record id: amp-feng-20261007-result-qtl-ipaqtl-caduceus-ph-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: c3c2ceaef44bc050ff04cdc898a51761a4019d41f1693507612ea7670bccf8ad; record id: amp-feng-20261007-result-qtl-ipaqtl-caduceus-ph-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: c343237bb89ee538b66077549e3f53d585a2b4864f2dc63de956f6b7c5ea274e; record id: amp-feng-20261007-result-qtl-ipaqtl-caduceus-ph-long-sequence-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: bdd3eeb790d88ece7bf59500e3d5df5b4918fd45467398e4ae1441a31cc0e59c; record id: amp-feng-20261007-result-qtl-ipaqtl-caduceus-ph-long-sequence-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 925e2277b8c8ab852312ea51131dcb6aea93831baa048c77ab8018813ae0aee6; record id: amp-feng-20261007-result-qtl-ipaqtl-dnabert-2-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 2a3188ad2218940e7b18df05764342b1c25b34acbc1d523154184d25e7b91b0a; record id: amp-feng-20261007-result-qtl-ipaqtl-dnabert-2-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: ed2515c3880ce80878f953f2225010a56f132daef1088190cfd70e4efc3fcca8; record id: amp-feng-20261007-result-qtl-ipaqtl-enformer-hidden-states-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 650e912b7b9431cc1b3d5f122518144b7175aaaf58f88f6fef4f95df83f707fd; record id: amp-feng-20261007-result-qtl-ipaqtl-enformer-hidden-states-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: dd96e74d66f70a023e4047dec8736984c978885b1b2f37403f3969c4661f7767; record id: amp-feng-20261007-result-qtl-ipaqtl-enformer-output-tracks-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 9eec6a8896ede98afea349a557b076268b70ebc5882b6f0d401339cde46ae1b6; record id: amp-feng-20261007-result-qtl-ipaqtl-enformer-output-tracks-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 30784a6ca3131e508cddab1baddb4daa41f0f381db2371aac37129745baea2f8; record id: amp-feng-20261007-result-qtl-ipaqtl-grover-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: e3096dee74a3ce6d098e184f50b9d08fe8834e3a869d33a4170ed760ba394d9c; record id: amp-feng-20261007-result-qtl-ipaqtl-grover-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: ea7b3a61d69e1062cb605e5f878ae6a6054043b2cb181c031c569623efce66ed; record id: amp-feng-20261007-result-qtl-ipaqtl-hyenadna-450k-long-sequence-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 883c3a7e9b510072b13438684b249d35822eff1f6fbe0d3d233ca69b379c780d; record id: amp-feng-20261007-result-qtl-ipaqtl-hyenadna-450k-long-sequence-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: d4834b155a09a544fdcfa10377b72805e517432c6aac7a8ceca5a8f37a4fc386; record id: amp-feng-20261007-result-qtl-ipaqtl-hyenadna-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: e57307337bbabf5888a8bdc3e898688c72ec9dd7c8efea26cd0537a4393de56b; record id: amp-feng-20261007-result-qtl-ipaqtl-hyenadna-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 63f5a09b3f56e606f2015b9175a0f72b2a0cc7750892940c6012a4dfe93f0282; record id: amp-feng-20261007-result-qtl-ipaqtl-nt-v2-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 5a13052a3617207282287fdfe0c22cdc48cb00d21cb18fb9322aa555826d7e78; record id: amp-feng-20261007-result-qtl-ipaqtl-nt-v2-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 4b12357a1b904b9df746c1473a7c9a43c2b4ce08d9b95bac5c97c9cc556f9b90; record id: amp-feng-20261007-result-qtl-ipaqtl-sei-hidden-states-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 3034d32450ff97252962ba1eb0c83f88619a19eff0f154a12adc2b9c6450e477; record id: amp-feng-20261007-result-qtl-ipaqtl-sei-hidden-states-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 9397c5ef9c75961414361b436d60f9ae78532740ee0ccf783b4df955a8ed929f; record id: amp-feng-20261007-result-qtl-ipaqtl-sei-output-tracks-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 061a61f3ccb361327d249e1431005f4f7e75057831de7f0cfd5fe320cd763a91; record id: amp-feng-20261007-result-qtl-ipaqtl-sei-output-tracks-cohen-s-d; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 61c8fa5412828c5c5a63c4f7e645b010f141b33ae470d86bd0d8e794acd15bd8; record id: evidence-expansion-dna-foundation-models-2025-5d8ca9bc; fields: status; attributes.artifact_sha256; sha256: 7996f91821054e875cfca234e2e3bca2b25a02af92475d0577cd3dd0a71a8559; record id: use-case-regulatory-variant-gene-follow-up; fields: status; name; description; facets; attributes.question; attributes.decision; attributes.inputs; attributes.output; attributes.exclusions; attributes.setting; attributes.clinical_scope; attributes.intended_users; sha256: 0071547e01ccaec30238aea9e4882dd92e6f51be9c967c7fb88bc61d2788b870
excluded evaluations
id: feng-dna-fm-20261014-eval-sd4-qtl-ipaqtl-alphagenome-output-tracks; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-ipaqtl-caduceus-ph; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-ipaqtl-caduceus-ph-long-sequence; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-ipaqtl-dnabert-2; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-ipaqtl-enformer-hidden-states; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-ipaqtl-enformer-output-tracks; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-ipaqtl-grover; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-ipaqtl-hyenadna; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-ipaqtl-hyenadna-450k-long-sequence; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-ipaqtl-nt-v2; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-ipaqtl-sei-hidden-states; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).; id: feng-dna-fm-20261014-eval-sd4-qtl-ipaqtl-sei-output-tracks; reason: Per-chromosome-group breakdown (Feng et al. Supplementary Data 4) of the three-group mean already shown for this configuration on this protocol. Excluded so each configuration is compared once, at the aggregation the paper reports; the spread is described in the limitations. Excluded at re-review 2026-10-14 (PR #157).
Related records

Suggest a correction