rewirebio.iobenchmarks
Source

Benchmarking DNA foundation models for genomic and genetic tasks

PMC12663285.1

Original source

What this source contributed

Records in this release that cite this source. A record can cite several sources.

Results

Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.

Model or configurationMetricValueDatasetEvaluation
AlphaGenome, output tracks* (eQTL discrimination)AUROC (task: eqtl; outer test group 1 only (chromosomes 3, 6, 9, 12, 16, 18, 19, 21), not averaged)0.7925 unitlessFeng eQTL discrimination long-window datasetAlphaGenome, output tracks eQTL per-test-group evaluation
AlphaGenome, output tracks* (eQTL discrimination)AUROC (task: eqtl; outer test group 2 only (chromosomes 2, 5, 11, 14, 17, 20, 22, X), not averaged)0.8032 unitlessFeng eQTL discrimination long-window datasetAlphaGenome, output tracks eQTL per-test-group evaluation
AlphaGenome, output tracks* (eQTL discrimination)AUROC (task: eqtl; outer test group 3 only (chromosomes 1, 4, 7, 8, 10, 13, 15), not averaged)0.8129 unitlessFeng eQTL discrimination long-window datasetAlphaGenome, output tracks eQTL per-test-group evaluation
AlphaGenome, output tracks* (ipaQTL discrimination)AUROC (task: ipaqtl; outer test group 1 only (chromosomes 3, 6, 9, 12, 16, 18, 19, 21), not averaged)0.8628 unitlessFeng ipaQTL discrimination long-window datasetAlphaGenome, output tracks ipaQTL per-test-group evaluation
AlphaGenome, output tracks* (ipaQTL discrimination)AUROC (task: ipaqtl; outer test group 2 only (chromosomes 2, 5, 11, 14, 17, 20, 22, X), not averaged)0.8525 unitlessFeng ipaQTL discrimination long-window datasetAlphaGenome, output tracks ipaQTL per-test-group evaluation
AlphaGenome, output tracks* (ipaQTL discrimination)AUROC (task: ipaqtl; outer test group 3 only (chromosomes 1, 4, 7, 8, 10, 13, 15), not averaged)0.8779 unitlessFeng ipaQTL discrimination long-window datasetAlphaGenome, output tracks ipaQTL per-test-group evaluation
AlphaGenome, output tracks* (paQTL discrimination)AUROC (task: paqtl; outer test group 1 only (chromosomes 3, 6, 9, 12, 16, 18, 19, 21), not averaged)0.6781 unitlessFeng paQTL discrimination long-window datasetAlphaGenome, output tracks paQTL per-test-group evaluation
AlphaGenome, output tracks* (paQTL discrimination)AUROC (task: paqtl; outer test group 2 only (chromosomes 2, 5, 11, 14, 17, 20, 22, X), not averaged)0.7354 unitlessFeng paQTL discrimination long-window datasetAlphaGenome, output tracks paQTL per-test-group evaluation
AlphaGenome, output tracks* (paQTL discrimination)AUROC (task: paqtl; outer test group 3 only (chromosomes 1, 4, 7, 8, 10, 13, 15), not averaged)0.8495 unitlessFeng paQTL discrimination long-window datasetAlphaGenome, output tracks paQTL per-test-group evaluation
AlphaGenome, output tracks* (sQTL discrimination)AUROC (task: sqtl; outer test group 1 only (chromosomes 3, 6, 9, 12, 16, 18, 19, 21), not averaged)0.713 unitlessFeng sQTL discrimination long-window datasetAlphaGenome, output tracks sQTL per-test-group evaluation
AlphaGenome, output tracks* (sQTL discrimination)AUROC (task: sqtl; outer test group 2 only (chromosomes 2, 5, 11, 14, 17, 20, 22, X), not averaged)0.7266 unitlessFeng sQTL discrimination long-window datasetAlphaGenome, output tracks sQTL per-test-group evaluation
AlphaGenome, output tracks* (sQTL discrimination)AUROC (task: sqtl; outer test group 3 only (chromosomes 1, 4, 7, 8, 10, 13, 15), not averaged)0.7047 unitlessFeng sQTL discrimination long-window datasetAlphaGenome, output tracks sQTL per-test-group evaluation
AlphaGenome, output tracks* (eQTL discrimination)AUROC (task: eqtl)0.8029 unitlessFeng eQTL discrimination long-window datasetAlphaGenome, output tracks* eQTL discrimination evaluation
AlphaGenome, output tracks* (eQTL discrimination)Cohen's d (task: eqtl)1.287 unitlessFeng eQTL discrimination long-window datasetAlphaGenome, output tracks* eQTL discrimination evaluation
AlphaGenome, output tracks* (ipaQTL discrimination)AUROC (task: ipaqtl)0.8644 unitlessFeng ipaQTL discrimination long-window datasetAlphaGenome, output tracks* ipaQTL discrimination evaluation
AlphaGenome, output tracks* (ipaQTL discrimination)Cohen's d (task: ipaqtl)1.6347 unitlessFeng ipaQTL discrimination long-window datasetAlphaGenome, output tracks* ipaQTL discrimination evaluation
AlphaGenome, output tracks* (paQTL discrimination)AUROC (task: paqtl)0.7543 unitlessFeng paQTL discrimination long-window datasetAlphaGenome, output tracks* paQTL discrimination evaluation
AlphaGenome, output tracks* (paQTL discrimination)Cohen's d (task: paqtl)0.9824 unitlessFeng paQTL discrimination long-window datasetAlphaGenome, output tracks* paQTL discrimination evaluation
AlphaGenome, output tracks* (sQTL discrimination)AUROC (task: sqtl)0.7147 unitlessFeng sQTL discrimination long-window datasetAlphaGenome, output tracks* sQTL discrimination evaluation
AlphaGenome, output tracks* (sQTL discrimination)Cohen's d (task: sqtl)0.7872 unitlessFeng sQTL discrimination long-window datasetAlphaGenome, output tracks* sQTL discrimination evaluation
Caduceus-Ph (A.Thaliana 4mC classification)AUROC (task: a.thaliana 4mc)0.6146 unitlessFeng A.Thaliana 4mC datasetCaduceus-Ph A.Thaliana 4mC evaluation
Caduceus-Ph (Acceptor classification)AUROC (task: splice acceptor)0.8449 unitlessFeng Acceptor datasetCaduceus-Ph Acceptor evaluation
Caduceus-Ph (C.Elegans 4mC classification)AUROC (task: c.elegans 4mc)0.5964 unitlessFeng C.Elegans 4mC datasetCaduceus-Ph C.Elegans 4mC evaluation
Caduceus-Ph (Coding classification)AUROC (task: coding)0.9735 unitlessFeng Coding datasetCaduceus-Ph Coding evaluation
Caduceus-Ph (D.Melanogaster 4mC classification)AUROC (task: d.melanogaster 4mc)0.6161 unitlessFeng D.Melanogaster 4mC datasetCaduceus-Ph D.Melanogaster 4mC evaluation
Caduceus-Ph (DNase I Hypersensitive classification)AUROC (task: dnase i hypersensitive)0.8799 unitlessFeng DNase I Hypersensitive datasetCaduceus-Ph DNase I Hypersensitive evaluation
Caduceus-Ph (Donor classification)AUROC (task: splice donor)0.8535 unitlessFeng Donor datasetCaduceus-Ph Donor evaluation
Caduceus-Ph (E.Coli 4mC classification)AUROC (task: e.coli 4mc)0.6283 unitlessFeng E.Coli 4mC datasetCaduceus-Ph E.Coli 4mC evaluation
Caduceus-Ph (Enhancer Cohn classification)AUROC (task: enhancer cohn)0.821 unitlessFeng Enhancer Cohn datasetCaduceus-Ph Enhancer Cohn evaluation
Caduceus-Ph (Enhancer Ensembl classification)AUROC (task: enhancer ensembl)0.9431 unitlessFeng Enhancer Ensembl datasetCaduceus-Ph Enhancer Ensembl evaluation
Caduceus-Ph (Enhancer classification)AUROC (task: enhancer)0.8384 unitlessFeng Enhancer datasetCaduceus-Ph Enhancer evaluation
Caduceus-Ph (eQTL discrimination)AUROC (task: eqtl)0.6492 unitlessFeng eQTL discrimination short-window datasetCaduceus-Ph eQTL discrimination evaluation
Caduceus-Ph (eQTL discrimination)Cohen's d (task: eqtl)0.5484 unitlessFeng eQTL discrimination short-window datasetCaduceus-Ph eQTL discrimination evaluation
Caduceus-Ph (eQTL discrimination)AUROC (task: eqtl; outer test group 1 only (chromosomes 3, 6, 9, 12, 16, 18, 19, 21), not averaged)0.6361 unitlessFeng eQTL discrimination short-window datasetCaduceus-Ph eQTL per-test-group evaluation
Caduceus-Ph (eQTL discrimination)AUROC (task: eqtl; outer test group 2 only (chromosomes 2, 5, 11, 14, 17, 20, 22, X), not averaged)0.6705 unitlessFeng eQTL discrimination short-window datasetCaduceus-Ph eQTL per-test-group evaluation
Caduceus-Ph (eQTL discrimination)AUROC (task: eqtl; outer test group 3 only (chromosomes 1, 4, 7, 8, 10, 13, 15), not averaged)0.641 unitlessFeng eQTL discrimination short-window datasetCaduceus-Ph eQTL per-test-group evaluation
Caduceus-Ph (G.Pickeringii 4mC classification)AUROC (task: g.pickeringii 4mc)0.6348 unitlessFeng G.Pickeringii 4mC datasetCaduceus-Ph G.Pickeringii 4mC evaluation
Caduceus-Ph (G.Subterraneus 4mC classification)AUROC (task: g.subterraneus 4mc)0.6079 unitlessFeng G.Subterraneus 4mC datasetCaduceus-Ph G.Subterraneus 4mC evaluation
Caduceus-Ph (GTEx whole-blood expression prediction)MSE (mean across genes of per-gene MSE of covariate-corrected expression)0.234 unit-unreportedFeng GTEx v8 whole-blood expression, TSS +/- 3 kbCaduceus-Ph GTEx whole-blood expression evaluation
Caduceus-Ph (GTEx whole-blood expression prediction)Pearson (mean across genes of per-gene Pearson correlation between predicted and observed expression)0.123 unitlessFeng GTEx v8 whole-blood expression, TSS +/- 3 kbCaduceus-Ph GTEx whole-blood expression evaluation
Caduceus-Ph (Human 6 mA classification)AUROC (task: human 6 ma)0.7731 unitlessFeng Human 6 mA datasetCaduceus-Ph Human 6 mA evaluation
Caduceus-Ph (Human TFBS 1 classification)AUROC (task: human tfbs 1)0.8796 unitlessFeng Human TFBS 1 datasetCaduceus-Ph Human TFBS 1 evaluation
Caduceus-Ph (Human TFBS 2 classification)AUROC (task: human tfbs 2)0.8687 unitlessFeng Human TFBS 2 datasetCaduceus-Ph Human TFBS 2 evaluation
Caduceus-Ph (Human TFBS 3 classification)AUROC (task: human tfbs 3)0.8249 unitlessFeng Human TFBS 3 datasetCaduceus-Ph Human TFBS 3 evaluation
Caduceus-Ph (Human TFBS 4 classification)AUROC (task: human tfbs 4)0.7725 unitlessFeng Human TFBS 4 datasetCaduceus-Ph Human TFBS 4 evaluation
Caduceus-Ph (Human TFBS 5 classification)AUROC (task: human tfbs 5)0.9294 unitlessFeng Human TFBS 5 datasetCaduceus-Ph Human TFBS 5 evaluation
Caduceus-Ph (Human vs worm classification)AUROC (task: human vs worm)0.9915 unitlessFeng Human vs worm datasetCaduceus-Ph Human vs worm evaluation
Caduceus-Ph (ipaQTL discrimination)AUROC (task: ipaqtl)0.5678 unitlessFeng ipaQTL discrimination short-window datasetCaduceus-Ph ipaQTL discrimination evaluation
Caduceus-Ph (ipaQTL discrimination)Cohen's d (task: ipaqtl)0.2324 unitlessFeng ipaQTL discrimination short-window datasetCaduceus-Ph ipaQTL discrimination evaluation
Caduceus-Ph (ipaQTL discrimination)AUROC (task: ipaqtl; outer test group 1 only (chromosomes 3, 6, 9, 12, 16, 18, 19, 21), not averaged)0.5712 unitlessFeng ipaQTL discrimination short-window datasetCaduceus-Ph ipaQTL per-test-group evaluation

Claims

Statements this source supports, each with where in the source it was checked.

Models, benchmarks and other records

Configurations (325)

Tasks (1)

Protocols (60)

Datasets (64)

Evaluations (384)

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

15 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-adc15377fab2
Property and statementOriginal source and locationReview and provenance
Artifact SHA-256
5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202
Source metadata
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

No field-specific location recorded

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_sha256

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Artifact url
https://www.ebi.ac.uk/europepmc/webservices/rest/PMC12663285/fullTextXML
Source metadata
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

No field-specific location recorded

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_url

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Hash scope
Exact retrieved primary paper artifact bytes.
Source metadata
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

No field-specific location recorded

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.hash_scope

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Retrieved at
2026-09-17T07:54:51.004119+00:00
Source metadata
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

No field-specific location recorded

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.retrieved_at

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Review method
1 values
  • automated-source-review
Source metadata
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

No field-specific location recorded

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.review.method

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Review: scope
Source identification and table transcription; no independent experimental reproduction.
Source metadata
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

No field-specific location recorded

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.review.scope

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Url
https://pmc.ncbi.nlm.nih.gov/articles/PMC12663285/
Source metadata
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

No field-specific location recorded

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.url

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Version
PMC12663285.1
Source metadata
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

No field-specific location recorded

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.version

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Description
Primary reference; inspect retrieval status and review scope.
Source metadata
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

No field-specific location recorded

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

catalogued

No individual claim review recorded

Audit details

Field: description

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Search facets
None recorded
Source metadata
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

No field-specific location recorded

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

catalogued

No individual claim review recorded

Audit details

Field: facets

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-21-adc15377fab2 · Record review: source checked

Primary reference; inspect retrieval status and review scope.

Release history

No supporting source is linked yet.

Read original source

Download this release (gzip)
Technical metadata and extraction receipts

Stable ID: evidence-expansion-dna-foundation-models-2025-5d8ca9bc

url
https://pmc.ncbi.nlm.nih.gov/articles/PMC12663285/
version
PMC12663285.1
retrieved at
2026-09-17T07:54:51.004119+00:00
artifact sha256
5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202
artifact url
https://www.ebi.ac.uk/europepmc/webservices/rest/PMC12663285/fullTextXML
hash scope
Exact retrieved primary paper artifact bytes.
review
scope: Source identification and table transcription; no independent experimental reproduction.; method: automated-source-review
Related records

Suggest a correction