rewirebio.iobenchmarks
Source

Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Data 1-6

Nature Communications 16, 10780 (2025); Supplementary Data 1-6 workbook (MOESM3, .xlsm) · Peer-reviewed

DOI: 10.1038/s41467-025-65823-8

What this source contributed

Records in this release that cite this source. A record can cite several sources.

Results

Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.

Model or configurationMetricValueDatasetEvaluation
AlphaGenome, output tracks* (eQTL discrimination)AUROC (task: eqtl; outer test group 1 only (chromosomes 3, 6, 9, 12, 16, 18, 19, 21), not averaged)0.7925 unitlessFeng eQTL discrimination long-window datasetAlphaGenome, output tracks eQTL per-test-group evaluation
AlphaGenome, output tracks* (eQTL discrimination)AUROC (task: eqtl; outer test group 2 only (chromosomes 2, 5, 11, 14, 17, 20, 22, X), not averaged)0.8032 unitlessFeng eQTL discrimination long-window datasetAlphaGenome, output tracks eQTL per-test-group evaluation
AlphaGenome, output tracks* (eQTL discrimination)AUROC (task: eqtl; outer test group 3 only (chromosomes 1, 4, 7, 8, 10, 13, 15), not averaged)0.8129 unitlessFeng eQTL discrimination long-window datasetAlphaGenome, output tracks eQTL per-test-group evaluation
AlphaGenome, output tracks* (ipaQTL discrimination)AUROC (task: ipaqtl; outer test group 1 only (chromosomes 3, 6, 9, 12, 16, 18, 19, 21), not averaged)0.8628 unitlessFeng ipaQTL discrimination long-window datasetAlphaGenome, output tracks ipaQTL per-test-group evaluation
AlphaGenome, output tracks* (ipaQTL discrimination)AUROC (task: ipaqtl; outer test group 2 only (chromosomes 2, 5, 11, 14, 17, 20, 22, X), not averaged)0.8525 unitlessFeng ipaQTL discrimination long-window datasetAlphaGenome, output tracks ipaQTL per-test-group evaluation
AlphaGenome, output tracks* (ipaQTL discrimination)AUROC (task: ipaqtl; outer test group 3 only (chromosomes 1, 4, 7, 8, 10, 13, 15), not averaged)0.8779 unitlessFeng ipaQTL discrimination long-window datasetAlphaGenome, output tracks ipaQTL per-test-group evaluation
AlphaGenome, output tracks* (paQTL discrimination)AUROC (task: paqtl; outer test group 1 only (chromosomes 3, 6, 9, 12, 16, 18, 19, 21), not averaged)0.6781 unitlessFeng paQTL discrimination long-window datasetAlphaGenome, output tracks paQTL per-test-group evaluation
AlphaGenome, output tracks* (paQTL discrimination)AUROC (task: paqtl; outer test group 2 only (chromosomes 2, 5, 11, 14, 17, 20, 22, X), not averaged)0.7354 unitlessFeng paQTL discrimination long-window datasetAlphaGenome, output tracks paQTL per-test-group evaluation
AlphaGenome, output tracks* (paQTL discrimination)AUROC (task: paqtl; outer test group 3 only (chromosomes 1, 4, 7, 8, 10, 13, 15), not averaged)0.8495 unitlessFeng paQTL discrimination long-window datasetAlphaGenome, output tracks paQTL per-test-group evaluation
AlphaGenome, output tracks* (sQTL discrimination)AUROC (task: sqtl; outer test group 1 only (chromosomes 3, 6, 9, 12, 16, 18, 19, 21), not averaged)0.713 unitlessFeng sQTL discrimination long-window datasetAlphaGenome, output tracks sQTL per-test-group evaluation
AlphaGenome, output tracks* (sQTL discrimination)AUROC (task: sqtl; outer test group 2 only (chromosomes 2, 5, 11, 14, 17, 20, 22, X), not averaged)0.7266 unitlessFeng sQTL discrimination long-window datasetAlphaGenome, output tracks sQTL per-test-group evaluation
AlphaGenome, output tracks* (sQTL discrimination)AUROC (task: sqtl; outer test group 3 only (chromosomes 1, 4, 7, 8, 10, 13, 15), not averaged)0.7047 unitlessFeng sQTL discrimination long-window datasetAlphaGenome, output tracks sQTL per-test-group evaluation
Caduceus-Ph (eQTL discrimination)AUROC (task: eqtl; outer test group 1 only (chromosomes 3, 6, 9, 12, 16, 18, 19, 21), not averaged)0.6361 unitlessFeng eQTL discrimination short-window datasetCaduceus-Ph eQTL per-test-group evaluation
Caduceus-Ph (eQTL discrimination)AUROC (task: eqtl; outer test group 2 only (chromosomes 2, 5, 11, 14, 17, 20, 22, X), not averaged)0.6705 unitlessFeng eQTL discrimination short-window datasetCaduceus-Ph eQTL per-test-group evaluation
Caduceus-Ph (eQTL discrimination)AUROC (task: eqtl; outer test group 3 only (chromosomes 1, 4, 7, 8, 10, 13, 15), not averaged)0.641 unitlessFeng eQTL discrimination short-window datasetCaduceus-Ph eQTL per-test-group evaluation
Caduceus-Ph (ipaQTL discrimination)AUROC (task: ipaqtl; outer test group 1 only (chromosomes 3, 6, 9, 12, 16, 18, 19, 21), not averaged)0.5712 unitlessFeng ipaQTL discrimination short-window datasetCaduceus-Ph ipaQTL per-test-group evaluation
Caduceus-Ph (ipaQTL discrimination)AUROC (task: ipaqtl; outer test group 2 only (chromosomes 2, 5, 11, 14, 17, 20, 22, X), not averaged)0.5931 unitlessFeng ipaQTL discrimination short-window datasetCaduceus-Ph ipaQTL per-test-group evaluation
Caduceus-Ph (ipaQTL discrimination)AUROC (task: ipaqtl; outer test group 3 only (chromosomes 1, 4, 7, 8, 10, 13, 15), not averaged)0.5392 unitlessFeng ipaQTL discrimination short-window datasetCaduceus-Ph ipaQTL per-test-group evaluation
Caduceus-Ph (paQTL discrimination)AUROC (task: paqtl; outer test group 1 only (chromosomes 3, 6, 9, 12, 16, 18, 19, 21), not averaged)0.5059 unitlessFeng paQTL discrimination short-window datasetCaduceus-Ph paQTL per-test-group evaluation
Caduceus-Ph (paQTL discrimination)AUROC (task: paqtl; outer test group 2 only (chromosomes 2, 5, 11, 14, 17, 20, 22, X), not averaged)0.505 unitlessFeng paQTL discrimination short-window datasetCaduceus-Ph paQTL per-test-group evaluation
Caduceus-Ph (paQTL discrimination)AUROC (task: paqtl; outer test group 3 only (chromosomes 1, 4, 7, 8, 10, 13, 15), not averaged)0.5136 unitlessFeng paQTL discrimination short-window datasetCaduceus-Ph paQTL per-test-group evaluation
Caduceus-Ph (pathogenic/common SNP classification)AUROC (task: pathogenic vs common snp; outer test group 1 only (chromosomes 3, 6, 9, 12, 16, 18, 19, 21), not averaged)0.704 unitlessFeng pathogenic/common SNP short-window datasetCaduceus-Ph Pathogenic variants vs common per-test-group evaluation
Caduceus-Ph (pathogenic/common SNP classification)AUROC (task: pathogenic vs common snp; outer test group 2 only (chromosomes 2, 5, 11, 14, 17, 20, 22, X), not averaged)0.6877 unitlessFeng pathogenic/common SNP short-window datasetCaduceus-Ph Pathogenic variants vs common per-test-group evaluation
Caduceus-Ph (pathogenic/common SNP classification)AUROC (task: pathogenic vs common snp; outer test group 3 only (chromosomes 1, 4, 7, 8, 10, 13, 15), not averaged)0.696 unitlessFeng pathogenic/common SNP short-window datasetCaduceus-Ph Pathogenic variants vs common per-test-group evaluation
Caduceus-Ph (sQTL discrimination)AUROC (task: sqtl; outer test group 1 only (chromosomes 3, 6, 9, 12, 16, 18, 19, 21), not averaged)0.5619 unitlessFeng sQTL discrimination short-window datasetCaduceus-Ph sQTL per-test-group evaluation
Caduceus-Ph (sQTL discrimination)AUROC (task: sqtl; outer test group 2 only (chromosomes 2, 5, 11, 14, 17, 20, 22, X), not averaged)0.541 unitlessFeng sQTL discrimination short-window datasetCaduceus-Ph sQTL per-test-group evaluation
Caduceus-Ph (sQTL discrimination)AUROC (task: sqtl; outer test group 3 only (chromosomes 1, 4, 7, 8, 10, 13, 15), not averaged)0.597 unitlessFeng sQTL discrimination short-window datasetCaduceus-Ph sQTL per-test-group evaluation
Caduceus-Ph, long sequence (eQTL discrimination)AUROC (task: eqtl; outer test group 1 only (chromosomes 3, 6, 9, 12, 16, 18, 19, 21), not averaged)0.621 unitlessFeng eQTL discrimination long-window datasetCaduceus-Ph, long sequence eQTL per-test-group evaluation
Caduceus-Ph, long sequence (eQTL discrimination)AUROC (task: eqtl; outer test group 2 only (chromosomes 2, 5, 11, 14, 17, 20, 22, X), not averaged)0.6441 unitlessFeng eQTL discrimination long-window datasetCaduceus-Ph, long sequence eQTL per-test-group evaluation
Caduceus-Ph, long sequence (eQTL discrimination)AUROC (task: eqtl; outer test group 3 only (chromosomes 1, 4, 7, 8, 10, 13, 15), not averaged)0.6145 unitlessFeng eQTL discrimination long-window datasetCaduceus-Ph, long sequence eQTL per-test-group evaluation
Caduceus-Ph, long sequence (ipaQTL discrimination)AUROC (task: ipaqtl; outer test group 1 only (chromosomes 3, 6, 9, 12, 16, 18, 19, 21), not averaged)0.5278 unitlessFeng ipaQTL discrimination long-window datasetCaduceus-Ph, long sequence ipaQTL per-test-group evaluation
Caduceus-Ph, long sequence (ipaQTL discrimination)AUROC (task: ipaqtl; outer test group 2 only (chromosomes 2, 5, 11, 14, 17, 20, 22, X), not averaged)0.5563 unitlessFeng ipaQTL discrimination long-window datasetCaduceus-Ph, long sequence ipaQTL per-test-group evaluation
Caduceus-Ph, long sequence (ipaQTL discrimination)AUROC (task: ipaqtl; outer test group 3 only (chromosomes 1, 4, 7, 8, 10, 13, 15), not averaged)0.4767 unitlessFeng ipaQTL discrimination long-window datasetCaduceus-Ph, long sequence ipaQTL per-test-group evaluation
Caduceus-Ph, long sequence (paQTL discrimination)AUROC (task: paqtl; outer test group 1 only (chromosomes 3, 6, 9, 12, 16, 18, 19, 21), not averaged)0.4637 unitlessFeng paQTL discrimination long-window datasetCaduceus-Ph, long sequence paQTL per-test-group evaluation
Caduceus-Ph, long sequence (paQTL discrimination)AUROC (task: paqtl; outer test group 2 only (chromosomes 2, 5, 11, 14, 17, 20, 22, X), not averaged)0.4667 unitlessFeng paQTL discrimination long-window datasetCaduceus-Ph, long sequence paQTL per-test-group evaluation
Caduceus-Ph, long sequence (paQTL discrimination)AUROC (task: paqtl; outer test group 3 only (chromosomes 1, 4, 7, 8, 10, 13, 15), not averaged)0.4645 unitlessFeng paQTL discrimination long-window datasetCaduceus-Ph, long sequence paQTL per-test-group evaluation
Caduceus-Ph, long sequence (pathogenic/common SNP classification)AUROC (task: pathogenic vs common snp; outer test group 1 only (chromosomes 3, 6, 9, 12, 16, 18, 19, 21), not averaged)0.6296 unitlessFeng pathogenic/common SNP long-window datasetCaduceus-Ph, long sequence Pathogenic variants vs common per-test-group evaluation
Caduceus-Ph, long sequence (pathogenic/common SNP classification)AUROC (task: pathogenic vs common snp; outer test group 2 only (chromosomes 2, 5, 11, 14, 17, 20, 22, X), not averaged)0.6178 unitlessFeng pathogenic/common SNP long-window datasetCaduceus-Ph, long sequence Pathogenic variants vs common per-test-group evaluation
Caduceus-Ph, long sequence (pathogenic/common SNP classification)AUROC (task: pathogenic vs common snp; outer test group 3 only (chromosomes 1, 4, 7, 8, 10, 13, 15), not averaged)0.6254 unitlessFeng pathogenic/common SNP long-window datasetCaduceus-Ph, long sequence Pathogenic variants vs common per-test-group evaluation
Caduceus-Ph, long sequence (sQTL discrimination)AUROC (task: sqtl; outer test group 1 only (chromosomes 3, 6, 9, 12, 16, 18, 19, 21), not averaged)0.5755 unitlessFeng sQTL discrimination long-window datasetCaduceus-Ph, long sequence sQTL per-test-group evaluation
Caduceus-Ph, long sequence (sQTL discrimination)AUROC (task: sqtl; outer test group 2 only (chromosomes 2, 5, 11, 14, 17, 20, 22, X), not averaged)0.5583 unitlessFeng sQTL discrimination long-window datasetCaduceus-Ph, long sequence sQTL per-test-group evaluation
Caduceus-Ph, long sequence (sQTL discrimination)AUROC (task: sqtl; outer test group 3 only (chromosomes 1, 4, 7, 8, 10, 13, 15), not averaged)0.5772 unitlessFeng sQTL discrimination long-window datasetCaduceus-Ph, long sequence sQTL per-test-group evaluation
DNABERT-2 (eQTL discrimination)AUROC (task: eqtl; outer test group 1 only (chromosomes 3, 6, 9, 12, 16, 18, 19, 21), not averaged)0.5636 unitlessFeng eQTL discrimination short-window datasetDNABERT-2 eQTL per-test-group evaluation
DNABERT-2 (eQTL discrimination)AUROC (task: eqtl; outer test group 2 only (chromosomes 2, 5, 11, 14, 17, 20, 22, X), not averaged)0.5745 unitlessFeng eQTL discrimination short-window datasetDNABERT-2 eQTL per-test-group evaluation
DNABERT-2 (eQTL discrimination)AUROC (task: eqtl; outer test group 3 only (chromosomes 1, 4, 7, 8, 10, 13, 15), not averaged)0.5723 unitlessFeng eQTL discrimination short-window datasetDNABERT-2 eQTL per-test-group evaluation
DNABERT-2 (ipaQTL discrimination)AUROC (task: ipaqtl; outer test group 1 only (chromosomes 3, 6, 9, 12, 16, 18, 19, 21), not averaged)0.4002 unitlessFeng ipaQTL discrimination short-window datasetDNABERT-2 ipaQTL per-test-group evaluation
DNABERT-2 (ipaQTL discrimination)AUROC (task: ipaqtl; outer test group 2 only (chromosomes 2, 5, 11, 14, 17, 20, 22, X), not averaged)0.5619 unitlessFeng ipaQTL discrimination short-window datasetDNABERT-2 ipaQTL per-test-group evaluation
DNABERT-2 (ipaQTL discrimination)AUROC (task: ipaqtl; outer test group 3 only (chromosomes 1, 4, 7, 8, 10, 13, 15), not averaged)0.446 unitlessFeng ipaQTL discrimination short-window datasetDNABERT-2 ipaQTL per-test-group evaluation
DNABERT-2 (paQTL discrimination)AUROC (task: paqtl; outer test group 1 only (chromosomes 3, 6, 9, 12, 16, 18, 19, 21), not averaged)0.5118 unitlessFeng paQTL discrimination short-window datasetDNABERT-2 paQTL per-test-group evaluation
DNABERT-2 (paQTL discrimination)AUROC (task: paqtl; outer test group 2 only (chromosomes 2, 5, 11, 14, 17, 20, 22, X), not averaged)0.5392 unitlessFeng paQTL discrimination short-window datasetDNABERT-2 paQTL per-test-group evaluation

Claims

Statements this source supports, each with where in the source it was checked.

  • reported_finding: amp-feng-20261007-protocol-promoter-nontata: Reported finding Baseline CNN trained from scratch on Promoter Arabidopsis NonTATA: Supplementary Data 1 lists the DNA foundation models the CNN significantly outperformed (one-sided DeLong p<0.01): Caduceus-Ph, DNABERT-2, GROVER, HyenaDNA, NT-v2. Supplementary Data 2 lists the models that significantly outperformed the CNN: None. The CNN's AUC is not printed, so it has no result record; the foundation-model AUCs are in Table 2. (Supplementary Data 1 and Supplementary Data 2, row 'Promoter Arabidopsis NonTATA')
  • reported_finding: amp-feng-20261007-protocol-promoter-tata: Reported finding Baseline CNN trained from scratch on Promoter Arabidopsis TATA: Supplementary Data 1 lists the DNA foundation models the CNN significantly outperformed (one-sided DeLong p<0.01): Caduceus-Ph, DNABERT-2, GROVER, NT-v2. Supplementary Data 2 lists the models that significantly outperformed the CNN: None. The CNN's AUC is not printed, so it has no result record; the foundation-model AUCs are in Table 2. (Supplementary Data 1 and Supplementary Data 2, row 'Promoter Arabidopsis TATA')
  • reported_finding: amp-feng-20261007-protocol-splice-acceptor: Reported finding Baseline CNN trained from scratch on Acceptor: Supplementary Data 1 lists the DNA foundation models the CNN significantly outperformed (one-sided DeLong p<0.01): Caduceus-Ph, GROVER, HyenaDNA, NT-v2. Supplementary Data 2 lists the models that significantly outperformed the CNN: None. The CNN's AUC is not printed, so it has no result record; the foundation-model AUCs are in Table 1. (Supplementary Data 1 and Supplementary Data 2, row 'Acceptors')
  • reported_finding: amp-feng-20261007-protocol-splice-donor: Reported finding Baseline CNN trained from scratch on Donor: Supplementary Data 1 lists the DNA foundation models the CNN significantly outperformed (one-sided DeLong p<0.01): Caduceus-Ph, DNABERT-2, GROVER, HyenaDNA, NT-v2. Supplementary Data 2 lists the models that significantly outperformed the CNN: None. The CNN's AUC is not printed, so it has no result record; the foundation-model AUCs are in Table 1. (Supplementary Data 1 and Supplementary Data 2, row 'Donors')
  • reported_finding: feng-dna-fm-20261013-protocol-t1-coding: Reported finding Baseline CNN trained from scratch on Coding: Supplementary Data 1 lists the DNA foundation models the CNN significantly outperformed (one-sided DeLong p<0.01): DNABERT-2, HyenaDNA, NT-v2. Supplementary Data 2 lists the models that significantly outperformed the CNN: Caduceus-Ph, GROVER. The CNN's AUC is not printed, so it has no result record; the foundation-model AUCs are in Table 1. (Supplementary Data 1 and Supplementary Data 2, row 'Coding')
  • reported_finding: feng-dna-fm-20261013-protocol-t1-dnase-i-hypersensitive: Reported finding Baseline CNN trained from scratch on DNase I Hypersensitive: Supplementary Data 1 lists the DNA foundation models the CNN significantly outperformed (one-sided DeLong p<0.01): None. Supplementary Data 2 lists the models that significantly outperformed the CNN: Caduceus-Ph, DNABERT-2. The CNN's AUC is not printed, so it has no result record; the foundation-model AUCs are in Table 1. (Supplementary Data 1 and Supplementary Data 2, row 'DNase I Hypersensitive')
  • reported_finding: feng-dna-fm-20261013-protocol-t1-enhancer: Reported finding Baseline CNN trained from scratch on Enhancer: Supplementary Data 1 lists the DNA foundation models the CNN significantly outperformed (one-sided DeLong p<0.01): None. Supplementary Data 2 lists the models that significantly outperformed the CNN: DNABERT-2, NT-v2. The CNN's AUC is not printed, so it has no result record; the foundation-model AUCs are in Table 1. (Supplementary Data 1 and Supplementary Data 2, row 'Enhancer')
  • reported_finding: feng-dna-fm-20261013-protocol-t1-enhancer-cohn: Reported finding Baseline CNN trained from scratch on Enhancer Cohn: Supplementary Data 1 lists the DNA foundation models the CNN significantly outperformed (one-sided DeLong p<0.01): HyenaDNA. Supplementary Data 2 lists the models that significantly outperformed the CNN: None. The CNN's AUC is not printed, so it has no result record; the foundation-model AUCs are in Table 1. (Supplementary Data 1 and Supplementary Data 2, row 'Enhancer Cohn')
  • reported_finding: feng-dna-fm-20261013-protocol-t1-enhancer-ensembl: Reported finding Baseline CNN trained from scratch on Enhancer Ensembl: Supplementary Data 1 lists the DNA foundation models the CNN significantly outperformed (one-sided DeLong p<0.01): None. Supplementary Data 2 lists the models that significantly outperformed the CNN: None. The CNN's AUC is not printed, so it has no result record; the foundation-model AUCs are in Table 1. (Supplementary Data 1 and Supplementary Data 2, row 'Enhancer Ensembl')
  • reported_finding: feng-dna-fm-20261013-protocol-t1-human-tfbs-1: Reported finding Baseline CNN trained from scratch on Human TFBS 1: Supplementary Data 1 lists the DNA foundation models the CNN significantly outperformed (one-sided DeLong p<0.01): None. Supplementary Data 2 lists the models that significantly outperformed the CNN: Caduceus-Ph, GROVER. The CNN's AUC is not printed, so it has no result record; the foundation-model AUCs are in Table 1. (Supplementary Data 1 and Supplementary Data 2, row 'Human TFBS 1')
  • reported_finding: feng-dna-fm-20261013-protocol-t1-human-tfbs-2: Reported finding Baseline CNN trained from scratch on Human TFBS 2: Supplementary Data 1 lists the DNA foundation models the CNN significantly outperformed (one-sided DeLong p<0.01): None. Supplementary Data 2 lists the models that significantly outperformed the CNN: Caduceus-Ph, GROVER. The CNN's AUC is not printed, so it has no result record; the foundation-model AUCs are in Table 1. (Supplementary Data 1 and Supplementary Data 2, row 'Human TFBS 2')
  • reported_finding: feng-dna-fm-20261013-protocol-t1-human-tfbs-3: Reported finding Baseline CNN trained from scratch on Human TFBS 3: Supplementary Data 1 lists the DNA foundation models the CNN significantly outperformed (one-sided DeLong p<0.01): Caduceus-Ph, DNABERT-2, GROVER, HyenaDNA, NT-v2. Supplementary Data 2 lists the models that significantly outperformed the CNN: None. The CNN's AUC is not printed, so it has no result record; the foundation-model AUCs are in Table 1. (Supplementary Data 1 and Supplementary Data 2, row 'Human TFBS 3')
  • reported_finding: feng-dna-fm-20261013-protocol-t1-human-tfbs-4: Reported finding Baseline CNN trained from scratch on Human TFBS 4: Supplementary Data 1 lists the DNA foundation models the CNN significantly outperformed (one-sided DeLong p<0.01): DNABERT-2, HyenaDNA, NT-v2. Supplementary Data 2 lists the models that significantly outperformed the CNN: Caduceus-Ph, GROVER. The CNN's AUC is not printed, so it has no result record; the foundation-model AUCs are in Table 1. (Supplementary Data 1 and Supplementary Data 2, row 'Human TFBS 4')
  • reported_finding: feng-dna-fm-20261013-protocol-t1-human-tfbs-5: Reported finding Baseline CNN trained from scratch on Human TFBS 5: Supplementary Data 1 lists the DNA foundation models the CNN significantly outperformed (one-sided DeLong p<0.01): None. Supplementary Data 2 lists the models that significantly outperformed the CNN: Caduceus-Ph, GROVER. The CNN's AUC is not printed, so it has no result record; the foundation-model AUCs are in Table 1. (Supplementary Data 1 and Supplementary Data 2, row 'Human TFBS 5')
  • reported_finding: feng-dna-fm-20261013-protocol-t1-open-chromatin-region: Reported finding Baseline CNN trained from scratch on Open chromatin region: Supplementary Data 1 lists the DNA foundation models the CNN significantly outperformed (one-sided DeLong p<0.01): DNABERT-2, GROVER, HyenaDNA, NT-v2. Supplementary Data 2 lists the models that significantly outperformed the CNN: None. The CNN's AUC is not printed, so it has no result record; the foundation-model AUCs are in Table 1. (Supplementary Data 1 and Supplementary Data 2, row 'Open Chromatin Region')
  • reported_finding: feng-dna-fm-20261013-protocol-t1-promoter-all-70-bps: Reported finding Baseline CNN trained from scratch on Promoter All 70 bps: Supplementary Data 1 lists the DNA foundation models the CNN significantly outperformed (one-sided DeLong p<0.01): Caduceus-Ph, DNABERT-2, GROVER, HyenaDNA, NT-v2. Supplementary Data 2 lists the models that significantly outperformed the CNN: None. The CNN's AUC is not printed, so it has no result record; the foundation-model AUCs are in Table 1. (Supplementary Data 1 and Supplementary Data 2, row 'Promoter All 70bps')
  • reported_finding: feng-dna-fm-20261013-protocol-t1-promoter-all-300-bps: Reported finding Baseline CNN trained from scratch on Promoter All 300 bps: Supplementary Data 1 lists the DNA foundation models the CNN significantly outperformed (one-sided DeLong p<0.01): DNABERT-2, GROVER, HyenaDNA, NT-v2. Supplementary Data 2 lists the models that significantly outperformed the CNN: None. The CNN's AUC is not printed, so it has no result record; the foundation-model AUCs are in Table 1. (Supplementary Data 1 and Supplementary Data 2, row 'Promoter All 300bps')
  • reported_finding: feng-dna-fm-20261013-protocol-t1-promoter-gm12878: Reported finding Baseline CNN trained from scratch on Promoter GM12878: Supplementary Data 1 lists the DNA foundation models the CNN significantly outperformed (one-sided DeLong p<0.01): None. Supplementary Data 2 lists the models that significantly outperformed the CNN: Caduceus-Ph, DNABERT-2, GROVER, NT-v2. The CNN's AUC is not printed, so it has no result record; the foundation-model AUCs are in Table 1. (Supplementary Data 1 and Supplementary Data 2, row 'Promoter GM12878')
  • reported_finding: feng-dna-fm-20261013-protocol-t1-promoter-hela-s3: Reported finding Baseline CNN trained from scratch on Promoter Hela-S3: Supplementary Data 1 lists the DNA foundation models the CNN significantly outperformed (one-sided DeLong p<0.01): None. Supplementary Data 2 lists the models that significantly outperformed the CNN: Caduceus-Ph, DNABERT-2, GROVER, NT-v2. The CNN's AUC is not printed, so it has no result record; the foundation-model AUCs are in Table 1. (Supplementary Data 1 and Supplementary Data 2, row 'Promoter Hela-S3')
  • reported_finding: feng-dna-fm-20261013-protocol-t1-promoter-huvec: Reported finding Baseline CNN trained from scratch on Promoter HUVEC: Supplementary Data 1 lists the DNA foundation models the CNN significantly outperformed (one-sided DeLong p<0.01): None. Supplementary Data 2 lists the models that significantly outperformed the CNN: Caduceus-Ph, DNABERT-2, GROVER, NT-v2. The CNN's AUC is not printed, so it has no result record; the foundation-model AUCs are in Table 1. (Supplementary Data 1 and Supplementary Data 2, row 'Promoter HUVEC')
  • reported_finding: feng-dna-fm-20261013-protocol-t1-promoter-nhek: Reported finding Baseline CNN trained from scratch on Promoter NHEK: Supplementary Data 1 lists the DNA foundation models the CNN significantly outperformed (one-sided DeLong p<0.01): HyenaDNA, NT-v2. Supplementary Data 2 lists the models that significantly outperformed the CNN: None. The CNN's AUC is not printed, so it has no result record; the foundation-model AUCs are in Table 1. (Supplementary Data 1 and Supplementary Data 2, row 'Promoter NHEK')
  • reported_finding: feng-dna-fm-20261013-protocol-t1-promoter-nontata-70-bps: Reported finding Baseline CNN trained from scratch on Promoter NonTATA 70 bps: Supplementary Data 1 lists the DNA foundation models the CNN significantly outperformed (one-sided DeLong p<0.01): DNABERT-2, GROVER, HyenaDNA, NT-v2. Supplementary Data 2 lists the models that significantly outperformed the CNN: None. The CNN's AUC is not printed, so it has no result record; the foundation-model AUCs are in Table 1. (Supplementary Data 1 and Supplementary Data 2, row 'Promoter NonTATA 70bps')
  • reported_finding: feng-dna-fm-20261013-protocol-t1-promoter-nontata-251-bps: Reported finding Baseline CNN trained from scratch on Promoter NonTATA 251 bps: Supplementary Data 1 lists the DNA foundation models the CNN significantly outperformed (one-sided DeLong p<0.01): DNABERT-2, HyenaDNA, NT-v2. Supplementary Data 2 lists the models that significantly outperformed the CNN: None. The CNN's AUC is not printed, so it has no result record; the foundation-model AUCs are in Table 1. (Supplementary Data 1 and Supplementary Data 2, row 'Promoter NonTATA 251bps')
  • reported_finding: feng-dna-fm-20261013-protocol-t1-promoter-nontata-300-bps: Reported finding Baseline CNN trained from scratch on Promoter NonTATA 300 bps: Supplementary Data 1 lists the DNA foundation models the CNN significantly outperformed (one-sided DeLong p<0.01): Caduceus-Ph, DNABERT-2, GROVER, HyenaDNA, NT-v2. Supplementary Data 2 lists the models that significantly outperformed the CNN: None. The CNN's AUC is not printed, so it has no result record; the foundation-model AUCs are in Table 1. (Supplementary Data 1 and Supplementary Data 2, row 'Promoter NonTATA 300bps')
  • reported_finding: feng-dna-fm-20261013-protocol-t1-promoter-tata-70-bps: Reported finding Baseline CNN trained from scratch on Promoter TATA 70 bps: Supplementary Data 1 lists the DNA foundation models the CNN significantly outperformed (one-sided DeLong p<0.01): Caduceus-Ph, DNABERT-2, GROVER, HyenaDNA, NT-v2. Supplementary Data 2 lists the models that significantly outperformed the CNN: None. The CNN's AUC is not printed, so it has no result record; the foundation-model AUCs are in Table 1. (Supplementary Data 1 and Supplementary Data 2, row 'Promoter TATA 70bps')

Models, benchmarks and other records

Protocols (48)

Datasets (47)

Evaluations (59)

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

26 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-02-a7f03c9e55a5
Property and statementOriginal source and locationReview and provenance
Artifact SHA-256
4804c801e0e054eca5f776617c18a6a0cb31d6ce3d2a7a52f70e4dda5b3abd7a
Source metadata
Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Data 1-6

Original source ↗

No field-specific location recorded

Version: Nature Communications 16, 10780 (2025); Supplementary Data 1-6 workbook (MOESM3, .xlsm)
Retrieved: 2026-10-13T14:08:10Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_sha256

Source artifact SHA-256: 4804c801e0e054eca5f776617c18a6a0cb31d6ce3d2a7a52f70e4dda5b3abd7a

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Artifact url
https://static-content.springer.com/esm/art%3A10.1038%2Fs41467-025-65823-8/MediaObjects/41467_2025_65823_MOESM3_ESM.xlsm
Source metadata
Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Data 1-6

Original source ↗

No field-specific location recorded

Version: Nature Communications 16, 10780 (2025); Supplementary Data 1-6 workbook (MOESM3, .xlsm)
Retrieved: 2026-10-13T14:08:10Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_url

Source artifact SHA-256: 4804c801e0e054eca5f776617c18a6a0cb31d6ce3d2a7a52f70e4dda5b3abd7a

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Doi
10.1038/s41467-025-65823-8
Source metadata
Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Data 1-6

Original source ↗

No field-specific location recorded

Version: Nature Communications 16, 10780 (2025); Supplementary Data 1-6 workbook (MOESM3, .xlsm)
Retrieved: 2026-10-13T14:08:10Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.doi

Source artifact SHA-256: 4804c801e0e054eca5f776617c18a6a0cb31d6ce3d2a7a52f70e4dda5b3abd7a

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Licence
CC-BY-4.0
Source metadata
Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Data 1-6

Original source ↗

No field-specific location recorded

Version: Nature Communications 16, 10780 (2025); Supplementary Data 1-6 workbook (MOESM3, .xlsm)
Retrieved: 2026-10-13T14:08:10Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.licence

Source artifact SHA-256: 4804c801e0e054eca5f776617c18a6a0cb31d6ce3d2a7a52f70e4dda5b3abd7a

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Limitations
2 values
  • Supplementary Data 1 and 2 list, per dataset, which models the baseline CNN significantly beat and which beat the CNN (one-sided DeLong p<0.01). The CNN's own AUC values are not printed anywhere in the article or supplement.
  • Supplementary Data 6 gives Enhancer Ensembl the same training and test sizes as Enhancer and a three-class label distribution, although Table 1 reports it as a binary AUC task.
Source metadata
Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Data 1-6

Original source ↗

No field-specific location recorded

Version: Nature Communications 16, 10780 (2025); Supplementary Data 1-6 workbook (MOESM3, .xlsm)
Retrieved: 2026-10-13T14:08:10Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.limitations

Source artifact SHA-256: 4804c801e0e054eca5f776617c18a6a0cb31d6ce3d2a7a52f70e4dda5b3abd7a

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Media type
application/vnd.ms-excel.sheet.macroEnabled.12
Source metadata
Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Data 1-6

Original source ↗

No field-specific location recorded

Version: Nature Communications 16, 10780 (2025); Supplementary Data 1-6 workbook (MOESM3, .xlsm)
Retrieved: 2026-10-13T14:08:10Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.media_type

Source artifact SHA-256: 4804c801e0e054eca5f776617c18a6a0cb31d6ce3d2a7a52f70e4dda5b3abd7a

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Publication status
peer_reviewed
Source metadata
Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Data 1-6

Original source ↗

No field-specific location recorded

Version: Nature Communications 16, 10780 (2025); Supplementary Data 1-6 workbook (MOESM3, .xlsm)
Retrieved: 2026-10-13T14:08:10Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.publication_status

Source artifact SHA-256: 4804c801e0e054eca5f776617c18a6a0cb31d6ce3d2a7a52f70e4dda5b3abd7a

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Retrieved at
2026-10-13T14:08:10Z
Source metadata
Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Data 1-6

Original source ↗

No field-specific location recorded

Version: Nature Communications 16, 10780 (2025); Supplementary Data 1-6 workbook (MOESM3, .xlsm)
Retrieved: 2026-10-13T14:08:10Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.retrieved_at

Source artifact SHA-256: 4804c801e0e054eca5f776617c18a6a0cb31d6ce3d2a7a52f70e4dda5b3abd7a

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Review: artifact sha256
4804c801e0e054eca5f776617c18a6a0cb31d6ce3d2a7a52f70e4dda5b3abd7a
Source metadata
Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Data 1-6

Original source ↗

No field-specific location recorded

Version: Nature Communications 16, 10780 (2025); Supplementary Data 1-6 workbook (MOESM3, .xlsm)
Retrieved: 2026-10-13T14:08:10Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.review.artifact_sha256

Source artifact SHA-256: 4804c801e0e054eca5f776617c18a6a0cb31d6ce3d2a7a52f70e4dda5b3abd7a

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Review: method note
Re-downloaded and matched; the archived artifacts/MOESM3_ESM.xlsm.gz decompresses to the same bytes. Read all seven sheets.
Source metadata
Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Data 1-6

Original source ↗

No field-specific location recorded

Version: Nature Communications 16, 10780 (2025); Supplementary Data 1-6 workbook (MOESM3, .xlsm)
Retrieved: 2026-10-13T14:08:10Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.review.method_note

Source artifact SHA-256: 4804c801e0e054eca5f776617c18a6a0cb31d6ce3d2a7a52f70e4dda5b3abd7a

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-02-a7f03c9e55a5 · Record review: source checked

Supplementary Data workbook of Feng et al. 2025 (Nature Communications 16:10780), retrieved and hashed for rewire-benchmark-data#19.

Release history

No supporting source is linked yet.

Read original source

Download this release (gzip)
Technical metadata and extraction receipts

Stable ID: feng-dna-fm-20261013-source-supplementary-data

areas
dna-genomes
contexts
research
doi
10.1038/s41467-025-65823-8
publication status
peer_reviewed
licence
CC-BY-4.0
url
https://doi.org/10.1038/s41467-025-65823-8
retrieved at
2026-10-13T14:08:10Z
artifact url
https://static-content.springer.com/esm/art%3A10.1038%2Fs41467-025-65823-8/MediaObjects/41467_2025_65823_MOESM3_ESM.xlsm
artifact sha256
4804c801e0e054eca5f776617c18a6a0cb31d6ce3d2a7a52f70e4dda5b3abd7a
media type
application/vnd.ms-excel.sheet.macroEnabled.12
version
Nature Communications 16, 10780 (2025); Supplementary Data 1-6 workbook (MOESM3, .xlsm)
limitations
Supplementary Data 1 and 2 list, per dataset, which models the baseline CNN significantly beat and which beat the CNN (one-sided DeLong p<0.01). The CNN's own AUC values are not printed anywhere in the article or supplement.; Supplementary Data 6 gives Enhancer Ensembl the same training and test sizes as Enhancer and a three-class label distribution, although Table 1 reports it as a binary AUC task.
review
method: source-hash-verification; ai-assisted-source-review; method note: Re-downloaded and matched; the archived artifacts/MOESM3_ESM.xlsm.gz decompresses to the same bytes. Read all seven sheets.; reviewer: claude; reviewer note: Independent Claude (Opus 5.5) review agent, separate from the extraction agent feng-19 that built this batch. Automated review only; no human review claimed. Transcription, not reproduction.; reviewed at: 2026-10-13T14:40:00Z; artifact sha256: 4804c801e0e054eca5f776617c18a6a0cb31d6ce3d2a7a52f70e4dda5b3abd7a; retrieval url: https://static-content.springer.com/esm/art%3A10.1038%2Fs41467-025-65823-8/MediaObjects/41467_2025_65823_MOESM3_ESM.xlsm; note: Identity, version, licence and limitations checked against the artifact.
Related records

    Suggest a correction