| Configuration: Caduceus-Ph, long sequence (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP long-window dataset | 0.624 AUROC (task: pathogenic vs common snp) unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ph, long sequence pathogenic/common SNP evaluation Table 5, frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks · Table 5, Caduceus-Ph, long sequence row, AUC column (deterministic XML extraction) |
|---|
| Configuration: Caduceus-Ph, long sequence (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP long-window dataset | 0.462 Cohen's d (task: pathogenic vs common snp) unitless · unknown Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ph, long sequence pathogenic/common SNP evaluation Table 5, frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks · Table 5, Caduceus-Ph, long sequence row, Cohen's d column (deterministic XML extraction). Signed effect size; the source does not state a universal desirable sign/direction, so direction is recorded as unknown rather than assumed higher-is-better. |
|---|
| Configuration: Enformer, hidden states* (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP long-window dataset | 0.688 AUROC (task: pathogenic vs common snp) unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceEnformer, hidden states* pathogenic/common SNP evaluation Table 5, frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks · Table 5, Enformer, hidden states* row, AUC column (deterministic XML extraction) |
|---|
| Configuration: Enformer, hidden states* (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP long-window dataset | 0.727 Cohen's d (task: pathogenic vs common snp) unitless · unknown Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceEnformer, hidden states* pathogenic/common SNP evaluation Table 5, frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks · Table 5, Enformer, hidden states* row, Cohen's d column (deterministic XML extraction). Signed effect size; the source does not state a universal desirable sign/direction, so direction is recorded as unknown rather than assumed higher-is-better. |
|---|
| Configuration: Enformer, output tracks* (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP long-window dataset | 0.666 AUROC (task: pathogenic vs common snp) unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceEnformer, output tracks* pathogenic/common SNP evaluation Table 5, frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks · Table 5, Enformer, output tracks* row, AUC column (deterministic XML extraction) |
|---|
| Configuration: Enformer, output tracks* (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP long-window dataset | 0.654 Cohen's d (task: pathogenic vs common snp) unitless · unknown Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceEnformer, output tracks* pathogenic/common SNP evaluation Table 5, frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks · Table 5, Enformer, output tracks* row, Cohen's d column (deterministic XML extraction). Signed effect size; the source does not state a universal desirable sign/direction, so direction is recorded as unknown rather than assumed higher-is-better. |
|---|
| Configuration: HyenaDNA-450K, long sequence (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP long-window dataset | 0.626 AUROC (task: pathogenic vs common snp) unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceHyenaDNA-450K, long sequence pathogenic/common SNP evaluation Table 5, frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks · Table 5, HyenaDNA-450K, long sequence row, AUC column (deterministic XML extraction) |
|---|
| Configuration: HyenaDNA-450K, long sequence (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP long-window dataset | 0.449 Cohen's d (task: pathogenic vs common snp) unitless · unknown Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceHyenaDNA-450K, long sequence pathogenic/common SNP evaluation Table 5, frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks · Table 5, HyenaDNA-450K, long sequence row, Cohen's d column (deterministic XML extraction). Signed effect size; the source does not state a universal desirable sign/direction, so direction is recorded as unknown rather than assumed higher-is-better. |
|---|
| Configuration: Caduceus-Ph, long sequence (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP long-window dataset | 0.63 AUROC (task: pathogenic vs common snp; outer test group 1 only (chromosomes 3, 6, 9, 12, 16, 18, 19, 21), not averaged) unitless · higher Uncertainty: Not reported by the source: Supplementary Data 4 prints one AUC per test group, with no interval. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ph, long sequence Pathogenic variants vs common per-test-group evaluation Table 5 set-up, AUC reported separately for each outer chromosome test group (Supplementary Data 4); frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Data 1-6 · Supplementary Data 4 (workbook sheet 'Data 4'), block 'Pathogenic variants vs common', row 'Caduceus-Ph, long sequence', column 'Test Group 1 AUC' (cell B4). Test group 1 is chromosomes 3, 6, 9, 12, 16, 18, 19, 21 (Methods, 'Variant effect quantification benchmark'). |
|---|
| Configuration: Caduceus-Ph, long sequence (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP long-window dataset | 0.618 AUROC (task: pathogenic vs common snp; outer test group 2 only (chromosomes 2, 5, 11, 14, 17, 20, 22, X), not averaged) unitless · higher Uncertainty: Not reported by the source: Supplementary Data 4 prints one AUC per test group, with no interval. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ph, long sequence Pathogenic variants vs common per-test-group evaluation Table 5 set-up, AUC reported separately for each outer chromosome test group (Supplementary Data 4); frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Data 1-6 · Supplementary Data 4 (workbook sheet 'Data 4'), block 'Pathogenic variants vs common', row 'Caduceus-Ph, long sequence', column 'Test Group 2 AUC' (cell C4). Test group 2 is chromosomes 2, 5, 11, 14, 17, 20, 22, X (Methods, 'Variant effect quantification benchmark'). |
|---|
| Configuration: Caduceus-Ph, long sequence (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP long-window dataset | 0.625 AUROC (task: pathogenic vs common snp; outer test group 3 only (chromosomes 1, 4, 7, 8, 10, 13, 15), not averaged) unitless · higher Uncertainty: Not reported by the source: Supplementary Data 4 prints one AUC per test group, with no interval. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ph, long sequence Pathogenic variants vs common per-test-group evaluation Table 5 set-up, AUC reported separately for each outer chromosome test group (Supplementary Data 4); frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Data 1-6 · Supplementary Data 4 (workbook sheet 'Data 4'), block 'Pathogenic variants vs common', row 'Caduceus-Ph, long sequence', column 'Test Group 3 AUC' (cell D4). Test group 3 is chromosomes 1, 4, 7, 8, 10, 13, 15 (Methods, 'Variant effect quantification benchmark'). |
|---|
| Configuration: Enformer, hidden states* (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP long-window dataset | 0.715 AUROC (task: pathogenic vs common snp; outer test group 1 only (chromosomes 3, 6, 9, 12, 16, 18, 19, 21), not averaged) unitless · higher Uncertainty: Not reported by the source: Supplementary Data 4 prints one AUC per test group, with no interval. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceEnformer, hidden states Pathogenic variants vs common per-test-group evaluation Table 5 set-up, AUC reported separately for each outer chromosome test group (Supplementary Data 4); frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Data 1-6 · Supplementary Data 4 (workbook sheet 'Data 4'), block 'Pathogenic variants vs common', row 'Enformer, hidden states', column 'Test Group 1 AUC' (cell B6). Test group 1 is chromosomes 3, 6, 9, 12, 16, 18, 19, 21 (Methods, 'Variant effect quantification benchmark'). |
|---|
| Configuration: Enformer, hidden states* (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP long-window dataset | 0.657 AUROC (task: pathogenic vs common snp; outer test group 2 only (chromosomes 2, 5, 11, 14, 17, 20, 22, X), not averaged) unitless · higher Uncertainty: Not reported by the source: Supplementary Data 4 prints one AUC per test group, with no interval. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceEnformer, hidden states Pathogenic variants vs common per-test-group evaluation Table 5 set-up, AUC reported separately for each outer chromosome test group (Supplementary Data 4); frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Data 1-6 · Supplementary Data 4 (workbook sheet 'Data 4'), block 'Pathogenic variants vs common', row 'Enformer, hidden states', column 'Test Group 2 AUC' (cell C6). Test group 2 is chromosomes 2, 5, 11, 14, 17, 20, 22, X (Methods, 'Variant effect quantification benchmark'). |
|---|
| Configuration: Enformer, hidden states* (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP long-window dataset | 0.692 AUROC (task: pathogenic vs common snp; outer test group 3 only (chromosomes 1, 4, 7, 8, 10, 13, 15), not averaged) unitless · higher Uncertainty: Not reported by the source: Supplementary Data 4 prints one AUC per test group, with no interval. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceEnformer, hidden states Pathogenic variants vs common per-test-group evaluation Table 5 set-up, AUC reported separately for each outer chromosome test group (Supplementary Data 4); frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Data 1-6 · Supplementary Data 4 (workbook sheet 'Data 4'), block 'Pathogenic variants vs common', row 'Enformer, hidden states', column 'Test Group 3 AUC' (cell D6). Test group 3 is chromosomes 1, 4, 7, 8, 10, 13, 15 (Methods, 'Variant effect quantification benchmark'). |
|---|
| Configuration: Enformer, output tracks* (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP long-window dataset | 0.681 AUROC (task: pathogenic vs common snp; outer test group 1 only (chromosomes 3, 6, 9, 12, 16, 18, 19, 21), not averaged) unitless · higher Uncertainty: Not reported by the source: Supplementary Data 4 prints one AUC per test group, with no interval. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceEnformer, output tracks Pathogenic variants vs common per-test-group evaluation Table 5 set-up, AUC reported separately for each outer chromosome test group (Supplementary Data 4); frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Data 1-6 · Supplementary Data 4 (workbook sheet 'Data 4'), block 'Pathogenic variants vs common', row 'Enformer, output tracks', column 'Test Group 1 AUC' (cell B7). Test group 1 is chromosomes 3, 6, 9, 12, 16, 18, 19, 21 (Methods, 'Variant effect quantification benchmark'). |
|---|
| Configuration: Enformer, output tracks* (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP long-window dataset | 0.648 AUROC (task: pathogenic vs common snp; outer test group 2 only (chromosomes 2, 5, 11, 14, 17, 20, 22, X), not averaged) unitless · higher Uncertainty: Not reported by the source: Supplementary Data 4 prints one AUC per test group, with no interval. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceEnformer, output tracks Pathogenic variants vs common per-test-group evaluation Table 5 set-up, AUC reported separately for each outer chromosome test group (Supplementary Data 4); frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Data 1-6 · Supplementary Data 4 (workbook sheet 'Data 4'), block 'Pathogenic variants vs common', row 'Enformer, output tracks', column 'Test Group 2 AUC' (cell C7). Test group 2 is chromosomes 2, 5, 11, 14, 17, 20, 22, X (Methods, 'Variant effect quantification benchmark'). |
|---|
| Configuration: Enformer, output tracks* (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP long-window dataset | 0.67 AUROC (task: pathogenic vs common snp; outer test group 3 only (chromosomes 1, 4, 7, 8, 10, 13, 15), not averaged) unitless · higher Uncertainty: Not reported by the source: Supplementary Data 4 prints one AUC per test group, with no interval. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceEnformer, output tracks Pathogenic variants vs common per-test-group evaluation Table 5 set-up, AUC reported separately for each outer chromosome test group (Supplementary Data 4); frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Data 1-6 · Supplementary Data 4 (workbook sheet 'Data 4'), block 'Pathogenic variants vs common', row 'Enformer, output tracks', column 'Test Group 3 AUC' (cell D7). Test group 3 is chromosomes 1, 4, 7, 8, 10, 13, 15 (Methods, 'Variant effect quantification benchmark'). |
|---|
| Configuration: HyenaDNA-450K, long sequence (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP long-window dataset | 0.636 AUROC (task: pathogenic vs common snp; outer test group 1 only (chromosomes 3, 6, 9, 12, 16, 18, 19, 21), not averaged) unitless · higher Uncertainty: Not reported by the source: Supplementary Data 4 prints one AUC per test group, with no interval. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceHyenaDNA-450K, long sequence Pathogenic variants vs common per-test-group evaluation Table 5 set-up, AUC reported separately for each outer chromosome test group (Supplementary Data 4); frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Data 1-6 · Supplementary Data 4 (workbook sheet 'Data 4'), block 'Pathogenic variants vs common', row 'HyenaDNA-450K, long sequence', column 'Test Group 1 AUC' (cell B10). Test group 1 is chromosomes 3, 6, 9, 12, 16, 18, 19, 21 (Methods, 'Variant effect quantification benchmark'). |
|---|
| Configuration: HyenaDNA-450K, long sequence (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP long-window dataset | 0.622 AUROC (task: pathogenic vs common snp; outer test group 2 only (chromosomes 2, 5, 11, 14, 17, 20, 22, X), not averaged) unitless · higher Uncertainty: Not reported by the source: Supplementary Data 4 prints one AUC per test group, with no interval. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceHyenaDNA-450K, long sequence Pathogenic variants vs common per-test-group evaluation Table 5 set-up, AUC reported separately for each outer chromosome test group (Supplementary Data 4); frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Data 1-6 · Supplementary Data 4 (workbook sheet 'Data 4'), block 'Pathogenic variants vs common', row 'HyenaDNA-450K, long sequence', column 'Test Group 2 AUC' (cell C10). Test group 2 is chromosomes 2, 5, 11, 14, 17, 20, 22, X (Methods, 'Variant effect quantification benchmark'). |
|---|
| Configuration: HyenaDNA-450K, long sequence (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP long-window dataset | 0.621 AUROC (task: pathogenic vs common snp; outer test group 3 only (chromosomes 1, 4, 7, 8, 10, 13, 15), not averaged) unitless · higher Uncertainty: Not reported by the source: Supplementary Data 4 prints one AUC per test group, with no interval. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceHyenaDNA-450K, long sequence Pathogenic variants vs common per-test-group evaluation Table 5 set-up, AUC reported separately for each outer chromosome test group (Supplementary Data 4); frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Data 1-6 · Supplementary Data 4 (workbook sheet 'Data 4'), block 'Pathogenic variants vs common', row 'HyenaDNA-450K, long sequence', column 'Test Group 3 AUC' (cell D10). Test group 3 is chromosomes 1, 4, 7, 8, 10, 13, 15 (Methods, 'Variant effect quantification benchmark'). |
|---|