| Configuration: Caduceus-Ph (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP short-window dataset | 0.696 AUROC (task: pathogenic vs common snp) unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ph pathogenic/common SNP evaluation Table 5, frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks · Table 5, Caduceus-Ph row, AUC column (deterministic XML extraction) |
|---|
| Configuration: Caduceus-Ph (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP short-window dataset | 0.735 Cohen's d (task: pathogenic vs common snp) unitless · unknown Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ph pathogenic/common SNP evaluation Table 5, frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks · Table 5, Caduceus-Ph row, Cohen's d column (deterministic XML extraction). Signed effect size; the source does not state a universal desirable sign/direction, so direction is recorded as unknown rather than assumed higher-is-better. |
|---|
| Configuration: DNABERT-2 (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP short-window dataset | 0.538 AUROC (task: pathogenic vs common snp) unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNABERT-2 pathogenic/common SNP evaluation Table 5, frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks · Table 5, DNABERT-2 row, AUC column (deterministic XML extraction) |
|---|
| Configuration: DNABERT-2 (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP short-window dataset | 0.134 Cohen's d (task: pathogenic vs common snp) unitless · unknown Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNABERT-2 pathogenic/common SNP evaluation Table 5, frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks · Table 5, DNABERT-2 row, Cohen's d column (deterministic XML extraction). Signed effect size; the source does not state a universal desirable sign/direction, so direction is recorded as unknown rather than assumed higher-is-better. |
|---|
| Configuration: GROVER (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP short-window dataset | 0.603 AUROC (task: pathogenic vs common snp) unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceGROVER pathogenic/common SNP evaluation Table 5, frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks · Table 5, GROVER row, AUC column (deterministic XML extraction) |
|---|
| Configuration: GROVER (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP short-window dataset | 0.369 Cohen's d (task: pathogenic vs common snp) unitless · unknown Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceGROVER pathogenic/common SNP evaluation Table 5, frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks · Table 5, GROVER row, Cohen's d column (deterministic XML extraction). Signed effect size; the source does not state a universal desirable sign/direction, so direction is recorded as unknown rather than assumed higher-is-better. |
|---|
| Configuration: HyenaDNA (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP short-window dataset | 0.612 AUROC (task: pathogenic vs common snp) unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceHyenaDNA pathogenic/common SNP evaluation Table 5, frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks · Table 5, HyenaDNA row, AUC column (deterministic XML extraction) |
|---|
| Configuration: HyenaDNA (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP short-window dataset | 0.395 Cohen's d (task: pathogenic vs common snp) unitless · unknown Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceHyenaDNA pathogenic/common SNP evaluation Table 5, frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks · Table 5, HyenaDNA row, Cohen's d column (deterministic XML extraction). Signed effect size; the source does not state a universal desirable sign/direction, so direction is recorded as unknown rather than assumed higher-is-better. |
|---|
| Configuration: NT-v2 (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP short-window dataset | 0.732 AUROC (task: pathogenic vs common snp) unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceNT-v2 pathogenic/common SNP evaluation Table 5, frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks · Table 5, NT-v2 row, AUC column (deterministic XML extraction) |
|---|
| Configuration: NT-v2 (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP short-window dataset | 0.881 Cohen's d (task: pathogenic vs common snp) unitless · unknown Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceNT-v2 pathogenic/common SNP evaluation Table 5, frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks · Table 5, NT-v2 row, Cohen's d column (deterministic XML extraction). Signed effect size; the source does not state a universal desirable sign/direction, so direction is recorded as unknown rather than assumed higher-is-better. |
|---|
| Configuration: Sei, hidden states* (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP short-window dataset | 0.66 AUROC (task: pathogenic vs common snp) unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceSei, hidden states* pathogenic/common SNP evaluation Table 5, frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks · Table 5, Sei, hidden states* row, AUC column (deterministic XML extraction) |
|---|
| Configuration: Sei, hidden states* (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP short-window dataset | 0.557 Cohen's d (task: pathogenic vs common snp) unitless · unknown Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceSei, hidden states* pathogenic/common SNP evaluation Table 5, frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks · Table 5, Sei, hidden states* row, Cohen's d column (deterministic XML extraction). Signed effect size; the source does not state a universal desirable sign/direction, so direction is recorded as unknown rather than assumed higher-is-better. |
|---|
| Configuration: Sei, output tracks* (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP short-window dataset | 0.664 AUROC (task: pathogenic vs common snp) unitless · higher Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceSei, output tracks* pathogenic/common SNP evaluation Table 5, frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks · Table 5, Sei, output tracks* row, AUC column (deterministic XML extraction) |
|---|
| Configuration: Sei, output tracks* (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP short-window dataset | 0.605 Cohen's d (task: pathogenic vs common snp) unitless · unknown Uncertainty: Not yet extracted Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceSei, output tracks* pathogenic/common SNP evaluation Table 5, frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks · Table 5, Sei, output tracks* row, Cohen's d column (deterministic XML extraction). Signed effect size; the source does not state a universal desirable sign/direction, so direction is recorded as unknown rather than assumed higher-is-better. |
|---|
| Configuration: Caduceus-Ph (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP short-window dataset | 0.704 AUROC (task: pathogenic vs common snp; outer test group 1 only (chromosomes 3, 6, 9, 12, 16, 18, 19, 21), not averaged) unitless · higher Uncertainty: Not reported by the source: Supplementary Data 4 prints one AUC per test group, with no interval. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ph Pathogenic variants vs common per-test-group evaluation Table 5 set-up, AUC reported separately for each outer chromosome test group (Supplementary Data 4); frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Data 1-6 · Supplementary Data 4 (workbook sheet 'Data 4'), block 'Pathogenic variants vs common', row 'Caduceus-Ph', column 'Test Group 1 AUC' (cell B3). Test group 1 is chromosomes 3, 6, 9, 12, 16, 18, 19, 21 (Methods, 'Variant effect quantification benchmark'). |
|---|
| Configuration: Caduceus-Ph (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP short-window dataset | 0.688 AUROC (task: pathogenic vs common snp; outer test group 2 only (chromosomes 2, 5, 11, 14, 17, 20, 22, X), not averaged) unitless · higher Uncertainty: Not reported by the source: Supplementary Data 4 prints one AUC per test group, with no interval. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ph Pathogenic variants vs common per-test-group evaluation Table 5 set-up, AUC reported separately for each outer chromosome test group (Supplementary Data 4); frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Data 1-6 · Supplementary Data 4 (workbook sheet 'Data 4'), block 'Pathogenic variants vs common', row 'Caduceus-Ph', column 'Test Group 2 AUC' (cell C3). Test group 2 is chromosomes 2, 5, 11, 14, 17, 20, 22, X (Methods, 'Variant effect quantification benchmark'). |
|---|
| Configuration: Caduceus-Ph (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP short-window dataset | 0.696 AUROC (task: pathogenic vs common snp; outer test group 3 only (chromosomes 1, 4, 7, 8, 10, 13, 15), not averaged) unitless · higher Uncertainty: Not reported by the source: Supplementary Data 4 prints one AUC per test group, with no interval. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ph Pathogenic variants vs common per-test-group evaluation Table 5 set-up, AUC reported separately for each outer chromosome test group (Supplementary Data 4); frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Data 1-6 · Supplementary Data 4 (workbook sheet 'Data 4'), block 'Pathogenic variants vs common', row 'Caduceus-Ph', column 'Test Group 3 AUC' (cell D3). Test group 3 is chromosomes 1, 4, 7, 8, 10, 13, 15 (Methods, 'Variant effect quantification benchmark'). |
|---|
| Configuration: DNABERT-2 (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP short-window dataset | 0.547 AUROC (task: pathogenic vs common snp; outer test group 1 only (chromosomes 3, 6, 9, 12, 16, 18, 19, 21), not averaged) unitless · higher Uncertainty: Not reported by the source: Supplementary Data 4 prints one AUC per test group, with no interval. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNABERT-2 Pathogenic variants vs common per-test-group evaluation Table 5 set-up, AUC reported separately for each outer chromosome test group (Supplementary Data 4); frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Data 1-6 · Supplementary Data 4 (workbook sheet 'Data 4'), block 'Pathogenic variants vs common', row 'DNABERT-2', column 'Test Group 1 AUC' (cell B5). Test group 1 is chromosomes 3, 6, 9, 12, 16, 18, 19, 21 (Methods, 'Variant effect quantification benchmark'). |
|---|
| Configuration: DNABERT-2 (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP short-window dataset | 0.532 AUROC (task: pathogenic vs common snp; outer test group 2 only (chromosomes 2, 5, 11, 14, 17, 20, 22, X), not averaged) unitless · higher Uncertainty: Not reported by the source: Supplementary Data 4 prints one AUC per test group, with no interval. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNABERT-2 Pathogenic variants vs common per-test-group evaluation Table 5 set-up, AUC reported separately for each outer chromosome test group (Supplementary Data 4); frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Data 1-6 · Supplementary Data 4 (workbook sheet 'Data 4'), block 'Pathogenic variants vs common', row 'DNABERT-2', column 'Test Group 2 AUC' (cell C5). Test group 2 is chromosomes 2, 5, 11, 14, 17, 20, 22, X (Methods, 'Variant effect quantification benchmark'). |
|---|
| Configuration: DNABERT-2 (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP short-window dataset | 0.535 AUROC (task: pathogenic vs common snp; outer test group 3 only (chromosomes 1, 4, 7, 8, 10, 13, 15), not averaged) unitless · higher Uncertainty: Not reported by the source: Supplementary Data 4 prints one AUC per test group, with no interval. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNABERT-2 Pathogenic variants vs common per-test-group evaluation Table 5 set-up, AUC reported separately for each outer chromosome test group (Supplementary Data 4); frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Data 1-6 · Supplementary Data 4 (workbook sheet 'Data 4'), block 'Pathogenic variants vs common', row 'DNABERT-2', column 'Test Group 3 AUC' (cell D5). Test group 3 is chromosomes 1, 4, 7, 8, 10, 13, 15 (Methods, 'Variant effect quantification benchmark'). |
|---|
| Configuration: GROVER (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP short-window dataset | 0.606 AUROC (task: pathogenic vs common snp; outer test group 1 only (chromosomes 3, 6, 9, 12, 16, 18, 19, 21), not averaged) unitless · higher Uncertainty: Not reported by the source: Supplementary Data 4 prints one AUC per test group, with no interval. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceGROVER Pathogenic variants vs common per-test-group evaluation Table 5 set-up, AUC reported separately for each outer chromosome test group (Supplementary Data 4); frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Data 1-6 · Supplementary Data 4 (workbook sheet 'Data 4'), block 'Pathogenic variants vs common', row 'GROVER', column 'Test Group 1 AUC' (cell B8). Test group 1 is chromosomes 3, 6, 9, 12, 16, 18, 19, 21 (Methods, 'Variant effect quantification benchmark'). |
|---|
| Configuration: GROVER (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP short-window dataset | 0.594 AUROC (task: pathogenic vs common snp; outer test group 2 only (chromosomes 2, 5, 11, 14, 17, 20, 22, X), not averaged) unitless · higher Uncertainty: Not reported by the source: Supplementary Data 4 prints one AUC per test group, with no interval. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceGROVER Pathogenic variants vs common per-test-group evaluation Table 5 set-up, AUC reported separately for each outer chromosome test group (Supplementary Data 4); frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Data 1-6 · Supplementary Data 4 (workbook sheet 'Data 4'), block 'Pathogenic variants vs common', row 'GROVER', column 'Test Group 2 AUC' (cell C8). Test group 2 is chromosomes 2, 5, 11, 14, 17, 20, 22, X (Methods, 'Variant effect quantification benchmark'). |
|---|
| Configuration: GROVER (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP short-window dataset | 0.609 AUROC (task: pathogenic vs common snp; outer test group 3 only (chromosomes 1, 4, 7, 8, 10, 13, 15), not averaged) unitless · higher Uncertainty: Not reported by the source: Supplementary Data 4 prints one AUC per test group, with no interval. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceGROVER Pathogenic variants vs common per-test-group evaluation Table 5 set-up, AUC reported separately for each outer chromosome test group (Supplementary Data 4); frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Data 1-6 · Supplementary Data 4 (workbook sheet 'Data 4'), block 'Pathogenic variants vs common', row 'GROVER', column 'Test Group 3 AUC' (cell D8). Test group 3 is chromosomes 1, 4, 7, 8, 10, 13, 15 (Methods, 'Variant effect quantification benchmark'). |
|---|
| Configuration: HyenaDNA (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP short-window dataset | 0.624 AUROC (task: pathogenic vs common snp; outer test group 1 only (chromosomes 3, 6, 9, 12, 16, 18, 19, 21), not averaged) unitless · higher Uncertainty: Not reported by the source: Supplementary Data 4 prints one AUC per test group, with no interval. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceHyenaDNA-160K Pathogenic variants vs common per-test-group evaluation Table 5 set-up, AUC reported separately for each outer chromosome test group (Supplementary Data 4); frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Data 1-6 · Supplementary Data 4 (workbook sheet 'Data 4'), block 'Pathogenic variants vs common', row 'HyenaDNA-160K', column 'Test Group 1 AUC' (cell B9). Test group 1 is chromosomes 3, 6, 9, 12, 16, 18, 19, 21 (Methods, 'Variant effect quantification benchmark'). |
|---|
| Configuration: HyenaDNA (pathogenic/common SNP classification) | Protocol: Feng pathogenic-versus-common SNP classification Dataset: Feng pathogenic/common SNP short-window dataset | 0.616 AUROC (task: pathogenic vs common snp; outer test group 2 only (chromosomes 2, 5, 11, 14, 17, 20, 22, X), not averaged) unitless · higher Uncertainty: Not reported by the source: Supplementary Data 4 prints one AUC per test group, with no interval. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceHyenaDNA-160K Pathogenic variants vs common per-test-group evaluation Table 5 set-up, AUC reported separately for each outer chromosome test group (Supplementary Data 4); frozen embeddings + random forest classifier Aggregation: Not reported Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Data 1-6 · Supplementary Data 4 (workbook sheet 'Data 4'), block 'Pathogenic variants vs common', row 'HyenaDNA-160K', column 'Test Group 2 AUC' (cell C9). Test group 2 is chromosomes 2, 5, 11, 14, 17, 20, 22, X (Methods, 'Variant effect quantification benchmark'). |
|---|