| Configuration: Caduceus-Ps (zero-shot, GFMBench-API) | Protocol: GFMBench-API Songlab ClinVar, zs-embedding Dataset: Songlab ClinVar test set (GFMBench-API) | 0.996 AUPRC (zero-shot; cosine similarity of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ps on GFMBench-API Songlab ClinVar (zs-embedding) lit-genomics-20261011-gfmbench-protocol-songlab-clinvar-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Songlab ClinVar', row 'Caduceus-Ps', column 'Cos AUPRC' |
|---|
| Configuration: Caduceus-Ps (zero-shot, GFMBench-API) | Protocol: GFMBench-API Songlab ClinVar, zs-embedding Dataset: Songlab ClinVar test set (GFMBench-API) | 0.933 AUROC (zero-shot; cosine similarity of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ps on GFMBench-API Songlab ClinVar (zs-embedding) lit-genomics-20261011-gfmbench-protocol-songlab-clinvar-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Songlab ClinVar', row 'Caduceus-Ps', column 'Cos AUROC' |
|---|
| Configuration: Caduceus-Ps (zero-shot, GFMBench-API) | Protocol: GFMBench-API Songlab ClinVar, zs-embedding Dataset: Songlab ClinVar test set (GFMBench-API) | 0.991 AUPRC (zero-shot; L2 distance of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ps on GFMBench-API Songlab ClinVar (zs-embedding) lit-genomics-20261011-gfmbench-protocol-songlab-clinvar-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Songlab ClinVar', row 'Caduceus-Ps', column 'L2 AUPRC' |
|---|
| Configuration: Caduceus-Ps (zero-shot, GFMBench-API) | Protocol: GFMBench-API Songlab ClinVar, zs-embedding Dataset: Songlab ClinVar test set (GFMBench-API) | 0.867 AUROC (zero-shot; L2 distance of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ps on GFMBench-API Songlab ClinVar (zs-embedding) lit-genomics-20261011-gfmbench-protocol-songlab-clinvar-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Songlab ClinVar', row 'Caduceus-Ps', column 'L2 AUROC' |
|---|
| Configuration: Caduceus-Ps (zero-shot, GFMBench-API) | Protocol: GFMBench-API Songlab ClinVar, zs-embedding Dataset: Songlab ClinVar test set (GFMBench-API) | 0.991 AUPRC (zero-shot; cosine similarity of embeddings at the SNV position) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ps on GFMBench-API Songlab ClinVar (zs-embedding) lit-genomics-20261011-gfmbench-protocol-songlab-clinvar-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Songlab ClinVar', row 'Caduceus-Ps', column 'SNV Cos AUPRC' |
|---|
| Configuration: Caduceus-Ps (zero-shot, GFMBench-API) | Protocol: GFMBench-API Songlab ClinVar, zs-embedding Dataset: Songlab ClinVar test set (GFMBench-API) | 0.867 AUROC (zero-shot; cosine similarity of embeddings at the SNV position) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ps on GFMBench-API Songlab ClinVar (zs-embedding) lit-genomics-20261011-gfmbench-protocol-songlab-clinvar-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Songlab ClinVar', row 'Caduceus-Ps', column 'SNV Cos AUROC' |
|---|
| Configuration: Caduceus-Ps (zero-shot, GFMBench-API) | Protocol: GFMBench-API Songlab ClinVar, zs-mlm-llr Dataset: Songlab ClinVar test set (GFMBench-API) | 0.546 AUPRC (zero-shot; masked log-likelihood ratio) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ps on GFMBench-API Songlab ClinVar (zs-mlm-llr) lit-genomics-20261011-gfmbench-protocol-songlab-clinvar-zs-mlm-llr Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 4, task 'Songlab ClinVar', row 'Caduceus-Ps', column 'Msk LLR PRC' |
|---|
| Configuration: Caduceus-Ps (zero-shot, GFMBench-API) | Protocol: GFMBench-API Songlab ClinVar, zs-mlm-llr Dataset: Songlab ClinVar test set (GFMBench-API) | 0.522 AUROC (zero-shot; masked log-likelihood ratio) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ps on GFMBench-API Songlab ClinVar (zs-mlm-llr) lit-genomics-20261011-gfmbench-protocol-songlab-clinvar-zs-mlm-llr Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 4, task 'Songlab ClinVar', row 'Caduceus-Ps', column 'Msk LLR ROC' |
|---|
| Configuration: DNA-BERT (zero-shot, GFMBench-API) | Protocol: GFMBench-API Songlab ClinVar, zs-embedding Dataset: Songlab ClinVar test set (GFMBench-API) | 0.55 AUPRC (zero-shot; cosine similarity of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNA-BERT on GFMBench-API Songlab ClinVar (zs-embedding) lit-genomics-20261011-gfmbench-protocol-songlab-clinvar-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Songlab ClinVar', row 'DNA-BERT', column 'Cos AUPRC' |
|---|
| Configuration: DNA-BERT (zero-shot, GFMBench-API) | Protocol: GFMBench-API Songlab ClinVar, zs-embedding Dataset: Songlab ClinVar test set (GFMBench-API) | 0.51 AUROC (zero-shot; cosine similarity of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNA-BERT on GFMBench-API Songlab ClinVar (zs-embedding) lit-genomics-20261011-gfmbench-protocol-songlab-clinvar-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Songlab ClinVar', row 'DNA-BERT', column 'Cos AUROC' |
|---|
| Configuration: DNA-BERT (zero-shot, GFMBench-API) | Protocol: GFMBench-API Songlab ClinVar, zs-embedding Dataset: Songlab ClinVar test set (GFMBench-API) | 0.55 AUPRC (zero-shot; L2 distance of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNA-BERT on GFMBench-API Songlab ClinVar (zs-embedding) lit-genomics-20261011-gfmbench-protocol-songlab-clinvar-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Songlab ClinVar', row 'DNA-BERT', column 'L2 AUPRC' |
|---|
| Configuration: DNA-BERT (zero-shot, GFMBench-API) | Protocol: GFMBench-API Songlab ClinVar, zs-embedding Dataset: Songlab ClinVar test set (GFMBench-API) | 0.51 AUROC (zero-shot; L2 distance of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNA-BERT on GFMBench-API Songlab ClinVar (zs-embedding) lit-genomics-20261011-gfmbench-protocol-songlab-clinvar-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Songlab ClinVar', row 'DNA-BERT', column 'L2 AUROC' |
|---|
| Configuration: DNA-BERT (zero-shot, GFMBench-API) | Protocol: GFMBench-API Songlab ClinVar, zs-embedding Dataset: Songlab ClinVar test set (GFMBench-API) | 0.567 AUPRC (zero-shot; cosine similarity of embeddings at the SNV position) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNA-BERT on GFMBench-API Songlab ClinVar (zs-embedding) lit-genomics-20261011-gfmbench-protocol-songlab-clinvar-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Songlab ClinVar', row 'DNA-BERT', column 'SNV Cos AUPRC' |
|---|
| Configuration: DNA-BERT (zero-shot, GFMBench-API) | Protocol: GFMBench-API Songlab ClinVar, zs-embedding Dataset: Songlab ClinVar test set (GFMBench-API) | 0.539 AUROC (zero-shot; cosine similarity of embeddings at the SNV position) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNA-BERT on GFMBench-API Songlab ClinVar (zs-embedding) lit-genomics-20261011-gfmbench-protocol-songlab-clinvar-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Songlab ClinVar', row 'DNA-BERT', column 'SNV Cos AUROC' |
|---|
| Configuration: DNA-BERT (zero-shot, GFMBench-API) | Protocol: GFMBench-API Songlab ClinVar, zs-mlm-llr Dataset: Songlab ClinVar test set (GFMBench-API) | 0.503 AUPRC (zero-shot; masked log-likelihood ratio) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNA-BERT on GFMBench-API Songlab ClinVar (zs-mlm-llr) lit-genomics-20261011-gfmbench-protocol-songlab-clinvar-zs-mlm-llr Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 4, task 'Songlab ClinVar', row 'DNA-BERT', column 'Msk LLR PRC' |
|---|
| Configuration: DNA-BERT (zero-shot, GFMBench-API) | Protocol: GFMBench-API Songlab ClinVar, zs-mlm-llr Dataset: Songlab ClinVar test set (GFMBench-API) | 0.452 AUROC (zero-shot; masked log-likelihood ratio) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNA-BERT on GFMBench-API Songlab ClinVar (zs-mlm-llr) lit-genomics-20261011-gfmbench-protocol-songlab-clinvar-zs-mlm-llr Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 4, task 'Songlab ClinVar', row 'DNA-BERT', column 'Msk LLR ROC' |
|---|
| Configuration: DNABERT-2 (zero-shot, GFMBench-API) | Protocol: GFMBench-API Songlab ClinVar, zs-embedding Dataset: Songlab ClinVar test set (GFMBench-API) | 0.547 AUPRC (zero-shot; cosine similarity of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNABERT-2 on GFMBench-API Songlab ClinVar (zs-embedding) lit-genomics-20261011-gfmbench-protocol-songlab-clinvar-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Songlab ClinVar', row 'DNABERT-2', column 'Cos AUPRC' |
|---|
| Configuration: DNABERT-2 (zero-shot, GFMBench-API) | Protocol: GFMBench-API Songlab ClinVar, zs-embedding Dataset: Songlab ClinVar test set (GFMBench-API) | 0.496 AUROC (zero-shot; cosine similarity of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNABERT-2 on GFMBench-API Songlab ClinVar (zs-embedding) lit-genomics-20261011-gfmbench-protocol-songlab-clinvar-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Songlab ClinVar', row 'DNABERT-2', column 'Cos AUROC' |
|---|
| Configuration: DNABERT-2 (zero-shot, GFMBench-API) | Protocol: GFMBench-API Songlab ClinVar, zs-embedding Dataset: Songlab ClinVar test set (GFMBench-API) | 0.547 AUPRC (zero-shot; L2 distance of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNABERT-2 on GFMBench-API Songlab ClinVar (zs-embedding) lit-genomics-20261011-gfmbench-protocol-songlab-clinvar-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Songlab ClinVar', row 'DNABERT-2', column 'L2 AUPRC' |
|---|
| Configuration: DNABERT-2 (zero-shot, GFMBench-API) | Protocol: GFMBench-API Songlab ClinVar, zs-embedding Dataset: Songlab ClinVar test set (GFMBench-API) | 0.495 AUROC (zero-shot; L2 distance of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNABERT-2 on GFMBench-API Songlab ClinVar (zs-embedding) lit-genomics-20261011-gfmbench-protocol-songlab-clinvar-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Songlab ClinVar', row 'DNABERT-2', column 'L2 AUROC' |
|---|
| Configuration: DNABERT-2 (zero-shot, GFMBench-API) | Protocol: GFMBench-API Songlab ClinVar, zs-embedding Dataset: Songlab ClinVar test set (GFMBench-API) | 0.552 AUPRC (zero-shot; cosine similarity of embeddings at the SNV position) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNABERT-2 on GFMBench-API Songlab ClinVar (zs-embedding) lit-genomics-20261011-gfmbench-protocol-songlab-clinvar-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Songlab ClinVar', row 'DNABERT-2', column 'SNV Cos AUPRC' |
|---|
| Configuration: DNABERT-2 (zero-shot, GFMBench-API) | Protocol: GFMBench-API Songlab ClinVar, zs-embedding Dataset: Songlab ClinVar test set (GFMBench-API) | 0.501 AUROC (zero-shot; cosine similarity of embeddings at the SNV position) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNABERT-2 on GFMBench-API Songlab ClinVar (zs-embedding) lit-genomics-20261011-gfmbench-protocol-songlab-clinvar-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Songlab ClinVar', row 'DNABERT-2', column 'SNV Cos AUROC' |
|---|
| Configuration: DNABERT-2 (zero-shot, GFMBench-API) | Protocol: GFMBench-API Songlab ClinVar, zs-mlm-llr Dataset: Songlab ClinVar test set (GFMBench-API) | 0.553 AUPRC (zero-shot; masked log-likelihood ratio) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNABERT-2 on GFMBench-API Songlab ClinVar (zs-mlm-llr) lit-genomics-20261011-gfmbench-protocol-songlab-clinvar-zs-mlm-llr Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 4, task 'Songlab ClinVar', row 'DNABERT-2', column 'Msk LLR PRC' |
|---|
| Configuration: DNABERT-2 (zero-shot, GFMBench-API) | Protocol: GFMBench-API Songlab ClinVar, zs-mlm-llr Dataset: Songlab ClinVar test set (GFMBench-API) | 0.519 AUROC (zero-shot; masked log-likelihood ratio) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNABERT-2 on GFMBench-API Songlab ClinVar (zs-mlm-llr) lit-genomics-20261011-gfmbench-protocol-songlab-clinvar-zs-mlm-llr Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 4, task 'Songlab ClinVar', row 'DNABERT-2', column 'Msk LLR ROC' |
|---|
| Configuration: Evo2 (zero-shot, GFMBench-API) | Protocol: GFMBench-API Songlab ClinVar, zs-ar-llr Dataset: Songlab ClinVar test set (GFMBench-API) | 0.933 AUPRC (zero-shot; autoregressive log-likelihood ratio over mean token probabilities) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceEvo2 on GFMBench-API Songlab ClinVar (zs-ar-llr) lit-genomics-20261011-gfmbench-protocol-songlab-clinvar-zs-ar-llr Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 5, task 'Songlab ClinVar', row 'Evo2', column 'Mean LLR PRC' |
|---|