| Configuration: Caduceus-Ps (zero-shot, GFMBench-API) | Protocol: GFMBench-API Bend Variant Effects Disease, zs-embedding Dataset: Bend Variant Effects Disease test set (GFMBench-API) | 0.378 AUPRC (zero-shot; cosine similarity of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ps on GFMBench-API Bend Variant Effects Disease (zs-embedding) lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-disease-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Bend Variant Effects Disease', row 'Caduceus-Ps', column 'Cos AUPRC' |
|---|
| Configuration: Caduceus-Ps (zero-shot, GFMBench-API) | Protocol: GFMBench-API Bend Variant Effects Disease, zs-embedding Dataset: Bend Variant Effects Disease test set (GFMBench-API) | 0.772 AUROC (zero-shot; cosine similarity of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ps on GFMBench-API Bend Variant Effects Disease (zs-embedding) lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-disease-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Bend Variant Effects Disease', row 'Caduceus-Ps', column 'Cos AUROC' |
|---|
| Configuration: Caduceus-Ps (zero-shot, GFMBench-API) | Protocol: GFMBench-API Bend Variant Effects Disease, zs-embedding Dataset: Bend Variant Effects Disease test set (GFMBench-API) | 0.379 AUPRC (zero-shot; L2 distance of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ps on GFMBench-API Bend Variant Effects Disease (zs-embedding) lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-disease-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Bend Variant Effects Disease', row 'Caduceus-Ps', column 'L2 AUPRC' |
|---|
| Configuration: Caduceus-Ps (zero-shot, GFMBench-API) | Protocol: GFMBench-API Bend Variant Effects Disease, zs-embedding Dataset: Bend Variant Effects Disease test set (GFMBench-API) | 0.78 AUROC (zero-shot; L2 distance of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ps on GFMBench-API Bend Variant Effects Disease (zs-embedding) lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-disease-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Bend Variant Effects Disease', row 'Caduceus-Ps', column 'L2 AUROC' |
|---|
| Configuration: Caduceus-Ps (zero-shot, GFMBench-API) | Protocol: GFMBench-API Bend Variant Effects Disease, zs-embedding Dataset: Bend Variant Effects Disease test set (GFMBench-API) | 0.107 AUPRC (zero-shot; cosine similarity of embeddings at the SNV position) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ps on GFMBench-API Bend Variant Effects Disease (zs-embedding) lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-disease-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Bend Variant Effects Disease', row 'Caduceus-Ps', column 'SNV Cos AUPRC' |
|---|
| Configuration: Caduceus-Ps (zero-shot, GFMBench-API) | Protocol: GFMBench-API Bend Variant Effects Disease, zs-embedding Dataset: Bend Variant Effects Disease test set (GFMBench-API) | 0.545 AUROC (zero-shot; cosine similarity of embeddings at the SNV position) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ps on GFMBench-API Bend Variant Effects Disease (zs-embedding) lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-disease-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Bend Variant Effects Disease', row 'Caduceus-Ps', column 'SNV Cos AUROC' |
|---|
| Configuration: Caduceus-Ps (zero-shot, GFMBench-API) | Protocol: GFMBench-API Bend Variant Effects Disease, zs-mlm-llr Dataset: Bend Variant Effects Disease test set (GFMBench-API) | 0.14 AUPRC (zero-shot; masked log-likelihood ratio) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ps on GFMBench-API Bend Variant Effects Disease (zs-mlm-llr) lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-disease-zs-mlm-llr Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 4, task 'Bend Variant Effects Disease', row 'Caduceus-Ps', column 'Msk LLR PRC' |
|---|
| Configuration: Caduceus-Ps (zero-shot, GFMBench-API) | Protocol: GFMBench-API Bend Variant Effects Disease, zs-mlm-llr Dataset: Bend Variant Effects Disease test set (GFMBench-API) | 0.66 AUROC (zero-shot; masked log-likelihood ratio) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ps on GFMBench-API Bend Variant Effects Disease (zs-mlm-llr) lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-disease-zs-mlm-llr Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 4, task 'Bend Variant Effects Disease', row 'Caduceus-Ps', column 'Msk LLR ROC' |
|---|
| Configuration: DNA-BERT (zero-shot, GFMBench-API) | Protocol: GFMBench-API Bend Variant Effects Disease, zs-embedding Dataset: Bend Variant Effects Disease test set (GFMBench-API) | 0.073 AUPRC (zero-shot; cosine similarity of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNA-BERT on GFMBench-API Bend Variant Effects Disease (zs-embedding) lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-disease-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Bend Variant Effects Disease', row 'DNA-BERT', column 'Cos AUPRC' |
|---|
| Configuration: DNA-BERT (zero-shot, GFMBench-API) | Protocol: GFMBench-API Bend Variant Effects Disease, zs-embedding Dataset: Bend Variant Effects Disease test set (GFMBench-API) | 0.509 AUROC (zero-shot; cosine similarity of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNA-BERT on GFMBench-API Bend Variant Effects Disease (zs-embedding) lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-disease-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Bend Variant Effects Disease', row 'DNA-BERT', column 'Cos AUROC' |
|---|
| Configuration: DNA-BERT (zero-shot, GFMBench-API) | Protocol: GFMBench-API Bend Variant Effects Disease, zs-embedding Dataset: Bend Variant Effects Disease test set (GFMBench-API) | 0.0731 AUPRC (zero-shot; L2 distance of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNA-BERT on GFMBench-API Bend Variant Effects Disease (zs-embedding) lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-disease-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Bend Variant Effects Disease', row 'DNA-BERT', column 'L2 AUPRC' |
|---|
| Configuration: DNA-BERT (zero-shot, GFMBench-API) | Protocol: GFMBench-API Bend Variant Effects Disease, zs-embedding Dataset: Bend Variant Effects Disease test set (GFMBench-API) | 0.509 AUROC (zero-shot; L2 distance of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNA-BERT on GFMBench-API Bend Variant Effects Disease (zs-embedding) lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-disease-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Bend Variant Effects Disease', row 'DNA-BERT', column 'L2 AUROC' |
|---|
| Configuration: DNA-BERT (zero-shot, GFMBench-API) | Protocol: GFMBench-API Bend Variant Effects Disease, zs-embedding Dataset: Bend Variant Effects Disease test set (GFMBench-API) | 0.0731 AUPRC (zero-shot; cosine similarity of embeddings at the SNV position) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNA-BERT on GFMBench-API Bend Variant Effects Disease (zs-embedding) lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-disease-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Bend Variant Effects Disease', row 'DNA-BERT', column 'SNV Cos AUPRC' |
|---|
| Configuration: DNA-BERT (zero-shot, GFMBench-API) | Protocol: GFMBench-API Bend Variant Effects Disease, zs-embedding Dataset: Bend Variant Effects Disease test set (GFMBench-API) | 0.534 AUROC (zero-shot; cosine similarity of embeddings at the SNV position) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNA-BERT on GFMBench-API Bend Variant Effects Disease (zs-embedding) lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-disease-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Bend Variant Effects Disease', row 'DNA-BERT', column 'SNV Cos AUROC' |
|---|
| Configuration: DNA-BERT (zero-shot, GFMBench-API) | Protocol: GFMBench-API Bend Variant Effects Disease, zs-mlm-llr Dataset: Bend Variant Effects Disease test set (GFMBench-API) | 0.0593 AUPRC (zero-shot; masked log-likelihood ratio) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNA-BERT on GFMBench-API Bend Variant Effects Disease (zs-mlm-llr) lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-disease-zs-mlm-llr Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 4, task 'Bend Variant Effects Disease', row 'DNA-BERT', column 'Msk LLR PRC' |
|---|
| Configuration: DNA-BERT (zero-shot, GFMBench-API) | Protocol: GFMBench-API Bend Variant Effects Disease, zs-mlm-llr Dataset: Bend Variant Effects Disease test set (GFMBench-API) | 0.432 AUROC (zero-shot; masked log-likelihood ratio) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNA-BERT on GFMBench-API Bend Variant Effects Disease (zs-mlm-llr) lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-disease-zs-mlm-llr Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 4, task 'Bend Variant Effects Disease', row 'DNA-BERT', column 'Msk LLR ROC' |
|---|
| Configuration: DNABERT-2 (zero-shot, GFMBench-API) | Protocol: GFMBench-API Bend Variant Effects Disease, zs-embedding Dataset: Bend Variant Effects Disease test set (GFMBench-API) | 0.152 AUPRC (zero-shot; cosine similarity of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNABERT-2 on GFMBench-API Bend Variant Effects Disease (zs-embedding) lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-disease-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Bend Variant Effects Disease', row 'DNABERT-2', column 'Cos AUPRC' |
|---|
| Configuration: DNABERT-2 (zero-shot, GFMBench-API) | Protocol: GFMBench-API Bend Variant Effects Disease, zs-embedding Dataset: Bend Variant Effects Disease test set (GFMBench-API) | 0.696 AUROC (zero-shot; cosine similarity of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNABERT-2 on GFMBench-API Bend Variant Effects Disease (zs-embedding) lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-disease-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Bend Variant Effects Disease', row 'DNABERT-2', column 'Cos AUROC' |
|---|
| Configuration: DNABERT-2 (zero-shot, GFMBench-API) | Protocol: GFMBench-API Bend Variant Effects Disease, zs-embedding Dataset: Bend Variant Effects Disease test set (GFMBench-API) | 0.149 AUPRC (zero-shot; L2 distance of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNABERT-2 on GFMBench-API Bend Variant Effects Disease (zs-embedding) lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-disease-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Bend Variant Effects Disease', row 'DNABERT-2', column 'L2 AUPRC' |
|---|
| Configuration: DNABERT-2 (zero-shot, GFMBench-API) | Protocol: GFMBench-API Bend Variant Effects Disease, zs-embedding Dataset: Bend Variant Effects Disease test set (GFMBench-API) | 0.693 AUROC (zero-shot; L2 distance of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNABERT-2 on GFMBench-API Bend Variant Effects Disease (zs-embedding) lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-disease-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Bend Variant Effects Disease', row 'DNABERT-2', column 'L2 AUROC' |
|---|
| Configuration: DNABERT-2 (zero-shot, GFMBench-API) | Protocol: GFMBench-API Bend Variant Effects Disease, zs-embedding Dataset: Bend Variant Effects Disease test set (GFMBench-API) | 0.0751 AUPRC (zero-shot; cosine similarity of embeddings at the SNV position) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNABERT-2 on GFMBench-API Bend Variant Effects Disease (zs-embedding) lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-disease-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Bend Variant Effects Disease', row 'DNABERT-2', column 'SNV Cos AUPRC' |
|---|
| Configuration: DNABERT-2 (zero-shot, GFMBench-API) | Protocol: GFMBench-API Bend Variant Effects Disease, zs-embedding Dataset: Bend Variant Effects Disease test set (GFMBench-API) | 0.511 AUROC (zero-shot; cosine similarity of embeddings at the SNV position) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNABERT-2 on GFMBench-API Bend Variant Effects Disease (zs-embedding) lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-disease-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Bend Variant Effects Disease', row 'DNABERT-2', column 'SNV Cos AUROC' |
|---|
| Configuration: DNABERT-2 (zero-shot, GFMBench-API) | Protocol: GFMBench-API Bend Variant Effects Disease, zs-mlm-llr Dataset: Bend Variant Effects Disease test set (GFMBench-API) | 0.0706 AUPRC (zero-shot; masked log-likelihood ratio) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNABERT-2 on GFMBench-API Bend Variant Effects Disease (zs-mlm-llr) lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-disease-zs-mlm-llr Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 4, task 'Bend Variant Effects Disease', row 'DNABERT-2', column 'Msk LLR PRC' |
|---|
| Configuration: DNABERT-2 (zero-shot, GFMBench-API) | Protocol: GFMBench-API Bend Variant Effects Disease, zs-mlm-llr Dataset: Bend Variant Effects Disease test set (GFMBench-API) | 0.504 AUROC (zero-shot; masked log-likelihood ratio) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNABERT-2 on GFMBench-API Bend Variant Effects Disease (zs-mlm-llr) lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-disease-zs-mlm-llr Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 4, task 'Bend Variant Effects Disease', row 'DNABERT-2', column 'Msk LLR ROC' |
|---|
| Configuration: Evo2 (zero-shot, GFMBench-API) | Protocol: GFMBench-API Bend Variant Effects Disease, zs-ar-llr Dataset: Bend Variant Effects Disease test set (GFMBench-API) | 0.742 AUPRC (zero-shot; autoregressive log-likelihood ratio over mean token probabilities) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceEvo2 on GFMBench-API Bend Variant Effects Disease (zs-ar-llr) lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-disease-zs-ar-llr Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 5, task 'Bend Variant Effects Disease', row 'Evo2', column 'Mean LLR PRC' |
|---|