| Configuration: Caduceus-Ps (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Complex, zs-embedding Dataset: TraitGym Complex test set (GFMBench-API) | 0.0946 AUPRC (zero-shot; cosine similarity of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ps on GFMBench-API TraitGym Complex (zs-embedding) lit-genomics-20261011-gfmbench-protocol-traitgym-complex-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'TraitGym Complex', row 'Caduceus-Ps', column 'Cos AUPRC' |
|---|
| Configuration: Caduceus-Ps (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Complex, zs-embedding Dataset: TraitGym Complex test set (GFMBench-API) | 0.483 AUROC (zero-shot; cosine similarity of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ps on GFMBench-API TraitGym Complex (zs-embedding) lit-genomics-20261011-gfmbench-protocol-traitgym-complex-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'TraitGym Complex', row 'Caduceus-Ps', column 'Cos AUROC' |
|---|
| Configuration: Caduceus-Ps (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Complex, zs-embedding Dataset: TraitGym Complex test set (GFMBench-API) | 0.0974 AUPRC (zero-shot; L2 distance of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ps on GFMBench-API TraitGym Complex (zs-embedding) lit-genomics-20261011-gfmbench-protocol-traitgym-complex-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'TraitGym Complex', row 'Caduceus-Ps', column 'L2 AUPRC' |
|---|
| Configuration: Caduceus-Ps (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Complex, zs-embedding Dataset: TraitGym Complex test set (GFMBench-API) | 0.497 AUROC (zero-shot; L2 distance of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ps on GFMBench-API TraitGym Complex (zs-embedding) lit-genomics-20261011-gfmbench-protocol-traitgym-complex-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'TraitGym Complex', row 'Caduceus-Ps', column 'L2 AUROC' |
|---|
| Configuration: Caduceus-Ps (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Complex, zs-embedding Dataset: TraitGym Complex test set (GFMBench-API) | 0.103 AUPRC (zero-shot; cosine similarity of embeddings at the SNV position) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ps on GFMBench-API TraitGym Complex (zs-embedding) lit-genomics-20261011-gfmbench-protocol-traitgym-complex-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'TraitGym Complex', row 'Caduceus-Ps', column 'SNV Cos AUPRC' |
|---|
| Configuration: Caduceus-Ps (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Complex, zs-embedding Dataset: TraitGym Complex test set (GFMBench-API) | 0.518 AUROC (zero-shot; cosine similarity of embeddings at the SNV position) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ps on GFMBench-API TraitGym Complex (zs-embedding) lit-genomics-20261011-gfmbench-protocol-traitgym-complex-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'TraitGym Complex', row 'Caduceus-Ps', column 'SNV Cos AUROC' |
|---|
| Configuration: Caduceus-Ps (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Complex, zs-mlm-llr Dataset: TraitGym Complex test set (GFMBench-API) | 0.0923 AUPRC (zero-shot; masked log-likelihood ratio) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ps on GFMBench-API TraitGym Complex (zs-mlm-llr) lit-genomics-20261011-gfmbench-protocol-traitgym-complex-zs-mlm-llr Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 4, task 'TraitGym Complex', row 'Caduceus-Ps', column 'Msk LLR PRC' |
|---|
| Configuration: Caduceus-Ps (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Complex, zs-mlm-llr Dataset: TraitGym Complex test set (GFMBench-API) | 0.483 AUROC (zero-shot; masked log-likelihood ratio) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ps on GFMBench-API TraitGym Complex (zs-mlm-llr) lit-genomics-20261011-gfmbench-protocol-traitgym-complex-zs-mlm-llr Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 4, task 'TraitGym Complex', row 'Caduceus-Ps', column 'Msk LLR ROC' |
|---|
| Configuration: DNA-BERT (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Complex, zs-embedding Dataset: TraitGym Complex test set (GFMBench-API) | 0.104 AUPRC (zero-shot; cosine similarity of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNA-BERT on GFMBench-API TraitGym Complex (zs-embedding) lit-genomics-20261011-gfmbench-protocol-traitgym-complex-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'TraitGym Complex', row 'DNA-BERT', column 'Cos AUPRC' |
|---|
| Configuration: DNA-BERT (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Complex, zs-embedding Dataset: TraitGym Complex test set (GFMBench-API) | 0.509 AUROC (zero-shot; cosine similarity of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNA-BERT on GFMBench-API TraitGym Complex (zs-embedding) lit-genomics-20261011-gfmbench-protocol-traitgym-complex-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'TraitGym Complex', row 'DNA-BERT', column 'Cos AUROC' |
|---|
| Configuration: DNA-BERT (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Complex, zs-embedding Dataset: TraitGym Complex test set (GFMBench-API) | 0.104 AUPRC (zero-shot; L2 distance of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNA-BERT on GFMBench-API TraitGym Complex (zs-embedding) lit-genomics-20261011-gfmbench-protocol-traitgym-complex-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'TraitGym Complex', row 'DNA-BERT', column 'L2 AUPRC' |
|---|
| Configuration: DNA-BERT (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Complex, zs-embedding Dataset: TraitGym Complex test set (GFMBench-API) | 0.509 AUROC (zero-shot; L2 distance of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNA-BERT on GFMBench-API TraitGym Complex (zs-embedding) lit-genomics-20261011-gfmbench-protocol-traitgym-complex-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'TraitGym Complex', row 'DNA-BERT', column 'L2 AUROC' |
|---|
| Configuration: DNA-BERT (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Complex, zs-embedding Dataset: TraitGym Complex test set (GFMBench-API) | 0.111 AUPRC (zero-shot; cosine similarity of embeddings at the SNV position) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNA-BERT on GFMBench-API TraitGym Complex (zs-embedding) lit-genomics-20261011-gfmbench-protocol-traitgym-complex-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'TraitGym Complex', row 'DNA-BERT', column 'SNV Cos AUPRC' |
|---|
| Configuration: DNA-BERT (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Complex, zs-embedding Dataset: TraitGym Complex test set (GFMBench-API) | 0.539 AUROC (zero-shot; cosine similarity of embeddings at the SNV position) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNA-BERT on GFMBench-API TraitGym Complex (zs-embedding) lit-genomics-20261011-gfmbench-protocol-traitgym-complex-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'TraitGym Complex', row 'DNA-BERT', column 'SNV Cos AUROC' |
|---|
| Configuration: DNA-BERT (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Complex, zs-mlm-llr Dataset: TraitGym Complex test set (GFMBench-API) | 0.0981 AUPRC (zero-shot; masked log-likelihood ratio) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNA-BERT on GFMBench-API TraitGym Complex (zs-mlm-llr) lit-genomics-20261011-gfmbench-protocol-traitgym-complex-zs-mlm-llr Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 4, task 'TraitGym Complex', row 'DNA-BERT', column 'Msk LLR PRC' |
|---|
| Configuration: DNA-BERT (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Complex, zs-mlm-llr Dataset: TraitGym Complex test set (GFMBench-API) | 0.499 AUROC (zero-shot; masked log-likelihood ratio) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNA-BERT on GFMBench-API TraitGym Complex (zs-mlm-llr) lit-genomics-20261011-gfmbench-protocol-traitgym-complex-zs-mlm-llr Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 4, task 'TraitGym Complex', row 'DNA-BERT', column 'Msk LLR ROC' |
|---|
| Configuration: DNABERT-2 (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Complex, zs-embedding Dataset: TraitGym Complex test set (GFMBench-API) | 0.109 AUPRC (zero-shot; cosine similarity of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNABERT-2 on GFMBench-API TraitGym Complex (zs-embedding) lit-genomics-20261011-gfmbench-protocol-traitgym-complex-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'TraitGym Complex', row 'DNABERT-2', column 'Cos AUPRC' |
|---|
| Configuration: DNABERT-2 (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Complex, zs-embedding Dataset: TraitGym Complex test set (GFMBench-API) | 0.53 AUROC (zero-shot; cosine similarity of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNABERT-2 on GFMBench-API TraitGym Complex (zs-embedding) lit-genomics-20261011-gfmbench-protocol-traitgym-complex-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'TraitGym Complex', row 'DNABERT-2', column 'Cos AUROC' |
|---|
| Configuration: DNABERT-2 (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Complex, zs-embedding Dataset: TraitGym Complex test set (GFMBench-API) | 0.112 AUPRC (zero-shot; L2 distance of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNABERT-2 on GFMBench-API TraitGym Complex (zs-embedding) lit-genomics-20261011-gfmbench-protocol-traitgym-complex-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'TraitGym Complex', row 'DNABERT-2', column 'L2 AUPRC' |
|---|
| Configuration: DNABERT-2 (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Complex, zs-embedding Dataset: TraitGym Complex test set (GFMBench-API) | 0.536 AUROC (zero-shot; L2 distance of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNABERT-2 on GFMBench-API TraitGym Complex (zs-embedding) lit-genomics-20261011-gfmbench-protocol-traitgym-complex-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'TraitGym Complex', row 'DNABERT-2', column 'L2 AUROC' |
|---|
| Configuration: DNABERT-2 (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Complex, zs-embedding Dataset: TraitGym Complex test set (GFMBench-API) | 0.0986 AUPRC (zero-shot; cosine similarity of embeddings at the SNV position) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNABERT-2 on GFMBench-API TraitGym Complex (zs-embedding) lit-genomics-20261011-gfmbench-protocol-traitgym-complex-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'TraitGym Complex', row 'DNABERT-2', column 'SNV Cos AUPRC' |
|---|
| Configuration: DNABERT-2 (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Complex, zs-embedding Dataset: TraitGym Complex test set (GFMBench-API) | 0.498 AUROC (zero-shot; cosine similarity of embeddings at the SNV position) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNABERT-2 on GFMBench-API TraitGym Complex (zs-embedding) lit-genomics-20261011-gfmbench-protocol-traitgym-complex-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'TraitGym Complex', row 'DNABERT-2', column 'SNV Cos AUROC' |
|---|
| Configuration: DNABERT-2 (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Complex, zs-mlm-llr Dataset: TraitGym Complex test set (GFMBench-API) | 0.0977 AUPRC (zero-shot; masked log-likelihood ratio) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNABERT-2 on GFMBench-API TraitGym Complex (zs-mlm-llr) lit-genomics-20261011-gfmbench-protocol-traitgym-complex-zs-mlm-llr Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 4, task 'TraitGym Complex', row 'DNABERT-2', column 'Msk LLR PRC' |
|---|
| Configuration: DNABERT-2 (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Complex, zs-mlm-llr Dataset: TraitGym Complex test set (GFMBench-API) | 0.493 AUROC (zero-shot; masked log-likelihood ratio) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNABERT-2 on GFMBench-API TraitGym Complex (zs-mlm-llr) lit-genomics-20261011-gfmbench-protocol-traitgym-complex-zs-mlm-llr Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 4, task 'TraitGym Complex', row 'DNABERT-2', column 'Msk LLR ROC' |
|---|
| Configuration: Evo2 (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Complex, zs-ar-llr Dataset: TraitGym Complex test set (GFMBench-API) | 0.0939 AUPRC (zero-shot; autoregressive log-likelihood ratio over mean token probabilities) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceEvo2 on GFMBench-API TraitGym Complex (zs-ar-llr) lit-genomics-20261011-gfmbench-protocol-traitgym-complex-zs-ar-llr Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 5, task 'TraitGym Complex', row 'Evo2', column 'Mean LLR PRC' |
|---|