| Configuration: Caduceus-Ps (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Mendelian, zs-embedding Dataset: TraitGym Mendelian test set (GFMBench-API) | 0.0879 AUPRC (zero-shot; cosine similarity of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ps on GFMBench-API TraitGym Mendelian (zs-embedding) lit-genomics-20261011-gfmbench-protocol-traitgym-mendelian-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'TraitGym Mendelian', row 'Caduceus-Ps', column 'Cos AUPRC' |
|---|
| Configuration: Caduceus-Ps (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Mendelian, zs-embedding Dataset: TraitGym Mendelian test set (GFMBench-API) | 0.463 AUROC (zero-shot; cosine similarity of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ps on GFMBench-API TraitGym Mendelian (zs-embedding) lit-genomics-20261011-gfmbench-protocol-traitgym-mendelian-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'TraitGym Mendelian', row 'Caduceus-Ps', column 'Cos AUROC' |
|---|
| Configuration: Caduceus-Ps (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Mendelian, zs-embedding Dataset: TraitGym Mendelian test set (GFMBench-API) | 0.0922 AUPRC (zero-shot; L2 distance of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ps on GFMBench-API TraitGym Mendelian (zs-embedding) lit-genomics-20261011-gfmbench-protocol-traitgym-mendelian-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'TraitGym Mendelian', row 'Caduceus-Ps', column 'L2 AUPRC' |
|---|
| Configuration: Caduceus-Ps (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Mendelian, zs-embedding Dataset: TraitGym Mendelian test set (GFMBench-API) | 0.477 AUROC (zero-shot; L2 distance of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ps on GFMBench-API TraitGym Mendelian (zs-embedding) lit-genomics-20261011-gfmbench-protocol-traitgym-mendelian-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'TraitGym Mendelian', row 'Caduceus-Ps', column 'L2 AUROC' |
|---|
| Configuration: Caduceus-Ps (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Mendelian, zs-embedding Dataset: TraitGym Mendelian test set (GFMBench-API) | 0.127 AUPRC (zero-shot; cosine similarity of embeddings at the SNV position) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ps on GFMBench-API TraitGym Mendelian (zs-embedding) lit-genomics-20261011-gfmbench-protocol-traitgym-mendelian-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'TraitGym Mendelian', row 'Caduceus-Ps', column 'SNV Cos AUPRC' |
|---|
| Configuration: Caduceus-Ps (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Mendelian, zs-embedding Dataset: TraitGym Mendelian test set (GFMBench-API) | 0.553 AUROC (zero-shot; cosine similarity of embeddings at the SNV position) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ps on GFMBench-API TraitGym Mendelian (zs-embedding) lit-genomics-20261011-gfmbench-protocol-traitgym-mendelian-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'TraitGym Mendelian', row 'Caduceus-Ps', column 'SNV Cos AUROC' |
|---|
| Configuration: Caduceus-Ps (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Mendelian, zs-mlm-llr Dataset: TraitGym Mendelian test set (GFMBench-API) | 0.0929 AUPRC (zero-shot; masked log-likelihood ratio) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ps on GFMBench-API TraitGym Mendelian (zs-mlm-llr) lit-genomics-20261011-gfmbench-protocol-traitgym-mendelian-zs-mlm-llr Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 4, task 'TraitGym Mendelian', row 'Caduceus-Ps', column 'Msk LLR PRC' |
|---|
| Configuration: Caduceus-Ps (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Mendelian, zs-mlm-llr Dataset: TraitGym Mendelian test set (GFMBench-API) | 0.505 AUROC (zero-shot; masked log-likelihood ratio) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCaduceus-Ps on GFMBench-API TraitGym Mendelian (zs-mlm-llr) lit-genomics-20261011-gfmbench-protocol-traitgym-mendelian-zs-mlm-llr Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 4, task 'TraitGym Mendelian', row 'Caduceus-Ps', column 'Msk LLR ROC' |
|---|
| Configuration: DNA-BERT (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Mendelian, zs-embedding Dataset: TraitGym Mendelian test set (GFMBench-API) | 0.106 AUPRC (zero-shot; cosine similarity of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNA-BERT on GFMBench-API TraitGym Mendelian (zs-embedding) lit-genomics-20261011-gfmbench-protocol-traitgym-mendelian-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'TraitGym Mendelian', row 'DNA-BERT', column 'Cos AUPRC' |
|---|
| Configuration: DNA-BERT (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Mendelian, zs-embedding Dataset: TraitGym Mendelian test set (GFMBench-API) | 0.529 AUROC (zero-shot; cosine similarity of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNA-BERT on GFMBench-API TraitGym Mendelian (zs-embedding) lit-genomics-20261011-gfmbench-protocol-traitgym-mendelian-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'TraitGym Mendelian', row 'DNA-BERT', column 'Cos AUROC' |
|---|
| Configuration: DNA-BERT (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Mendelian, zs-embedding Dataset: TraitGym Mendelian test set (GFMBench-API) | 0.106 AUPRC (zero-shot; L2 distance of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNA-BERT on GFMBench-API TraitGym Mendelian (zs-embedding) lit-genomics-20261011-gfmbench-protocol-traitgym-mendelian-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'TraitGym Mendelian', row 'DNA-BERT', column 'L2 AUPRC' |
|---|
| Configuration: DNA-BERT (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Mendelian, zs-embedding Dataset: TraitGym Mendelian test set (GFMBench-API) | 0.53 AUROC (zero-shot; L2 distance of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNA-BERT on GFMBench-API TraitGym Mendelian (zs-embedding) lit-genomics-20261011-gfmbench-protocol-traitgym-mendelian-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'TraitGym Mendelian', row 'DNA-BERT', column 'L2 AUROC' |
|---|
| Configuration: DNA-BERT (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Mendelian, zs-embedding Dataset: TraitGym Mendelian test set (GFMBench-API) | 0.129 AUPRC (zero-shot; cosine similarity of embeddings at the SNV position) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNA-BERT on GFMBench-API TraitGym Mendelian (zs-embedding) lit-genomics-20261011-gfmbench-protocol-traitgym-mendelian-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'TraitGym Mendelian', row 'DNA-BERT', column 'SNV Cos AUPRC' |
|---|
| Configuration: DNA-BERT (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Mendelian, zs-embedding Dataset: TraitGym Mendelian test set (GFMBench-API) | 0.597 AUROC (zero-shot; cosine similarity of embeddings at the SNV position) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNA-BERT on GFMBench-API TraitGym Mendelian (zs-embedding) lit-genomics-20261011-gfmbench-protocol-traitgym-mendelian-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'TraitGym Mendelian', row 'DNA-BERT', column 'SNV Cos AUROC' |
|---|
| Configuration: DNA-BERT (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Mendelian, zs-mlm-llr Dataset: TraitGym Mendelian test set (GFMBench-API) | 0.0905 AUPRC (zero-shot; masked log-likelihood ratio) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNA-BERT on GFMBench-API TraitGym Mendelian (zs-mlm-llr) lit-genomics-20261011-gfmbench-protocol-traitgym-mendelian-zs-mlm-llr Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 4, task 'TraitGym Mendelian', row 'DNA-BERT', column 'Msk LLR PRC' |
|---|
| Configuration: DNA-BERT (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Mendelian, zs-mlm-llr Dataset: TraitGym Mendelian test set (GFMBench-API) | 0.469 AUROC (zero-shot; masked log-likelihood ratio) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNA-BERT on GFMBench-API TraitGym Mendelian (zs-mlm-llr) lit-genomics-20261011-gfmbench-protocol-traitgym-mendelian-zs-mlm-llr Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 4, task 'TraitGym Mendelian', row 'DNA-BERT', column 'Msk LLR ROC' |
|---|
| Configuration: DNABERT-2 (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Mendelian, zs-embedding Dataset: TraitGym Mendelian test set (GFMBench-API) | 0.147 AUPRC (zero-shot; cosine similarity of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNABERT-2 on GFMBench-API TraitGym Mendelian (zs-embedding) lit-genomics-20261011-gfmbench-protocol-traitgym-mendelian-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'TraitGym Mendelian', row 'DNABERT-2', column 'Cos AUPRC' |
|---|
| Configuration: DNABERT-2 (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Mendelian, zs-embedding Dataset: TraitGym Mendelian test set (GFMBench-API) | 0.594 AUROC (zero-shot; cosine similarity of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNABERT-2 on GFMBench-API TraitGym Mendelian (zs-embedding) lit-genomics-20261011-gfmbench-protocol-traitgym-mendelian-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'TraitGym Mendelian', row 'DNABERT-2', column 'Cos AUROC' |
|---|
| Configuration: DNABERT-2 (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Mendelian, zs-embedding Dataset: TraitGym Mendelian test set (GFMBench-API) | 0.153 AUPRC (zero-shot; L2 distance of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNABERT-2 on GFMBench-API TraitGym Mendelian (zs-embedding) lit-genomics-20261011-gfmbench-protocol-traitgym-mendelian-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'TraitGym Mendelian', row 'DNABERT-2', column 'L2 AUPRC' |
|---|
| Configuration: DNABERT-2 (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Mendelian, zs-embedding Dataset: TraitGym Mendelian test set (GFMBench-API) | 0.605 AUROC (zero-shot; L2 distance of reference and alternate sequence embeddings) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNABERT-2 on GFMBench-API TraitGym Mendelian (zs-embedding) lit-genomics-20261011-gfmbench-protocol-traitgym-mendelian-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'TraitGym Mendelian', row 'DNABERT-2', column 'L2 AUROC' |
|---|
| Configuration: DNABERT-2 (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Mendelian, zs-embedding Dataset: TraitGym Mendelian test set (GFMBench-API) | 0.089 AUPRC (zero-shot; cosine similarity of embeddings at the SNV position) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNABERT-2 on GFMBench-API TraitGym Mendelian (zs-embedding) lit-genomics-20261011-gfmbench-protocol-traitgym-mendelian-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'TraitGym Mendelian', row 'DNABERT-2', column 'SNV Cos AUPRC' |
|---|
| Configuration: DNABERT-2 (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Mendelian, zs-embedding Dataset: TraitGym Mendelian test set (GFMBench-API) | 0.463 AUROC (zero-shot; cosine similarity of embeddings at the SNV position) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNABERT-2 on GFMBench-API TraitGym Mendelian (zs-embedding) lit-genomics-20261011-gfmbench-protocol-traitgym-mendelian-zs-embedding Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'TraitGym Mendelian', row 'DNABERT-2', column 'SNV Cos AUROC' |
|---|
| Configuration: DNABERT-2 (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Mendelian, zs-mlm-llr Dataset: TraitGym Mendelian test set (GFMBench-API) | 0.0949 AUPRC (zero-shot; masked log-likelihood ratio) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNABERT-2 on GFMBench-API TraitGym Mendelian (zs-mlm-llr) lit-genomics-20261011-gfmbench-protocol-traitgym-mendelian-zs-mlm-llr Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 4, task 'TraitGym Mendelian', row 'DNABERT-2', column 'Msk LLR PRC' |
|---|
| Configuration: DNABERT-2 (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Mendelian, zs-mlm-llr Dataset: TraitGym Mendelian test set (GFMBench-API) | 0.482 AUROC (zero-shot; masked log-likelihood ratio) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNABERT-2 on GFMBench-API TraitGym Mendelian (zs-mlm-llr) lit-genomics-20261011-gfmbench-protocol-traitgym-mendelian-zs-mlm-llr Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 4, task 'TraitGym Mendelian', row 'DNABERT-2', column 'Msk LLR ROC' |
|---|
| Configuration: Evo2 (zero-shot, GFMBench-API) | Protocol: GFMBench-API TraitGym Mendelian, zs-ar-llr Dataset: TraitGym Mendelian test set (GFMBench-API) | 0.161 AUPRC (zero-shot; autoregressive log-likelihood ratio over mean token probabilities) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceEvo2 on GFMBench-API TraitGym Mendelian (zs-ar-llr) lit-genomics-20261011-gfmbench-protocol-traitgym-mendelian-zs-ar-llr Aggregation: Not reported GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 5, task 'TraitGym Mendelian', row 'Evo2', column 'Mean LLR PRC' |
|---|