rewirebio.iobenchmarks
Configuration

Evo2 (zero-shot, GFMBench-API)

Configuration of Evo 2: 1B parameters; NVIDIA BioNeMo implementation; zero-shot.

18 evaluations · 68 results

Overview

An explanatory profile has not yet been reviewed for this record.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Evaluations and results

18 evaluations · 68 results. Different protocols are not a single leaderboard.

Sorted by AUPRC (zero-shot; autoregressive log-likelihood ratio over mean token probabilities) (higher is better). The best value in each column is highlighted. Decimals are rounded for display; each value links to the printed value and its source.

Tested configurationProtocol and datasetAUPRC (zero-shot; autoregressive log-likelihood ratio over mean token probabilities)AUPRC (zero-shot; cosine similarity of reference and alternate sequence embeddings)AUPRC (zero-shot; L2 distance of reference and alternate sequence embeddings)AUROC (zero-shot; autoregressive log-likelihood ratio over mean token probabilities)AUROC (zero-shot; cosine similarity of reference and alternate sequence embeddings)AUROC (zero-shot; L2 distance of reference and alternate sequence embeddings)AUPRC (zero-shot; cosine similarity of embeddings at the SNV position)AUROC (zero-shot; cosine similarity of embeddings at the SNV position)
Evo2 (zero-shot, GFMBench-API)EvaluationGFMBench-API Songlab ClinVar, zs-ar-llr, Songlab ClinVar test set (GFMBench-API)0.933 (best in column)Not reportedNot reported0.921 (best in column)Not reportedNot reportedNot reportedNot reported
Evo2 (zero-shot, GFMBench-API)EvaluationGFMBench-API ClinVar Indel Pathogenicity, zs-ar-llr, ClinVar Indel Pathogenicity test set (GFMBench-API)0.892Not reportedNot reported0.627Not reportedNot reportedNot reportedNot reported
Evo2 (zero-shot, GFMBench-API)EvaluationGFMBench-API Bend Variant Effects Disease, zs-ar-llr, Bend Variant Effects Disease test set (GFMBench-API)0.742Not reportedNot reported0.919Not reportedNot reportedNot reportedNot reported
Evo2 (zero-shot, GFMBench-API)EvaluationGFMBench-API BRCA1, zs-ar-llr, BRCA1 test set (GFMBench-API)0.533Not reportedNot reported0.741Not reportedNot reportedNot reportedNot reported
Evo2 (zero-shot, GFMBench-API)EvaluationGFMBench-API TraitGym Mendelian, zs-ar-llr, TraitGym Mendelian test set (GFMBench-API)0.161Not reportedNot reported0.604Not reportedNot reportedNot reportedNot reported
Evo2 (zero-shot, GFMBench-API)EvaluationGFMBench-API LOL-EVE, zs-ar-llr, LOL-EVE test set (GFMBench-API)0.109Not reportedNot reported0.548Not reportedNot reportedNot reportedNot reported
Evo2 (zero-shot, GFMBench-API)EvaluationGFMBench-API TraitGym Complex, zs-ar-llr, TraitGym Complex test set (GFMBench-API)0.0939Not reportedNot reported0.492Not reportedNot reportedNot reportedNot reported
Evo2 (zero-shot, GFMBench-API)EvaluationGFMBench-API Bend Variant Effects Expression, zs-ar-llr, Bend Variant Effects Expression test set (GFMBench-API)0.0685Not reportedNot reported0.488Not reportedNot reportedNot reportedNot reported
Evo2 (zero-shot, GFMBench-API)EvaluationGFMBench-API LRB Variant Effect OMIM, zs-ar-llr, LRB Variant Effect OMIM test set (GFMBench-API)0.0024Not reportedNot reported0.508Not reportedNot reportedNot reportedNot reported
Evo2 (zero-shot, GFMBench-API)EvaluationGFMBench-API Bend Variant Effects Disease, zs-embedding, Bend Variant Effects Disease test set (GFMBench-API)Not reported0.4740.596Not reported0.8720.9120.09440.615 (best in column)
Evo2 (zero-shot, GFMBench-API)EvaluationGFMBench-API Bend Variant Effects Expression, zs-embedding, Bend Variant Effects Expression test set (GFMBench-API)Not reported0.09040.0897Not reported0.5820.5730.08870.557
Evo2 (zero-shot, GFMBench-API)EvaluationGFMBench-API BRCA1, zs-embedding, BRCA1 test set (GFMBench-API)Not reported0.540.575Not reported0.7470.7750.2040.467
Evo2 (zero-shot, GFMBench-API)EvaluationGFMBench-API ClinVar Indel Pathogenicity, zs-embedding, ClinVar Indel Pathogenicity test set (GFMBench-API)Not reported0.989 (best in column)0.993 (best in column)Not reported0.946 (best in column)0.967 (best in column)Not reportedNot reported
Evo2 (zero-shot, GFMBench-API)EvaluationGFMBench-API LOL-EVE, zs-embedding, LOL-EVE test set (GFMBench-API)Not reported0.08450.0938Not reported0.5310.543Not reportedNot reported
Evo2 (zero-shot, GFMBench-API)EvaluationGFMBench-API LRB Variant Effect OMIM, zs-embedding, LRB Variant Effect OMIM test set (GFMBench-API)Not reported0.0020.0021Not reported0.5010.5020.0020.498
Evo2 (zero-shot, GFMBench-API)EvaluationGFMBench-API Songlab ClinVar, zs-embedding, Songlab ClinVar test set (GFMBench-API)Not reported0.7340.865Not reported0.7220.8450.576 (best in column)0.579
Evo2 (zero-shot, GFMBench-API)EvaluationGFMBench-API TraitGym Complex, zs-embedding, TraitGym Complex test set (GFMBench-API)Not reported0.1080.107Not reported0.5270.5240.1060.523
Evo2 (zero-shot, GFMBench-API)EvaluationGFMBench-API TraitGym Mendelian, zs-embedding, TraitGym Mendelian test set (GFMBench-API)Not reported0.1640.17Not reported0.6180.6260.1210.548
All 68 result rows with coverage, uncertainty and sources
Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: Evo2 (zero-shot, GFMBench-API)Protocol: GFMBench-API Bend Variant Effects Disease, zs-ar-llr
Dataset: Bend Variant Effects Disease test set (GFMBench-API)
0.742 AUPRC (zero-shot; autoregressive log-likelihood ratio over mean token probabilities)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Evo2 on GFMBench-API Bend Variant Effects Disease (zs-ar-llr)

lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-disease-zs-ar-llr

Aggregation: Not reported

GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 5, task 'Bend Variant Effects Disease', row 'Evo2', column 'Mean LLR PRC'
Configuration: Evo2 (zero-shot, GFMBench-API)Protocol: GFMBench-API Bend Variant Effects Disease, zs-ar-llr
Dataset: Bend Variant Effects Disease test set (GFMBench-API)
0.919 AUROC (zero-shot; autoregressive log-likelihood ratio over mean token probabilities)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Evo2 on GFMBench-API Bend Variant Effects Disease (zs-ar-llr)

lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-disease-zs-ar-llr

Aggregation: Not reported

GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 5, task 'Bend Variant Effects Disease', row 'Evo2', column 'Mean LLR ROC'
Configuration: Evo2 (zero-shot, GFMBench-API)Protocol: GFMBench-API Bend Variant Effects Disease, zs-embedding
Dataset: Bend Variant Effects Disease test set (GFMBench-API)
0.474 AUPRC (zero-shot; cosine similarity of reference and alternate sequence embeddings)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Evo2 on GFMBench-API Bend Variant Effects Disease (zs-embedding)

lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-disease-zs-embedding

Aggregation: Not reported

GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Bend Variant Effects Disease', row 'Evo2', column 'Cos AUPRC'
Configuration: Evo2 (zero-shot, GFMBench-API)Protocol: GFMBench-API Bend Variant Effects Disease, zs-embedding
Dataset: Bend Variant Effects Disease test set (GFMBench-API)
0.872 AUROC (zero-shot; cosine similarity of reference and alternate sequence embeddings)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Evo2 on GFMBench-API Bend Variant Effects Disease (zs-embedding)

lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-disease-zs-embedding

Aggregation: Not reported

GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Bend Variant Effects Disease', row 'Evo2', column 'Cos AUROC'
Configuration: Evo2 (zero-shot, GFMBench-API)Protocol: GFMBench-API Bend Variant Effects Disease, zs-embedding
Dataset: Bend Variant Effects Disease test set (GFMBench-API)
0.596 AUPRC (zero-shot; L2 distance of reference and alternate sequence embeddings)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Evo2 on GFMBench-API Bend Variant Effects Disease (zs-embedding)

lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-disease-zs-embedding

Aggregation: Not reported

GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Bend Variant Effects Disease', row 'Evo2', column 'L2 AUPRC'
Configuration: Evo2 (zero-shot, GFMBench-API)Protocol: GFMBench-API Bend Variant Effects Disease, zs-embedding
Dataset: Bend Variant Effects Disease test set (GFMBench-API)
0.912 AUROC (zero-shot; L2 distance of reference and alternate sequence embeddings)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Evo2 on GFMBench-API Bend Variant Effects Disease (zs-embedding)

lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-disease-zs-embedding

Aggregation: Not reported

GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Bend Variant Effects Disease', row 'Evo2', column 'L2 AUROC'
Configuration: Evo2 (zero-shot, GFMBench-API)Protocol: GFMBench-API Bend Variant Effects Disease, zs-embedding
Dataset: Bend Variant Effects Disease test set (GFMBench-API)
0.0944 AUPRC (zero-shot; cosine similarity of embeddings at the SNV position)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Evo2 on GFMBench-API Bend Variant Effects Disease (zs-embedding)

lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-disease-zs-embedding

Aggregation: Not reported

GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Bend Variant Effects Disease', row 'Evo2', column 'SNV Cos AUPRC'
Configuration: Evo2 (zero-shot, GFMBench-API)Protocol: GFMBench-API Bend Variant Effects Disease, zs-embedding
Dataset: Bend Variant Effects Disease test set (GFMBench-API)
0.615 AUROC (zero-shot; cosine similarity of embeddings at the SNV position)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Evo2 on GFMBench-API Bend Variant Effects Disease (zs-embedding)

lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-disease-zs-embedding

Aggregation: Not reported

GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Bend Variant Effects Disease', row 'Evo2', column 'SNV Cos AUROC'
Configuration: Evo2 (zero-shot, GFMBench-API)Protocol: GFMBench-API Bend Variant Effects Expression, zs-ar-llr
Dataset: Bend Variant Effects Expression test set (GFMBench-API)
0.0685 AUPRC (zero-shot; autoregressive log-likelihood ratio over mean token probabilities)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Evo2 on GFMBench-API Bend Variant Effects Expression (zs-ar-llr)

lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-expression-zs-ar-llr

Aggregation: Not reported

GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 5, task 'Bend Variant Effects Expression', row 'Evo2', column 'Mean LLR PRC'
Configuration: Evo2 (zero-shot, GFMBench-API)Protocol: GFMBench-API Bend Variant Effects Expression, zs-ar-llr
Dataset: Bend Variant Effects Expression test set (GFMBench-API)
0.488 AUROC (zero-shot; autoregressive log-likelihood ratio over mean token probabilities)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Evo2 on GFMBench-API Bend Variant Effects Expression (zs-ar-llr)

lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-expression-zs-ar-llr

Aggregation: Not reported

GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 5, task 'Bend Variant Effects Expression', row 'Evo2', column 'Mean LLR ROC'
Configuration: Evo2 (zero-shot, GFMBench-API)Protocol: GFMBench-API Bend Variant Effects Expression, zs-embedding
Dataset: Bend Variant Effects Expression test set (GFMBench-API)
0.0904 AUPRC (zero-shot; cosine similarity of reference and alternate sequence embeddings)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Evo2 on GFMBench-API Bend Variant Effects Expression (zs-embedding)

lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-expression-zs-embedding

Aggregation: Not reported

GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Bend Variant Effects Expression', row 'Evo2', column 'Cos AUPRC'
Configuration: Evo2 (zero-shot, GFMBench-API)Protocol: GFMBench-API Bend Variant Effects Expression, zs-embedding
Dataset: Bend Variant Effects Expression test set (GFMBench-API)
0.582 AUROC (zero-shot; cosine similarity of reference and alternate sequence embeddings)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Evo2 on GFMBench-API Bend Variant Effects Expression (zs-embedding)

lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-expression-zs-embedding

Aggregation: Not reported

GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Bend Variant Effects Expression', row 'Evo2', column 'Cos AUROC'
Configuration: Evo2 (zero-shot, GFMBench-API)Protocol: GFMBench-API Bend Variant Effects Expression, zs-embedding
Dataset: Bend Variant Effects Expression test set (GFMBench-API)
0.0897 AUPRC (zero-shot; L2 distance of reference and alternate sequence embeddings)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Evo2 on GFMBench-API Bend Variant Effects Expression (zs-embedding)

lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-expression-zs-embedding

Aggregation: Not reported

GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Bend Variant Effects Expression', row 'Evo2', column 'L2 AUPRC'
Configuration: Evo2 (zero-shot, GFMBench-API)Protocol: GFMBench-API Bend Variant Effects Expression, zs-embedding
Dataset: Bend Variant Effects Expression test set (GFMBench-API)
0.573 AUROC (zero-shot; L2 distance of reference and alternate sequence embeddings)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Evo2 on GFMBench-API Bend Variant Effects Expression (zs-embedding)

lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-expression-zs-embedding

Aggregation: Not reported

GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Bend Variant Effects Expression', row 'Evo2', column 'L2 AUROC'
Configuration: Evo2 (zero-shot, GFMBench-API)Protocol: GFMBench-API Bend Variant Effects Expression, zs-embedding
Dataset: Bend Variant Effects Expression test set (GFMBench-API)
0.0887 AUPRC (zero-shot; cosine similarity of embeddings at the SNV position)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Evo2 on GFMBench-API Bend Variant Effects Expression (zs-embedding)

lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-expression-zs-embedding

Aggregation: Not reported

GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Bend Variant Effects Expression', row 'Evo2', column 'SNV Cos AUPRC'
Configuration: Evo2 (zero-shot, GFMBench-API)Protocol: GFMBench-API Bend Variant Effects Expression, zs-embedding
Dataset: Bend Variant Effects Expression test set (GFMBench-API)
0.557 AUROC (zero-shot; cosine similarity of embeddings at the SNV position)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Evo2 on GFMBench-API Bend Variant Effects Expression (zs-embedding)

lit-genomics-20261011-gfmbench-protocol-bend-variant-effects-expression-zs-embedding

Aggregation: Not reported

GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'Bend Variant Effects Expression', row 'Evo2', column 'SNV Cos AUROC'
Configuration: Evo2 (zero-shot, GFMBench-API)Protocol: GFMBench-API BRCA1, zs-ar-llr
Dataset: BRCA1 test set (GFMBench-API)
0.533 AUPRC (zero-shot; autoregressive log-likelihood ratio over mean token probabilities)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Evo2 on GFMBench-API BRCA1 (zs-ar-llr)

lit-genomics-20261011-gfmbench-protocol-brca1-zs-ar-llr

Aggregation: Not reported

GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 5, task 'BRCA1', row 'Evo2', column 'Mean LLR PRC'
Configuration: Evo2 (zero-shot, GFMBench-API)Protocol: GFMBench-API BRCA1, zs-ar-llr
Dataset: BRCA1 test set (GFMBench-API)
0.741 AUROC (zero-shot; autoregressive log-likelihood ratio over mean token probabilities)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Evo2 on GFMBench-API BRCA1 (zs-ar-llr)

lit-genomics-20261011-gfmbench-protocol-brca1-zs-ar-llr

Aggregation: Not reported

GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 5, task 'BRCA1', row 'Evo2', column 'Mean LLR ROC'
Configuration: Evo2 (zero-shot, GFMBench-API)Protocol: GFMBench-API BRCA1, zs-embedding
Dataset: BRCA1 test set (GFMBench-API)
0.54 AUPRC (zero-shot; cosine similarity of reference and alternate sequence embeddings)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Evo2 on GFMBench-API BRCA1 (zs-embedding)

lit-genomics-20261011-gfmbench-protocol-brca1-zs-embedding

Aggregation: Not reported

GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'BRCA1', row 'Evo2', column 'Cos AUPRC'
Configuration: Evo2 (zero-shot, GFMBench-API)Protocol: GFMBench-API BRCA1, zs-embedding
Dataset: BRCA1 test set (GFMBench-API)
0.747 AUROC (zero-shot; cosine similarity of reference and alternate sequence embeddings)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Evo2 on GFMBench-API BRCA1 (zs-embedding)

lit-genomics-20261011-gfmbench-protocol-brca1-zs-embedding

Aggregation: Not reported

GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'BRCA1', row 'Evo2', column 'Cos AUROC'
Configuration: Evo2 (zero-shot, GFMBench-API)Protocol: GFMBench-API BRCA1, zs-embedding
Dataset: BRCA1 test set (GFMBench-API)
0.575 AUPRC (zero-shot; L2 distance of reference and alternate sequence embeddings)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Evo2 on GFMBench-API BRCA1 (zs-embedding)

lit-genomics-20261011-gfmbench-protocol-brca1-zs-embedding

Aggregation: Not reported

GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'BRCA1', row 'Evo2', column 'L2 AUPRC'
Configuration: Evo2 (zero-shot, GFMBench-API)Protocol: GFMBench-API BRCA1, zs-embedding
Dataset: BRCA1 test set (GFMBench-API)
0.775 AUROC (zero-shot; L2 distance of reference and alternate sequence embeddings)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Evo2 on GFMBench-API BRCA1 (zs-embedding)

lit-genomics-20261011-gfmbench-protocol-brca1-zs-embedding

Aggregation: Not reported

GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'BRCA1', row 'Evo2', column 'L2 AUROC'
Configuration: Evo2 (zero-shot, GFMBench-API)Protocol: GFMBench-API BRCA1, zs-embedding
Dataset: BRCA1 test set (GFMBench-API)
0.204 AUPRC (zero-shot; cosine similarity of embeddings at the SNV position)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Evo2 on GFMBench-API BRCA1 (zs-embedding)

lit-genomics-20261011-gfmbench-protocol-brca1-zs-embedding

Aggregation: Not reported

GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'BRCA1', row 'Evo2', column 'SNV Cos AUPRC'
Configuration: Evo2 (zero-shot, GFMBench-API)Protocol: GFMBench-API BRCA1, zs-embedding
Dataset: BRCA1 test set (GFMBench-API)
0.467 AUROC (zero-shot; cosine similarity of embeddings at the SNV position)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Evo2 on GFMBench-API BRCA1 (zs-embedding)

lit-genomics-20261011-gfmbench-protocol-brca1-zs-embedding

Aggregation: Not reported

GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 3, task 'BRCA1', row 'Evo2', column 'SNV Cos AUROC'
Configuration: Evo2 (zero-shot, GFMBench-API)Protocol: GFMBench-API ClinVar Indel Pathogenicity, zs-ar-llr
Dataset: ClinVar Indel Pathogenicity test set (GFMBench-API)
0.892 AUPRC (zero-shot; autoregressive log-likelihood ratio over mean token probabilities)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Evo2 on GFMBench-API ClinVar Indel Pathogenicity (zs-ar-llr)

lit-genomics-20261011-gfmbench-protocol-clinvar-indel-pathogenicity-zs-ar-llr

Aggregation: Not reported

GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Table 5, task 'ClinVar Indel Pathogenicity', row 'Evo2', column 'Mean LLR PRC'

Source checking is not independent reproduction. Release 2026-10-22-1b7cf027e4f6.

Use this configuration

How it works, versions and access
Strengths, limitations and unresolved questions

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-10-22-1b7cf027e4f6
Property and statementOriginal source and locationReview and provenance

No evidence rows match these filters. Choose another scope or clear the search.

Sources and history

Release 2026-10-22-1b7cf027e4f6 · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: lit-genomics-20261011-gfmbench-config-evo2-zero-shot

areas
dna-genomes
contexts
research
method types
foundation_model
reported name
Evo2
foundation model eligible
true
parameters
1B parameters; NVIDIA BioNeMo implementation; zero-shot
access reuse
Public checkpoint (Hugging Face; Evo2 via NVIDIA BioNeMo)
source locator
Benchmark Results sections A and B
missing metadata
version: reason: unreported; note: Checkpoint revision not printed; parameter count only
provenance note
Evo2 as evaluated in GFMBench-API, zero-shot.
Related records

Suggest a correction