GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models
bioRxiv preprint version 2, posted 2026-08-11 · Preprint
What this source contributed
Records in this release that cite this source. A record can cite several sources.
Results
Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.
Claims
Statements this source supports, each with where in the source it was checked.
- Relevance of GFMBench-API BRCA1, zs-ar-llr to "Interpret BRCA1/BRCA2 germline variants": Assessed by GFMBench-API BRCA1, zs-ar-llr (lit-genomics-20261011-gfmbench-source-larey2026: Table 5, task 'BRCA1'; Supplementary Note, BRCA1 task)
- Relevance of GFMBench-API BRCA1, zs-embedding to "Interpret BRCA1/BRCA2 germline variants": Assessed by GFMBench-API BRCA1, zs-embedding (lit-genomics-20261011-gfmbench-source-larey2026: Table 3, task 'BRCA1'; Supplementary Note, BRCA1 task)
- Relevance of GFMBench-API BRCA1, zs-mlm-llr to "Interpret BRCA1/BRCA2 germline variants": Assessed by GFMBench-API BRCA1, zs-mlm-llr (lit-genomics-20261011-gfmbench-source-larey2026: Table 4, task 'BRCA1'; Supplementary Note, BRCA1 task)
- Relevance of GFMBench-API TraitGym Complex, zs-ar-llr to "Select regulatory variants and genes for functional follow-up": Assessed by GFMBench-API TraitGym Complex, zs-ar-llr (lit-genomics-20261011-gfmbench-source-larey2026: Table 5, task 'TraitGym Complex'; appendix task description)
- Relevance of GFMBench-API TraitGym Complex, zs-embedding to "Select regulatory variants and genes for functional follow-up": Assessed by GFMBench-API TraitGym Complex, zs-embedding (lit-genomics-20261011-gfmbench-source-larey2026: Table 3, task 'TraitGym Complex'; appendix task description)
- Relevance of GFMBench-API TraitGym Complex, zs-mlm-llr to "Select regulatory variants and genes for functional follow-up": Assessed by GFMBench-API TraitGym Complex, zs-mlm-llr (lit-genomics-20261011-gfmbench-source-larey2026: Table 4, task 'TraitGym Complex'; appendix task description)
- Relevance of GFMBench-API TraitGym Mendelian, zs-ar-llr to "Select regulatory variants and genes for functional follow-up": Assessed by GFMBench-API TraitGym Mendelian, zs-ar-llr (lit-genomics-20261011-gfmbench-source-larey2026: Table 5, task 'TraitGym Mendelian'; appendix task description)
- Relevance of GFMBench-API TraitGym Mendelian, zs-embedding to "Select regulatory variants and genes for functional follow-up": Assessed by GFMBench-API TraitGym Mendelian, zs-embedding (lit-genomics-20261011-gfmbench-source-larey2026: Table 3, task 'TraitGym Mendelian'; appendix task description)
- Relevance of GFMBench-API TraitGym Mendelian, zs-mlm-llr to "Select regulatory variants and genes for functional follow-up": Assessed by GFMBench-API TraitGym Mendelian, zs-mlm-llr (lit-genomics-20261011-gfmbench-source-larey2026: Table 4, task 'TraitGym Mendelian'; appendix task description)
Models, benchmarks and other records
Models (1)
Configurations (10)
- Caduceus-Ps (full fine-tuning, GFMBench-API)
- Caduceus-Ps (zero-shot, GFMBench-API)
- DNA-BERT (full fine-tuning, GFMBench-API)
- DNA-BERT (zero-shot, GFMBench-API)
- DNABERT-2 (full fine-tuning, GFMBench-API)
- DNABERT-2 (zero-shot, GFMBench-API)
- Evo2 (linear probing, GFMBench-API)
- Evo2 (zero-shot, GFMBench-API)
- NTv3 (full fine-tuning, GFMBench-API)
- NTv3 (zero-shot, GFMBench-API)
Benchmarks (1)
Protocols (37)
- GFMBench-API Bend Variant Effects Disease, zs-ar-llr
- GFMBench-API Bend Variant Effects Disease, zs-embedding
- GFMBench-API Bend Variant Effects Disease, zs-mlm-llr
- GFMBench-API Bend Variant Effects Expression, zs-ar-llr
- GFMBench-API Bend Variant Effects Expression, zs-embedding
- GFMBench-API Bend Variant Effects Expression, zs-mlm-llr
- GFMBench-API BRCA1, zs-ar-llr
- GFMBench-API BRCA1, zs-embedding
- GFMBench-API BRCA1, zs-mlm-llr
- GFMBench-API ClinVar Indel Pathogenicity, zs-ar-llr
- GFMBench-API ClinVar Indel Pathogenicity, zs-embedding
- GFMBench-API GUE Promoter All, supervised
- GFMBench-API GUE Splice Site, supervised
- GFMBench-API GUE Transcription Factor, supervised
- GFMBench-API LOL-EVE, zs-ar-llr
- GFMBench-API LOL-EVE, zs-embedding
- GFMBench-API LRB Variant Effect Causal eQTL, supervised
- GFMBench-API LRB Variant Effect OMIM, zs-ar-llr
- GFMBench-API LRB Variant Effect OMIM, zs-embedding
- GFMBench-API LRB Variant Effect OMIM, zs-mlm-llr
- GFMBench-API Songlab ClinVar, zs-ar-llr
- GFMBench-API Songlab ClinVar, zs-embedding
- GFMBench-API Songlab ClinVar, zs-mlm-llr
- GFMBench-API TraitGym Complex, zs-ar-llr
- GFMBench-API TraitGym Complex, zs-embedding
Datasets (20)
- Bend Variant Effects Disease test set (GFMBench-API)
- Bend Variant Effects Expression test set (GFMBench-API)
- BRCA1 test set (GFMBench-API)
- ClinVar Indel Pathogenicity test set (GFMBench-API)
- GUE Promoter All test set (GFMBench-API)
- GUE Splice Site test set (GFMBench-API)
- GUE Transcription Factor test set (GFMBench-API)
- LOL-EVE test set (GFMBench-API)
- LRB Variant Effect Causal eQTL test set (GFMBench-API)
- LRB Variant Effect OMIM test set (GFMBench-API)
- Songlab ClinVar test set (GFMBench-API)
- TraitGym Complex test set (GFMBench-API)
- TraitGym Mendelian test set (GFMBench-API)
- Var Bench Coding Pathogenicity test set (GFMBench-API)
- Var Bench Common Vs Rare test set (GFMBench-API)
- Var Bench Expression test set (GFMBench-API)
- Var Bench meQTL test set (GFMBench-API)
- Var Bench Non Coding Pathogenicity test set (GFMBench-API)
- Var Bench sQTL test set (GFMBench-API)
- VEP-eval test set (GFMBench-API)
Evaluations (139)
- Caduceus-Ps on GFMBench-API Bend Variant Effects Disease (zs-embedding)
- Caduceus-Ps on GFMBench-API Bend Variant Effects Disease (zs-mlm-llr)
- Caduceus-Ps on GFMBench-API Bend Variant Effects Expression (zs-embedding)
- Caduceus-Ps on GFMBench-API Bend Variant Effects Expression (zs-mlm-llr)
- Caduceus-Ps on GFMBench-API BRCA1 (zs-embedding)
- Caduceus-Ps on GFMBench-API BRCA1 (zs-mlm-llr)
- Caduceus-Ps on GFMBench-API ClinVar Indel Pathogenicity (zs-embedding)
- Caduceus-Ps on GFMBench-API GUE Promoter All (supervised)
- Caduceus-Ps on GFMBench-API GUE Splice Site (supervised)
- Caduceus-Ps on GFMBench-API GUE Transcription Factor (supervised)
- Caduceus-Ps on GFMBench-API LOL-EVE (zs-embedding)
- Caduceus-Ps on GFMBench-API LRB Variant Effect Causal eQTL (supervised)
- Caduceus-Ps on GFMBench-API LRB Variant Effect OMIM (zs-embedding)
- Caduceus-Ps on GFMBench-API LRB Variant Effect OMIM (zs-mlm-llr)
- Caduceus-Ps on GFMBench-API Songlab ClinVar (zs-embedding)
- Caduceus-Ps on GFMBench-API Songlab ClinVar (zs-mlm-llr)
- Caduceus-Ps on GFMBench-API TraitGym Complex (zs-embedding)
- Caduceus-Ps on GFMBench-API TraitGym Complex (zs-mlm-llr)
- Caduceus-Ps on GFMBench-API TraitGym Mendelian (zs-embedding)
- Caduceus-Ps on GFMBench-API TraitGym Mendelian (zs-mlm-llr)
- Caduceus-Ps on GFMBench-API Var Bench Coding Pathogenicity (supervised)
- Caduceus-Ps on GFMBench-API Var Bench Common Vs Rare (supervised)
- Caduceus-Ps on GFMBench-API Var Bench Expression (supervised)
- Caduceus-Ps on GFMBench-API Var Bench meQTL (supervised)
- Caduceus-Ps on GFMBench-API Var Bench Non Coding Pathogenicity (supervised)
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
23 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| attributes.artifact_sha256 df9934c88ee245b1e19e155174169d6b6da57ae07c1a04bbea7115423facdf72 Source metadata | GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models No field-specific location recorded Version: bioRxiv preprint version 2, posted 2026-08-11 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Artifact url https://www.biorxiv.org/content/10.64898/2026.02.19.706811v2.full.pdf Source metadata | GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models No field-specific location recorded Version: bioRxiv preprint version 2, posted 2026-08-11 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Doi 10.64898/2026.02.19.706811 Source metadata | GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models No field-specific location recorded Version: bioRxiv preprint version 2, posted 2026-08-11 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Licence CC-BY-4.0 Source metadata | GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models No field-specific location recorded Version: bioRxiv preprint version 2, posted 2026-08-11 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Limitations2 values
| GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models No field-specific location recorded Version: bioRxiv preprint version 2, posted 2026-08-11 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Media type application/pdf Source metadata | GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models No field-specific location recorded Version: bioRxiv preprint version 2, posted 2026-08-11 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Publication status preprint Source metadata | GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models No field-specific location recorded Version: bioRxiv preprint version 2, posted 2026-08-11 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Retrieved at 2026-10-11T00:44:58Z Source metadata | GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models No field-specific location recorded Version: bioRxiv preprint version 2, posted 2026-08-11 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Review: date 2026-10-11 Source metadata | GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models No field-specific location recorded Version: bioRxiv preprint version 2, posted 2026-08-11 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Review: method note Artifact re-retrieved or unpacked and SHA-256 matched. Source metadata | GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models No field-specific location recorded Version: bioRxiv preprint version 2, posted 2026-08-11 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Sources and history
Release 2026-10-22-1b7cf027e4f6 · Record review: source checked
Primary source retrieved and hashed for the 2026-10-11 genomics literature pass.
Technical metadata and extraction receipts
Stable ID: lit-genomics-20261011-gfmbench-source-larey2026
- areas
- dna-genomes
- contexts
- research
- url
- https://doi.org/10.64898/2026.02.19.706811
- artifact url
- https://www.biorxiv.org/content/10.64898/2026.02.19.706811v2.full.pdf
- version
- bioRxiv preprint version 2, posted 2026-08-11
- retrieved at
- 2026-10-11T00:44:58Z
- artifact sha256
- df9934c88ee245b1e19e155174169d6b6da57ae07c1a04bbea7115423facdf72
- doi
- 10.64898/2026.02.19.706811
- publication status
- preprint
- licence
- CC-BY-4.0
- media type
- application/pdf
- limitations
- Preprint, not peer reviewed.; Authors are at NVIDIA, which distributes the BioNeMo implementation of Evo2 used here; no model in the tables was developed by the authors.
- review
- method: source-hash-verification; method note: Artifact re-retrieved or unpacked and SHA-256 matched.; reviewer: claude; reviewer note: Claude review agent reviewer-gen-3, independent of the extractor lit-genomics; no human review claimed; date: 2026-10-11