GFMBench-API
Python interface that wraps existing genomic tasks (GUE, VariantBenchmarks, LRB, BEND, TraitGym, SongLab ClinVar, BRCA1, VEP-eval, LOL-EVE) and a new ClinVar indel task behind one evaluation API.
Results are recorded on the linked protocols, tasks or configurations listed below. Their settings and evaluations are kept separate.
Overview
An explanatory profile has not yet been reviewed for this record.
Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.
Results on linked records
This benchmark has no results of its own in this release. 37 linked records have results. They are not assigned to the underlying benchmark: each record keeps its own settings and evaluations, and its scores are on its own page.
- GFMBench-API Bend Variant Effects Disease, zs-ar-llr Protocol · part of this benchmark · 1 evaluation · 2 results
- GFMBench-API Bend Variant Effects Disease, zs-embedding Protocol · part of this benchmark · 5 evaluations · 30 results
- GFMBench-API Bend Variant Effects Disease, zs-mlm-llr Protocol · part of this benchmark · 4 evaluations · 8 results
- GFMBench-API Bend Variant Effects Expression, zs-ar-llr Protocol · part of this benchmark · 1 evaluation · 2 results
- GFMBench-API Bend Variant Effects Expression, zs-embedding Protocol · part of this benchmark · 5 evaluations · 30 results
- GFMBench-API Bend Variant Effects Expression, zs-mlm-llr Protocol · part of this benchmark · 4 evaluations · 8 results
- GFMBench-API BRCA1, zs-ar-llr Protocol · part of this benchmark · 1 evaluation · 2 results
- GFMBench-API BRCA1, zs-embedding Protocol · part of this benchmark · 5 evaluations · 30 results
- GFMBench-API BRCA1, zs-mlm-llr Protocol · part of this benchmark · 4 evaluations · 8 results
- GFMBench-API ClinVar Indel Pathogenicity, zs-ar-llr Protocol · part of this benchmark · 1 evaluation · 2 results
- GFMBench-API ClinVar Indel Pathogenicity, zs-embedding Protocol · part of this benchmark · 5 evaluations · 20 results
- GFMBench-API GUE Promoter All, supervised Protocol · part of this benchmark · 5 evaluations · 20 results
- GFMBench-API GUE Splice Site, supervised Protocol · part of this benchmark · 5 evaluations · 20 results
- GFMBench-API GUE Transcription Factor, supervised Protocol · part of this benchmark · 5 evaluations · 20 results
- GFMBench-API LOL-EVE, zs-ar-llr Protocol · part of this benchmark · 1 evaluation · 2 results
- GFMBench-API LOL-EVE, zs-embedding Protocol · part of this benchmark · 5 evaluations · 20 results
- GFMBench-API LRB Variant Effect Causal eQTL, supervised Protocol · part of this benchmark · 5 evaluations · 20 results
- GFMBench-API LRB Variant Effect OMIM, zs-ar-llr Protocol · part of this benchmark · 1 evaluation · 2 results
- GFMBench-API LRB Variant Effect OMIM, zs-embedding Protocol · part of this benchmark · 5 evaluations · 30 results
- GFMBench-API LRB Variant Effect OMIM, zs-mlm-llr Protocol · part of this benchmark · 4 evaluations · 8 results
- GFMBench-API Songlab ClinVar, zs-ar-llr Protocol · part of this benchmark · 1 evaluation · 2 results
- GFMBench-API Songlab ClinVar, zs-embedding Protocol · part of this benchmark · 5 evaluations · 30 results
- GFMBench-API Songlab ClinVar, zs-mlm-llr Protocol · part of this benchmark · 4 evaluations · 8 results
- GFMBench-API TraitGym Complex, zs-ar-llr Protocol · part of this benchmark · 1 evaluation · 2 results
- GFMBench-API TraitGym Complex, zs-embedding Protocol · part of this benchmark · 5 evaluations · 30 results
- GFMBench-API TraitGym Complex, zs-mlm-llr Protocol · part of this benchmark · 4 evaluations · 8 results
- GFMBench-API TraitGym Mendelian, zs-ar-llr Protocol · part of this benchmark · 1 evaluation · 2 results
- GFMBench-API TraitGym Mendelian, zs-embedding Protocol · part of this benchmark · 5 evaluations · 30 results
- GFMBench-API TraitGym Mendelian, zs-mlm-llr Protocol · part of this benchmark · 4 evaluations · 8 results
- GFMBench-API Var Bench Coding Pathogenicity, supervised Protocol · part of this benchmark · 5 evaluations · 20 results
- GFMBench-API Var Bench Common Vs Rare, supervised Protocol · part of this benchmark · 5 evaluations · 20 results
- GFMBench-API Var Bench Expression, supervised Protocol · part of this benchmark · 5 evaluations · 20 results
- GFMBench-API Var Bench meQTL, supervised Protocol · part of this benchmark · 5 evaluations · 20 results
- GFMBench-API Var Bench Non Coding Pathogenicity, supervised Protocol · part of this benchmark · 5 evaluations · 20 results
- GFMBench-API Var Bench sQTL, supervised Protocol · part of this benchmark · 4 evaluations · 16 results
- GFMBench-API VEP-eval, zs-embedding Protocol · part of this benchmark · 4 evaluations · 24 results
- GFMBench-API VEP-eval, zs-mlm-llr Protocol · part of this benchmark · 4 evaluations · 8 results
Methods and evaluation design
Procedure, tasks and evaluated configurations
Baseline coverage
Reference methods help show what a model adds beyond simple controls. We track a null control and a conventional method for each protocol.
0 of 74 active baseline roles have published Rewire measurements in this release. Measurements on a selected protocol do not establish coverage of an entire suite.
Baseline status by linked protocol
- GFMBench-API Bend Variant Effects Disease, zs-ar-llr · 0/2 roles measured
- GFMBench-API Bend Variant Effects Disease, zs-embedding · 0/2 roles measured
- GFMBench-API Bend Variant Effects Disease, zs-mlm-llr · 0/2 roles measured
- GFMBench-API Bend Variant Effects Expression, zs-ar-llr · 0/2 roles measured
- GFMBench-API Bend Variant Effects Expression, zs-embedding · 0/2 roles measured
- GFMBench-API Bend Variant Effects Expression, zs-mlm-llr · 0/2 roles measured
- GFMBench-API BRCA1, zs-ar-llr · 0/2 roles measured
- GFMBench-API BRCA1, zs-embedding · 0/2 roles measured
- GFMBench-API BRCA1, zs-mlm-llr · 0/2 roles measured
- GFMBench-API ClinVar Indel Pathogenicity, zs-ar-llr · 0/2 roles measured
- GFMBench-API ClinVar Indel Pathogenicity, zs-embedding · 0/2 roles measured
- GFMBench-API GUE Promoter All, supervised · 0/2 roles measured
- GFMBench-API GUE Splice Site, supervised · 0/2 roles measured
- GFMBench-API GUE Transcription Factor, supervised · 0/2 roles measured
- GFMBench-API LOL-EVE, zs-ar-llr · 0/2 roles measured
- GFMBench-API LOL-EVE, zs-embedding · 0/2 roles measured
- GFMBench-API LRB Variant Effect Causal eQTL, supervised · 0/2 roles measured
- GFMBench-API LRB Variant Effect OMIM, zs-ar-llr · 0/2 roles measured
- GFMBench-API LRB Variant Effect OMIM, zs-embedding · 0/2 roles measured
- GFMBench-API LRB Variant Effect OMIM, zs-mlm-llr · 0/2 roles measured
- GFMBench-API Songlab ClinVar, zs-ar-llr · 0/2 roles measured
- GFMBench-API Songlab ClinVar, zs-embedding · 0/2 roles measured
- GFMBench-API Songlab ClinVar, zs-mlm-llr · 0/2 roles measured
- GFMBench-API TraitGym Complex, zs-ar-llr · 0/2 roles measured
- GFMBench-API TraitGym Complex, zs-embedding · 0/2 roles measured
- GFMBench-API TraitGym Complex, zs-mlm-llr · 0/2 roles measured
- GFMBench-API TraitGym Mendelian, zs-ar-llr · 0/2 roles measured
- GFMBench-API TraitGym Mendelian, zs-embedding · 0/2 roles measured
- GFMBench-API TraitGym Mendelian, zs-mlm-llr · 0/2 roles measured
- GFMBench-API Var Bench Coding Pathogenicity, supervised · 0/2 roles measured
- GFMBench-API Var Bench Common Vs Rare, supervised · 0/2 roles measured
- GFMBench-API Var Bench Expression, supervised · 0/2 roles measured
- GFMBench-API Var Bench meQTL, supervised · 0/2 roles measured
- GFMBench-API Var Bench Non Coding Pathogenicity, supervised · 0/2 roles measured
- GFMBench-API Var Bench sQTL, supervised · 0/2 roles measured
- GFMBench-API VEP-eval, zs-embedding · 0/2 roles measured
- GFMBench-API VEP-eval, zs-mlm-llr · 0/2 roles measured
Protocol coverage CSV (gzip) · Model evaluation matrix (gzip) · Source table (gzip) · Release and checksums (gzip)
Coverage is derived from release 2026-10-22-1b7cf027e4f6. Source citations describe the original records; they do not validate an unreviewed baseline proposal. No results have been generated by this audit.
Run instructions
No runnable recipe has been reviewed for this benchmark. Dataset access, model requirements, licences and compute requirements must be checked against its sources before execution.
Strengths, limitations and unresolved questions
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
0 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|
No evidence rows match these filters. Choose another scope or clear the search.
Sources and history
Release 2026-10-22-1b7cf027e4f6 · Record review: source checked
1 source record and release history
- GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models · Original source · bioRxiv preprint version 2, posted 2026-08-11
Technical metadata and extraction receipts
Stable ID: lit-genomics-20261011-gfmbench-benchmark-gfmbench-api
- areas
- dna-genomes
- contexts
- research
- entity level
- suite
- version
- Preprint v2 (2026-08-11)
- task
- Supervised classification and zero-shot variant effect prediction on DNA sequence
- scope note
- Tasks are re-implementations of existing benchmarks with some changes, for example fixed test folds instead of cross-validation for VariantBenchmarks.
- source locator
- Technical Methods; Appendix task descriptions; Tables 1-5
Related records
- part of: GFMBench-API Bend Variant Effects Disease, zs-ar-llr
- part of: GFMBench-API Bend Variant Effects Disease, zs-embedding
- part of: GFMBench-API Bend Variant Effects Disease, zs-mlm-llr
- part of: GFMBench-API Bend Variant Effects Expression, zs-ar-llr
- part of: GFMBench-API Bend Variant Effects Expression, zs-embedding
- part of: GFMBench-API Bend Variant Effects Expression, zs-mlm-llr
- part of: GFMBench-API BRCA1, zs-ar-llr
- part of: GFMBench-API BRCA1, zs-embedding
- part of: GFMBench-API BRCA1, zs-mlm-llr
- part of: GFMBench-API ClinVar Indel Pathogenicity, zs-ar-llr
- part of: GFMBench-API ClinVar Indel Pathogenicity, zs-embedding
- part of: GFMBench-API GUE Promoter All, supervised
- part of: GFMBench-API GUE Splice Site, supervised
- part of: GFMBench-API GUE Transcription Factor, supervised
- part of: GFMBench-API LOL-EVE, zs-ar-llr
- part of: GFMBench-API LOL-EVE, zs-embedding
- part of: GFMBench-API LRB Variant Effect Causal eQTL, supervised
- part of: GFMBench-API LRB Variant Effect OMIM, zs-ar-llr
- part of: GFMBench-API LRB Variant Effect OMIM, zs-embedding
- part of: GFMBench-API LRB Variant Effect OMIM, zs-mlm-llr
- part of: GFMBench-API Songlab ClinVar, zs-ar-llr
- part of: GFMBench-API Songlab ClinVar, zs-embedding
- part of: GFMBench-API Songlab ClinVar, zs-mlm-llr
- part of: GFMBench-API TraitGym Complex, zs-ar-llr
- part of: GFMBench-API TraitGym Complex, zs-embedding
- part of: GFMBench-API TraitGym Complex, zs-mlm-llr
- part of: GFMBench-API TraitGym Mendelian, zs-ar-llr
- part of: GFMBench-API TraitGym Mendelian, zs-embedding
- part of: GFMBench-API TraitGym Mendelian, zs-mlm-llr
- part of: GFMBench-API Var Bench Coding Pathogenicity, supervised
- part of: GFMBench-API Var Bench Common Vs Rare, supervised
- part of: GFMBench-API Var Bench Expression, supervised
- part of: GFMBench-API Var Bench meQTL, supervised
- part of: GFMBench-API Var Bench Non Coding Pathogenicity, supervised
- part of: GFMBench-API Var Bench sQTL, supervised
- part of: GFMBench-API VEP-eval, zs-embedding
- part of: GFMBench-API VEP-eval, zs-mlm-llr