NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG
Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG. Scored with Zero-shot NDCG on NABench deep mutational scanning assays. Aggregated by the NABench authors across NABench deep mutational scanning assays.
Overview
Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG. Scored with Zero-shot NDCG on NABench deep mutational scanning assays. Aggregated by the NABench authors across NABench deep mutational scanning assays.
Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.
Results
Each comparison retains its reviewed evaluation scope, dataset and metric. Results are shown without a pooled ranking.
NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG
ndcg (fraction) · Higher values are better.
NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG · NABench deep mutational scanning assays (NABench split)
Evidence origin: Author-reported evaluation.
NABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, column(Zero-shot NDCG)- Zero-shot, few-shot and supervised cross validation figures come from different protocols and are not comparable to each other.
- The per-nucleotide-type figures and the overall figures describe the same runs at different resolutions, so they must not be combined.
Comparison details and limitations
Every method NABench reports on Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG, scored with Zero-shot NDCG on NABench deep mutational scanning assays.
- Author-reported numbers, source checked but not independently reproduced.
Automated source review: 2026-09-18. Numerical source review does not establish independent reproduction.
Dots show point estimates. Whiskers show only explicitly defined uncertainty (standard deviation, standard error or a labelled interval); their definitions remain in Table. Unresolved uncertainty is not plotted. Differences do not establish statistical significance.
Showing 12 of 25 matching rows.
Methods and evaluation design
Procedure, tasks and evaluated configurations
Evaluation design
Benchmarks bring together tasks and protocols. A task describes the biological question; a protocol defines a particular test.
Benchmarks
These source-backed links do not make different protocols or scores interchangeable.
Recorded evaluations
Each evaluation records what was tested and under which conditions.
- AIDO.RNA on NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG
- BiRNA-BERT on NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG
- Crafts on NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG
- Dnabert_6 on NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG
- Dnabert on NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG
- Enformer on NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG
- Evo_1.5_8k_base on NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG
- Evo_1_8k_base on NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG
- Evo_1_8k on NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG
- Evo2-7B-base on NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG
- Evo2-7B on NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG
- GENA-LM-large on NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG
Run instructions
No runnable recipe has been reviewed for this task. Dataset access, model requirements, licences and compute requirements must be checked against its sources before execution.
A task describes a biological question. Choose a linked protocol to obtain concrete split and scoring instructions.
Strengths, limitations and unresolved questions
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
1 evidence row matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| Relationship: part of discovery-benchmark-nabench Individual claims | NABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction Table 6, column(Zero-shot NDCG) Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | source checked automated source review · 2026-09-18 Audit detailsPrimary-source transcription with no human sign-off and no independent reproduction. Field: Claim: nabench-association-dms-zs-ndcg Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
Sources and history
View linked audit checks and correction history
Release 2026-09-29-06401fd5b220 · Record review: source checked
1 source records and release history
- NABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Original source · Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256
Technical metadata and extraction receipts
Stable ID: nabench-task-dms-zs-ndcg
- areas
- rna-transcriptomes
- tasks
- Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG
- metric
- Zero-shot NDCG
- metric direction
- higher
- dataset
- NABench deep mutational scanning assays
- protocol
- Aggregated by the NABench authors across NABench deep mutational scanning assays.
- source locator
- Table 6, column(Zero-shot NDCG)
- comparison panels
- id: nabench-panel-dms-zs-ndcg; title: NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG; protocol id: nabench-task-dms-zs-ndcg; dataset id: nabench-dataset-nabench-deep-mutational-scanning-assays; metric: ndcg; unit: fraction; direction: higher; result ids: nabench-result-rna-fm-dms-zs-ndcg-ndcg; nabench-result-rnaernie-dms-zs-ndcg-ndcg; nabench-result-space-dms-zs-ndcg-ndcg; nabench-result-aido-rna-dms-zs-ndcg-ndcg; nabench-result-birna-bert-dms-zs-ndcg-ndcg; nabench-result-crafts-dms-zs-ndcg-ndcg; nabench-result-dnabert-dms-zs-ndcg-ndcg; nabench-result-dnabert-6-dms-zs-ndcg-ndcg; nabench-result-enformer-dms-zs-ndcg-ndcg; nabench-result-evo2-7b-dms-zs-ndcg-ndcg; nabench-result-evo2-7b-base-dms-zs-ndcg-ndcg; nabench-result-evo-1-5-8k-base-dms-zs-ndcg-ndcg; nabench-result-evo-1-8k-dms-zs-ndcg-ndcg; nabench-result-evo-1-8k-base-dms-zs-ndcg-ndcg; nabench-result-gena-lm-large-dms-zs-ndcg-ndcg; nabench-result-generator-3b-dms-zs-ndcg-ndcg; nabench-result-generrna-dms-zs-ndcg-ndcg; nabench-result-genslm-dms-zs-ndcg-ndcg; nabench-result-hyenadna-dms-zs-ndcg-ndcg; nabench-result-lucaone-dms-zs-ndcg-ndcg; nabench-result-lucavirus-dms-zs-ndcg-ndcg; nabench-result-n-t-v2-50m-dms-zs-ndcg-ndcg; nabench-result-resm-dms-zs-ndcg-ndcg; nabench-result-rinalmo-giga-dms-zs-ndcg-ndcg; nabench-result-structrfm-dms-zs-ndcg-ndcg; source ids: evidence-expansion-nabench-fefd48d5; source locator: Table 6, column(Zero-shot NDCG); context: Every method NABench reports on Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG, scored with Zero-shot NDCG on NABench deep mutational scanning assays.; caveats: Author-reported numbers, source checked but not independently reproduced.; Zero-shot, few-shot and supervised cross validation figures come from different protocols and are not comparable to each other.; The per-nucleotide-type figures and the overall figures describe the same runs at different resolutions, so they must not be combined.; review: method: automated_source_review; date: 2026-09-18
Related records
- part of: NABench
- subject: NABench DMS-ZS-NDCG: part of discovery-benchmark-nabench
- benchmark: AIDO.RNA on NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG
- benchmark: BiRNA-BERT on NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG
- benchmark: Crafts on NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG
- benchmark: Dnabert_6 on NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG
- benchmark: Dnabert on NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG
- benchmark: Enformer on NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG
- benchmark: Evo_1.5_8k_base on NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG
- benchmark: Evo_1_8k_base on NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG
- benchmark: Evo_1_8k on NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG
- benchmark: Evo2-7B-base on NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG
- benchmark: Evo2-7B on NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG
- benchmark: GENA-LM-large on NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG
- benchmark: GENERator-3B on NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG
- benchmark: GenerRNA on NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG
- benchmark: GenSLM on NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG
- benchmark: HyenaDNA on NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG
- benchmark: LucaOne on NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG
- benchmark: LucaVirus on NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG
- benchmark: N.T.-v2-50m on NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG
- benchmark: RESM on NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG
- benchmark: RiNALMo_giga on NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG
- benchmark: RNA-FM on NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG
- benchmark: RNAernie on NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG
- benchmark: SPACE on NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG
- benchmark: structRFM on NABench DMS-ZS-NDCG: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot NDCG