GENEB leaderboard (leaderboard.json, 13 task-type aggregates); Git commit 9642d481e40c0af23995dcd162b779613f789f97 (repository pushed 2026-08-22)

What this source contributed

Records in this release that cite this source. A record can cite several sources.

19 models
41 configurations
1 benchmark
3 protocols
1 dataset
123 evaluations
1,845 results
1 evidence claim

Results

Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.

Value	Metric	Model or configuration	Dataset	Evaluation
0.1273326041289636 unitless	MCC (1-shot; category 'Chromatin Acc.')	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (1-shot)
0.2189314072002921 unitless	MCC (1-shot; category 'Coding/NC')	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (1-shot)
0.012761325739143424 unitless	MCC (1-shot; category 'DNA Methyl.')	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (1-shot)
0.12243430084698051 unitless	MCC (1-shot; category 'Enhancers')	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (1-shot)
0.09681772499206528 unitless	MCC (1-shot; category 'Histone Mod.')	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (1-shot)
0.02622715627574435 unitless	MCC (1-shot; category 'lncRNA')	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (1-shot)
0.022264052842632102 unitless	MCC (1-shot; category 'Mouse Enh.')	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (1-shot)
0.269450629972771 unitless	MCC (1-shot; category 'Promoters')	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (1-shot)
0.0885984544808596 unitless	MCC (1-shot; category 'Regulatory')	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (1-shot)
0.17573237856896884 unitless	MCC (1-shot; category 'Species Clf.')	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (1-shot)
0.06376548368621764 unitless	MCC (1-shot; category 'Splice Sites')	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (1-shot)
0.04333849074992452 unitless	MCC (1-shot; category 'TF Binding')	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (1-shot)
0.02203092094722295 unitless	MCC (1-shot; category 'Virus/Phage')	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (1-shot)
0.09920653311013737 unitless	MCC (1-shot; macro average: unweighted mean of the 13 category MCCs)	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (1-shot)
0.11940464561165019 unitless	MCC (1-shot; micro average: mean over all 100 tasks)	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (1-shot)
0.3827514020131914 unitless	MCC (10-shot; category 'Chromatin Acc.')	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (10-shot)
0.5651449791677905 unitless	MCC (10-shot; category 'Coding/NC')	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (10-shot)
0.034562926122503834 unitless	MCC (10-shot; category 'DNA Methyl.')	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (10-shot)
0.2573589270514975 unitless	MCC (10-shot; category 'Enhancers')	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (10-shot)
0.25551262554138393 unitless	MCC (10-shot; category 'Histone Mod.')	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (10-shot)
0.08206064903816347 unitless	MCC (10-shot; category 'lncRNA')	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (10-shot)
0.12164889479841309 unitless	MCC (10-shot; category 'Mouse Enh.')	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (10-shot)
0.4873934717383831 unitless	MCC (10-shot; category 'Promoters')	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (10-shot)
0.16840455148633196 unitless	MCC (10-shot; category 'Regulatory')	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (10-shot)
0.4191766779243385 unitless	MCC (10-shot; category 'Species Clf.')	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (10-shot)
0.09435582991872717 unitless	MCC (10-shot; category 'Splice Sites')	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (10-shot)
0.12429221903482109 unitless	MCC (10-shot; category 'TF Binding')	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (10-shot)
0.0893124923243843 unitless	MCC (10-shot; category 'Virus/Phage')	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (10-shot)
0.23707504970461 unitless	MCC (10-shot; macro average: unweighted mean of the 13 category MCCs)	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (10-shot)
0.25826830745279616 unitless	MCC (10-shot; micro average: mean over all 100 tasks)	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (10-shot)
0.5617643288816202 unitless	MCC (full training data; category 'Chromatin Acc.')	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (full training data)
0.7919376908739103 unitless	MCC (full training data; category 'Coding/NC')	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (full training data)
0.21062100209908463 unitless	MCC (full training data; category 'DNA Methyl.')	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (full training data)
0.4461929770567211 unitless	MCC (full training data; category 'Enhancers')	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (full training data)
0.4751960599117348 unitless	MCC (full training data; category 'Histone Mod.')	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (full training data)
0.3360305677101986 unitless	MCC (full training data; category 'lncRNA')	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (full training data)
0.4176024532315375 unitless	MCC (full training data; category 'Mouse Enh.')	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (full training data)
0.6929401333818945 unitless	MCC (full training data; category 'Promoters')	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (full training data)
0.43306903865877444 unitless	MCC (full training data; category 'Regulatory')	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (full training data)
0.697484863400478 unitless	MCC (full training data; category 'Species Clf.')	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (full training data)
0.45532418904391825 unitless	MCC (full training data; category 'Splice Sites')	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (full training data)
0.46192979321714966 unitless	MCC (full training data; category 'TF Binding')	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (full training data)
0.4800266371519185 unitless	MCC (full training data; category 'Virus/Phage')	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (full training data)
0.49693228727837996 unitless	MCC (full training data; macro average: unweighted mean of the 13 category MCCs)	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (full training data)
0.4962853848839059 unitless	MCC (full training data; micro average: mean over all 100 tasks)	agro-NT-1b (GENEB leaderboard)	GENEB 100 tasks	agro-NT-1b on GENEB (full training data)
-0.0431872385962855 unitless	MCC (1-shot; category 'Chromatin Acc.')	BioFM-265M (GENEB leaderboard)	GENEB 100 tasks	BioFM-265M on GENEB (1-shot)
0.0313848203306664 unitless	MCC (1-shot; category 'Coding/NC')	BioFM-265M (GENEB leaderboard)	GENEB 100 tasks	BioFM-265M on GENEB (1-shot)
0.005969457070921338 unitless	MCC (1-shot; category 'DNA Methyl.')	BioFM-265M (GENEB leaderboard)	GENEB 100 tasks	BioFM-265M on GENEB (1-shot)
-0.008827817147045149 unitless	MCC (1-shot; category 'Enhancers')	BioFM-265M (GENEB leaderboard)	GENEB 100 tasks	BioFM-265M on GENEB (1-shot)
0.03383112608726713 unitless	MCC (1-shot; category 'Histone Mod.')	BioFM-265M (GENEB leaderboard)	GENEB 100 tasks	BioFM-265M on GENEB (1-shot)

Claims

Statements this source supports, each with where in the source it was checked.

GENEB leaderboard: part of GENEB: Part of GENEB (Both records describe the GENEB suite in the darlednik/GENEB repository at commit 9642d481e40c0af23995dcd162b779613f789f97: src-discovery-darlednik-geneb is README.md and lit-genomics-20261011-geneb-source-leaderboard is leaderboard/leaderboard.json at the same commit. The leaderboard record is the suite's published aggregate, not a separate benchmark.)

Models, benchmarks and other records

Models (19)

Configurations (41)

Benchmarks (1)

GENEB leaderboard

Protocols (3)

Datasets (1)

GENEB 100 tasks

Evaluations (123)

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

22 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-10-22-1b7cf027e4f6
Property and statement	Original source and location	Review and provenance
attributes.artifact_sha256 7c8a9d985e7c2df24514f309bf6102e4f81d9da1b9afbb74856d87e78e01f738 Source metadata	GENEB leaderboard (leaderboard.json, 13 task-type aggregates) Original source ↗ No field-specific location recorded Version: Git commit 9642d481e40c0af23995dcd162b779613f789f97 (repository pushed 2026-08-22) Retrieved: 2026-10-11T01:42:40Z	catalogued No individual claim review recorded Audit details Field: `attributes.artifact_sha256` Source artifact SHA-256: `7c8a9d985e7c2df24514f309bf6102e4f81d9da1b9afbb74856d87e78e01f738` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Artifact url https://raw.githubusercontent.com/darlednik/GENEB/9642d481e40c0af23995dcd162b779613f789f97/leaderboard/leaderboard.json Source metadata	GENEB leaderboard (leaderboard.json, 13 task-type aggregates) Original source ↗ No field-specific location recorded Version: Git commit 9642d481e40c0af23995dcd162b779613f789f97 (repository pushed 2026-08-22) Retrieved: 2026-10-11T01:42:40Z	catalogued No individual claim review recorded Audit details Field: `attributes.artifact_url` Source artifact SHA-256: `7c8a9d985e7c2df24514f309bf6102e4f81d9da1b9afbb74856d87e78e01f738` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Licence Apache-2.0 Source metadata	GENEB leaderboard (leaderboard.json, 13 task-type aggregates) Original source ↗ No field-specific location recorded Version: Git commit 9642d481e40c0af23995dcd162b779613f789f97 (repository pushed 2026-08-22) Retrieved: 2026-10-11T01:42:40Z	catalogued No individual claim review recorded Audit details Field: `attributes.licence` Source artifact SHA-256: `7c8a9d985e7c2df24514f309bf6102e4f81d9da1b9afbb74856d87e78e01f738` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Limitations 3 values Mutable leaderboard; the commit pins this retrieval. The README says the JSON is regenerated from reviewed submissions. Benchmark paper: GENEB, arXiv 2606.04525 (v4, 2026-06). The store already holds 22 Table 8 results from v1 (source evidence-expansion-p2-evidence-discovery-final-geneb-47975089c0ca). Accuracy and F1 aggregates, and the 100 per-task scores in leaderboard_tasks.json, were not extracted. Source metadata	GENEB leaderboard (leaderboard.json, 13 task-type aggregates) Original source ↗ No field-specific location recorded Version: Git commit 9642d481e40c0af23995dcd162b779613f789f97 (repository pushed 2026-08-22) Retrieved: 2026-10-11T01:42:40Z	catalogued No individual claim review recorded Audit details Field: `attributes.limitations` Source artifact SHA-256: `7c8a9d985e7c2df24514f309bf6102e4f81d9da1b9afbb74856d87e78e01f738` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Media type application/json Source metadata	GENEB leaderboard (leaderboard.json, 13 task-type aggregates) Original source ↗ No field-specific location recorded Version: Git commit 9642d481e40c0af23995dcd162b779613f789f97 (repository pushed 2026-08-22) Retrieved: 2026-10-11T01:42:40Z	catalogued No individual claim review recorded Audit details Field: `attributes.media_type` Source artifact SHA-256: `7c8a9d985e7c2df24514f309bf6102e4f81d9da1b9afbb74856d87e78e01f738` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Publication status official_project_source Source metadata	GENEB leaderboard (leaderboard.json, 13 task-type aggregates) Original source ↗ No field-specific location recorded Version: Git commit 9642d481e40c0af23995dcd162b779613f789f97 (repository pushed 2026-08-22) Retrieved: 2026-10-11T01:42:40Z	catalogued No individual claim review recorded Audit details Field: `attributes.publication_status` Source artifact SHA-256: `7c8a9d985e7c2df24514f309bf6102e4f81d9da1b9afbb74856d87e78e01f738` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Retrieved at 2026-10-11T01:42:40Z Source metadata	GENEB leaderboard (leaderboard.json, 13 task-type aggregates) Original source ↗ No field-specific location recorded Version: Git commit 9642d481e40c0af23995dcd162b779613f789f97 (repository pushed 2026-08-22) Retrieved: 2026-10-11T01:42:40Z	catalogued No individual claim review recorded Audit details Field: `attributes.retrieved_at` Source artifact SHA-256: `7c8a9d985e7c2df24514f309bf6102e4f81d9da1b9afbb74856d87e78e01f738` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Review: date 2026-10-11 Source metadata	GENEB leaderboard (leaderboard.json, 13 task-type aggregates) Original source ↗ No field-specific location recorded Version: Git commit 9642d481e40c0af23995dcd162b779613f789f97 (repository pushed 2026-08-22) Retrieved: 2026-10-11T01:42:40Z	catalogued No individual claim review recorded Audit details Field: `attributes.review.date` Source artifact SHA-256: `7c8a9d985e7c2df24514f309bf6102e4f81d9da1b9afbb74856d87e78e01f738` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Review: method note Artifact re-retrieved or unpacked and SHA-256 matched. Source metadata	GENEB leaderboard (leaderboard.json, 13 task-type aggregates) Original source ↗ No field-specific location recorded Version: Git commit 9642d481e40c0af23995dcd162b779613f789f97 (repository pushed 2026-08-22) Retrieved: 2026-10-11T01:42:40Z	catalogued No individual claim review recorded Audit details Field: `attributes.review.method_note` Source artifact SHA-256: `7c8a9d985e7c2df24514f309bf6102e4f81d9da1b9afbb74856d87e78e01f738` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Review method 1 values source-hash-verification Source metadata	GENEB leaderboard (leaderboard.json, 13 task-type aggregates) Original source ↗ No field-specific location recorded Version: Git commit 9642d481e40c0af23995dcd162b779613f789f97 (repository pushed 2026-08-22) Retrieved: 2026-10-11T01:42:40Z	catalogued No individual claim review recorded Audit details Field: `attributes.review.method` Source artifact SHA-256: `7c8a9d985e7c2df24514f309bf6102e4f81d9da1b9afbb74856d87e78e01f738` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact

How to read the evidence

Sources and history

Release 2026-10-22-1b7cf027e4f6 · Record review: source checked

Primary source retrieved and hashed for the 2026-10-11 genomics literature pass.

Release history

No supporting source is linked yet.

Read original source

Download this release (gzip)

Technical metadata and extraction receipts

Stable ID: lit-genomics-20261011-geneb-source-leaderboard

areas: dna-genomes
contexts: research
url: https://github.com/darlednik/GENEB/blob/9642d481e40c0af23995dcd162b779613f789f97/leaderboard/leaderboard.json
artifact url: https://raw.githubusercontent.com/darlednik/GENEB/9642d481e40c0af23995dcd162b779613f789f97/leaderboard/leaderboard.json
version: Git commit 9642d481e40c0af23995dcd162b779613f789f97 (repository pushed 2026-08-22)
retrieved at: 2026-10-11T01:42:40Z
artifact sha256: 7c8a9d985e7c2df24514f309bf6102e4f81d9da1b9afbb74856d87e78e01f738
publication status: official_project_source
licence: Apache-2.0
media type: application/json
limitations: Mutable leaderboard; the commit pins this retrieval. The README says the JSON is regenerated from reviewed submissions.; Benchmark paper: GENEB, arXiv 2606.04525 (v4, 2026-06). The store already holds 22 Table 8 results from v1 (source evidence-expansion-p2-evidence-discovery-final-geneb-47975089c0ca).; Accuracy and F1 aggregates, and the 100 per-task scores in leaderboard_tasks.json, were not extracted.
review: method: source-hash-verification; method note: Artifact re-retrieved or unpacked and SHA-256 matched.; reviewer: claude; reviewer note: Claude review agent reviewer-gen-1, independent of the extractor lit-genomics; no human review claimed; date: 2026-10-11

Related records