rewirebio.iobenchmarks
Result

MCC (10-shot; category 'DNA Methyl.') of eccdnamamba_weights (GENEB leaderboard) on GENEB 100 tasks

0.0683 MCC (10-shot; category 'DNA Methyl.')

Methods

Tested configuration
eccdnamamba_weights (GENEB leaderboard)
Protocol
GENEB leaderboard, 10-shot, MCC aggregates
Dataset
GENEB 100 tasks
Procedure
GENEB leaderboard, 10-shot, MCC aggregates
Evaluation
eccdnamamba_weights on GENEB (10-shot)
Coverage
Not reported scored / Not reported eligible
Uncertainty
Not reported by the source
Evidence
Independent external evaluation · source checkedGENEB leaderboard (leaderboard.json, 13 task-type aggregates) · leaderboard.json data.10shot, model 'eccdnamamba_weights', key 'cat_MCC.DNA Methyl.'

A source-checked result verifies the numerical transcription, not every model or protocol detail. Evaluation metadata: source checked. Source checked does not mean independently reproduced.

Reproduction

Split
10-shot
Adaptation
Logistic-regression probe on frozen embeddings
Scoring implementation
MCC

No execution recipe has been verified for this exact configuration and evaluation. A benchmark's general instructions may use different inputs, splits or model settings.

Reproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

1 evidence row matching the loaded filters

Claims, original sources and review scope · Release 2026-10-22-1b7cf027e4f6
Property and statementOriginal source and locationReview and provenance
Reported result
0.0682862542601049
Individual claims
GENEB leaderboard (leaderboard.json, 13 task-type aggregates)

Original source ↗

leaderboard.json data.10shot, model 'eccdnamamba_weights', key 'cat_MCC.DNA Methyl.'

Version: Git commit 9642d481e40c0af23995dcd162b779613f789f97 (repository pushed 2026-08-22)
Retrieved: 2026-10-11T01:42:40Z

source checked

["source-hash-verification","deterministic-table-parse","independent-cell-check"] · 2026-10-11

independent paper

Audit details

Extraction: Read the pinned leaderboard.json with tools/extract_geneb.py; keys data.<regime>[i].micro_MCC, macro_MCC and cat_MCC.<category>; model id from the 'model' key. leaderboard.json data.10shot, model 'eccdnamamba_weights', key 'cat_MCC.DNA Methyl.' Independent review 2026-10-11: value, locator, metric, unit, direction and linked configuration and protocol checked; corrections from the review applied by the extractor as listed in review.md.

Field: attributes.printed_value

Source artifact SHA-256: 7c8a9d985e7c2df24514f309bf6102e4f81d9da1b9afbb74856d87e78e01f738

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Extraction artifact SHA-256: 7c8a9d985e7c2df24514f309bf6102e4f81d9da1b9afbb74856d87e78e01f738

Extraction artifact

Sources and history

Release 2026-10-22-1b7cf027e4f6 · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: lit-genomics-20261011-geneb-result-eccdnamamba-weights-10shot-dna-methyl

metric
matthews-correlation-coefficient
metric direction
higher
unit
unitless
printed value
0.0682862542601049
source locator
leaderboard.json data.10shot, model 'eccdnamamba_weights', key 'cat_MCC.DNA Methyl.'
review
method: source-hash-verification; deterministic-table-parse; independent-cell-check; method note: Re-fetched leaderboard.json at commit 9642d481 and matched its SHA-256; an automated comparison of all 1,845 results against the JSON keys found 0 mismatches; a separate jq check of a stratified sample of 66 values also matched.; reviewer: claude; reviewer note: Claude review agent reviewer-gen-1, independent of the extractor lit-genomics; no human review claimed; date: 2026-10-11; artifact sha256: 7c8a9d985e7c2df24514f309bf6102e4f81d9da1b9afbb74856d87e78e01f738; retrieval url: https://raw.githubusercontent.com/darlednik/GENEB/9642d481e40c0af23995dcd162b779613f789f97/leaderboard/leaderboard.json; note: Extraction: Read the pinned leaderboard.json with tools/extract_geneb.py; keys data.<regime>[i].micro_MCC, macro_MCC and cat_MCC.<category>; model id from the 'model' key. leaderboard.json data.10shot, model 'eccdnamamba_weights', key 'cat_MCC.DNA Methyl.' Independent review 2026-10-11: value, locator, metric, unit, direction and linked configuration and protocol checked; corrections from the review applied by the extractor as listed in review.md.
numeric value
0.0682862542601049
metric qualifier
10-shot; category 'DNA Methyl.'
missing metadata
uncertainty: reason: unreported
printed value basis
Full-precision JSON number as stored
Related records

Suggest a correction