rewirebio.iobenchmarks
Result

AUROC (tissue-weighted mean) of AlphaGenome absolute multimodal scores → RandomForestClassifier on Supervised distance-balanced eQTL causality: evaluated data subset

0.8 AUROC (tissue-weighted mean)

Methods

Tested pipeline
AlphaGenome absolute multimodal scores → RandomForestClassifier
Protocol
Supervised distance-balanced eQTL causality (AlphaGenome paper)
Dataset subset
Supervised distance-balanced eQTL causality: evaluated data subset
Procedure
Train the source’s random-forest classifier on the same balanced causality dataset and score the held-out chromosome test set.
Evaluation
AlphaGenome absolute multimodal scores → RandomForestClassifier: Supervised distance-balanced eQTL causality
Coverage
Not reported scored / Not reported eligible
Uncertainty
Not reported by the source
Evidence
Author-reported evaluation · source checkedAlphaGenome Nature 2026 supplementary comparison tables · 'Suppl Table 4 Variant performan'!M14

A source-checked result verifies the numerical transcription, not every model or protocol detail. Evaluation metadata: needs review. Source checked does not mean independently reproduced.

Reproduction

Split
Supervised training chromosomes are 1,4,7,8,10,13,15; validation chromosomes 2,5,11,14,17,20,22,X; test chromosomes 3,6,9,12,16,18,19,21. This is downstream evaluation separation, not a held-out reference-genome claim for the distilled backbone. The task additionally describes five-fold random-forest training excluding test chromosomes, followed by mean test auROC across those fits; exact fold membership is not enumerated.
Adaptation
AlphaGenome absolute multimodal scores → RandomForestClassifier
Scoring implementation
Not reported

No execution recipe has been verified for this exact configuration and evaluation. A benchmark's general instructions may use different inputs, splits or model settings.

Reproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

1 evidence row matching the loaded filters

Claims, original sources and review scope · Release 2026-11-02-a7f03c9e55a5
Property and statementOriginal source and locationReview and provenance
Reported result
0.80
Individual claims
AlphaGenome Nature 2026 supplementary comparison tables

Original source ↗

'Suppl Table 4 Variant performan'!M14

Version: Nature version of record, 28 January 2026
Retrieved: 2026-09-17T06:31:06.887921+00:00

source checked

["deterministic-table-parse","automated-source-review"] · 2026-09-17

author reported

Audit details

Checked against a second extraction. Fixed-format display and exact stored decimals preserved separately. No experiment rerun.

Field: attributes.printed_value

Source artifact SHA-256: 833cb78b6ae6fe39415cfff296ac00c48d800326139f13eb307531a1cc133154

Hash scope: SHA-256 of exact retrieved original artifact bytes

Format: xlsx

Inspected artifact

Extraction artifact SHA-256: 833cb78b6ae6fe39415cfff296ac00c48d800326139f13eb307531a1cc133154

Extraction artifact

Sources and history

Release 2026-11-02-a7f03c9e55a5 · Record review: source checked

3 source records and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: alphagenome-2026-result-5059e5c4d8ea60db

areas
dna-genomes
printed value
0.80
printed value basis
Workbook number format 0.00
numeric value
0.799775799314286
raw xml value
0.799775799314286
workbook number format
0.00
metric
auroc
metric direction
higher
unit
unitless
aggregation
auROC per tissue weighted by the tissue’s variant count; the supervised analysis additionally averages auROC across five fitted folds.
source cells
'Suppl Table 4 Variant performan'!M14
source locator
'Suppl Table 4 Variant performan'!M14
review
method: deterministic-table-parse; automated-source-review; date: 2026-09-17; artifact sha256: 833cb78b6ae6fe39415cfff296ac00c48d800326139f13eb307531a1cc133154; retrieval url: https://media.springernature.com/original/springer-static/esm/art%3A10.1038%2Fs41586-025-10014-0/MediaObjects/41586_2025_10014_MOESM3_ESM.xlsx; note: Checked against a second extraction. Fixed-format display and exact stored decimals preserved separately. No experiment rerun.; method note: OOXML extraction; separate automated review against the primary source
missing metadata
eligible count: reason: unextracted; scored count: reason: unextracted; seeds: reason: unreported; uncertainty: reason: unreported
source warnings
None recorded
metric qualifier
tissue-weighted mean
Related records

Suggest a correction