rewirebio.iobenchmarks
Result

Pearson (mean over loci or contexts) of borzoi-ensemble (paper Table 4) on Zero-shot CAGI5 MPRA activity-effect prediction (borzoi-ensemble-matched comparison): evaluated data subset

0.55 Pearson (mean over loci or contexts)

Methods

Tested configuration
borzoi-ensemble (paper Table 4)
Protocol
Zero-shot CAGI5 MPRA activity-effect prediction (borzoi-ensemble-matched comparison) (AlphaGenome paper)
Dataset subset
Zero-shot CAGI5 MPRA activity-effect prediction (borzoi-ensemble-matched comparison): evaluated data subset
Related family profiles
Borzoi
Procedure
Compute locus/context Pearson correlations between predicted and observed effects. The Borzoi strategy uses its reported scoring windows and modified matching; the ChromBPNet comparison excludes the unavailable TERT-GBM context.
Evaluation
borzoi-ensemble (paper Table 4): Zero-shot CAGI5 MPRA activity-effect prediction (borzoi-ensemble-matched comparison)
Coverage
Not reported scored / Not reported eligible
Uncertainty
Not reported by the source
Evidence
Author-reported evaluation · source checkedAlphaGenome Nature 2026 supplementary comparison tables · 'Suppl Table 4 Variant performan'!L11

A source-checked result verifies the numerical transcription, not every model or protocol detail. Evaluation metadata: needs review. Source checked does not mean independently reproduced.

Reproduction

Split
Use the challenge’s evaluation data and reported locus exclusions. Do not replace this locus-based protocol with the generic variant chromosome split.
Adaptation
borzoi-ensemble (paper Table 4)
Scoring implementation
Not reported

No execution recipe has been verified for this exact configuration and evaluation. A benchmark's general instructions may use different inputs, splits or model settings.

Reproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

1 evidence row matching the loaded filters

Claims, original sources and review scope · Release 2026-11-02-a7f03c9e55a5
Property and statementOriginal source and locationReview and provenance
Reported result
0.55
Individual claims
AlphaGenome Nature 2026 supplementary comparison tables

Original source ↗

'Suppl Table 4 Variant performan'!L11

Version: Nature version of record, 28 January 2026
Retrieved: 2026-09-17T06:31:06.887921+00:00

source checked

["deterministic-table-parse","automated-source-review"] · 2026-09-17

author reported

Audit details

Checked against a second extraction. Fixed-format display and exact stored decimals preserved separately. No experiment rerun.

Field: attributes.printed_value

Source artifact SHA-256: 833cb78b6ae6fe39415cfff296ac00c48d800326139f13eb307531a1cc133154

Hash scope: SHA-256 of exact retrieved original artifact bytes

Format: xlsx

Inspected artifact

Extraction artifact SHA-256: 833cb78b6ae6fe39415cfff296ac00c48d800326139f13eb307531a1cc133154

Extraction artifact

Sources and history

Release 2026-11-02-a7f03c9e55a5 · Record review: source checked

3 source records and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: alphagenome-2026-result-e2a1c17623286afb

areas
dna-genomes
printed value
0.55
printed value basis
Canonical stored-number transcription of a General-format cell; visible spreadsheet precision depends on column width.
numeric value
0.55000000000000004
raw xml value
0.55000000000000004
workbook number format
General
metric
pearson-correlation
metric direction
higher
unit
unitless
aggregation
Mean Pearson correlation over the included locus/context comparisons; Table4 rows10 and11 have different AlphaGenome scalars and must remain separate.
source cells
'Suppl Table 4 Variant performan'!L11
source locator
'Suppl Table 4 Variant performan'!L11
review
method: deterministic-table-parse; automated-source-review; date: 2026-09-17; artifact sha256: 833cb78b6ae6fe39415cfff296ac00c48d800326139f13eb307531a1cc133154; retrieval url: https://media.springernature.com/original/springer-static/esm/art%3A10.1038%2Fs41586-025-10014-0/MediaObjects/41586_2025_10014_MOESM3_ESM.xlsx; note: Checked against a second extraction. Fixed-format display and exact stored decimals preserved separately. No experiment rerun.; method note: OOXML extraction; separate automated review against the primary source
missing metadata
eligible count: reason: unextracted; scored count: reason: unextracted; seeds: reason: unreported; uncertainty: reason: unreported
source warnings
The same evaluation index 9 has different AlphaGenome results in rows 10/11. Preserve comparator-specific locus/matching protocol; do not deduplicate these AlphaGenome rows.
metric qualifier
mean over loci or contexts
Related records

Suggest a correction