Result

Pearson delta (1,000 most highly expressed control genes; mean over held-out perturbations and splits) of UCE (Ahlmann-Eltze et al. 2025) on Adamson et al. 2016 Perturb-seq, K562 CRISPRi single perturbations (GEARS distribution, Ahlmann-Eltze et al. 2025)

0.724 Pearson delta (1,000 most highly expressed control genes; mean over held-out perturbations and splits) Computed by Rewire from the authors' source data

Evidence concern: excluded from comparisons

Panel A repeats Source Data Fig. 2 Panel A row for row (48, 262 and 413 rows per method over two splits). Methods restricts the analysis to 73, 398 and 629 perturbations predicted by all models; the sheet does not have these counts.Source Data Extended Data Fig. 8, Ahlmann-Eltze et al. 2025 · Methods 'Single perturbation benchmark setup' paragraph 4 versus Source Data Extended Data Fig. 8, sheet "Panel A"

The Fig. 2 legend gives "134, 210 and 24 unseen single perturbations across two test-training splits". In Panel A these are the split 1 counts only (Replogle K562 134, Replogle RPE1 210, Adamson 24 rows per method); split 2 has 128, 203 and 24, so the two-split totals are 262, 413 and 48. The Fig. 2a means recorded here use all Panel A rows; whether the plotted red lines use both splits is not stated beyond the sheet itself. Reviewer check 2026-10-11: using split 1 rows only would change the per-model means by up to 0.61 (L2 distance) and 0.06 (Pearson delta), and would change the model with the lowest mean L2 distance on Adamson and Replogle RPE1, so the choice is material.Source Data Fig. 2, Ahlmann-Eltze et al. 2025 · Fig. 2 legend versus Source Data Fig. 2, sheet "Panel A"

Methods restricts the single-perturbation analysis to perturbations predicted by all models: 73 for Adamson, 398 for Replogle K562 and 629 for Replogle RPE1. No sheet of Source Data Fig. 2 has these counts (Panel A: 48, 262 and 413 per method over two splits; Panel C: 20, 214 and 224 test or val rows per method).Source Data Fig. 2, Ahlmann-Eltze et al. 2025 · Methods 'Single perturbation benchmark setup' paragraph 4 versus Source Data Fig. 2, sheets "Panel A" and "Panel C"

The test and val rows in Panel C (20, 214 and 224 per method for Adamson, Replogle K562 and Replogle RPE1) match neither the Fig. 2 legend counts nor the Methods counts. Fig. 2c was not extracted.Source Data Fig. 2, Ahlmann-Eltze et al. 2025 · Source Data Fig. 2, sheet "Panel C" versus the Fig. 2 legend and Methods

The main text says CPA was not included in the single-perturbation benchmark, but method "cpa" has rows in Panel C. Fig. 2c was not extracted.Source Data Fig. 2, Ahlmann-Eltze et al. 2025 · Main text paragraph 16 versus Source Data Fig. 2, sheet "Panel C"

How this value was computed

Computed by Rewire from the authors' source data. This value is not printed in the source; Rewire computed it with the script below from the data files listed.

Inputs

Source Data Extended Data Fig. 8, Ahlmann-Eltze et al. 2025 · Data file, Source Data Extended Data Fig. 8 (MOESM10), sheet "Panel A"; rows where dataset_name == "adamson" and method == "uce"; train in {test, val}; seed in {1, 2}; column r2_delta (48 rows) · file checksum 040dae4985b4

Aggregation, as the source describes it

The horizontal red lines show the mean per model · Deep-learning-based gene perturbation effect prediction does not yet outperform simple linear baselines · Data file, Extended Data Fig. 8 legend, panel a

Script

scripts/omics/derive/ahlmann_eltze_2025.py · checksum 452a7a7aaab7

Precision

Exact arithmetic mean of the stored cell values, rounded half to even to 3 decimal places

Note

The sheet labels each held-out perturbation test or val; both are pooled, as for Fig. 1. The Fig. 2 legend counts are the split 1 counts only; this mean uses both splits as the sheet does (see the source's evidence concerns).

Methods

Tested configuration: UCE (Ahlmann-Eltze et al. 2025)
Protocol: Adamson: expression prediction for unseen single perturbations (Ahlmann-Eltze et al. 2025 Fig. 2a and Extended Data Fig. 8a)
Dataset: Adamson et al. 2016 Perturb-seq, K562 CRISPRi single perturbations (GEARS distribution, Ahlmann-Eltze et al. 2025)
Procedure: Adamson: expression prediction for unseen single perturbations (Ahlmann-Eltze et al. 2025 Fig. 2a and Extended Data Fig. 8a)
Evaluation: UCE on Adamson (Ahlmann-Eltze et al. 2025)
Coverage: 48/48 perturbation-split rows scored
Uncertainty: Not reported by the source: No spread of the mean is stated; Rewire did not compute one
Evidence: Independent external evaluation · source checkedDeep-learning-based gene perturbation effect prediction does not yet outperform simple linear baselines; Source Data Extended Data Fig. 8, Ahlmann-Eltze et al. 2025 · Source Data Extended Data Fig. 8 (MOESM10), sheet "Panel A", rows with dataset_name "adamson" and method "uce", column "r2_delta"; plotted as the red line in Extended Data Fig. 8a

Review of a computed result checks its inputs and script against the source's data, not every model or protocol detail. Evaluation metadata: source checked. Source checked does not mean independently reproduced.

Reproduction

Split: GEARS 'simulation' test-training split, run twice (two splits)
Adaptation: Fine-tuned, fitted or applied per split by the paper's authors with default parameters where possible
Scoring implementation: L2 distance and Pearson delta over the 1,000 most highly expressed genes in the control condition (Methods 'Evaluation metrics')

No execution recipe has been verified for this exact configuration and evaluation. A benchmark's general instructions may use different inputs, splits or model settings.

Reproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

2 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-10-22-1b7cf027e4f6
Property and statement	Original source and location	Review and provenance
Computed by Rewire from source data 0.724 Individual claims	Deep-learning-based gene perturbation effect prediction does not yet outperform simple linear baselines Original source ↗ Source Data Extended Data Fig. 8 (MOESM10), sheet "Panel A", rows with dataset_name "adamson" and method "uce", column "r2_delta"; plotted as the red line in Extended Data Fig. 8a Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: Nature Methods 22(8):1657, published online 2025-08-04; PMC12328236 full-text XML Retrieved: 2026-10-11T00:48:13Z	source checked ["source-hash-verification","source-data-recomputation","independent-cell-check"] · 2026-10-11T03:00:00Z independent paper Audit details Computed by scripts/omics/derive/ahlmann_eltze_2025.py (sha256 452a7a7aaab7e4965142de87ed9f00209a6d9664760919cb39b921bb45aec45c) from the re-downloaded workbook, whose SHA-256 the script checks along with every row count. Not printed in the source. Independent review 2026-10-11: value recomputed and matches; not printed in the source and not a reproduction of any model run. See docs/reviews/use-cases/genetic-perturbation-response-2026-10-11.md. Field: `attributes.printed_value` Source artifact SHA-256: `dc5ccf62cb51d301f327a3c3e629d60be719bb2aaf02b57fb4999be43a4d95c7` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact Extraction artifact SHA-256: `040dae4985b4461817b96eb807390c8fe3f2c115523f4dfcb7692485aa0734e3` Extraction artifact
Computed by Rewire from source data 0.724 Individual claims	Source Data Extended Data Fig. 8, Ahlmann-Eltze et al. 2025 Original source ↗ Source Data Extended Data Fig. 8 (MOESM10), sheet "Panel A", rows with dataset_name "adamson" and method "uce", column "r2_delta"; plotted as the red line in Extended Data Fig. 8a Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: Source Data Extended Data Fig. 8 (41592_2025_2772_MOESM10_ESM.xlsx) as published with the article Retrieved: 2026-10-11T00:48:13Z	source checked ["source-hash-verification","source-data-recomputation","independent-cell-check"] · 2026-10-11T03:00:00Z independent paper Source has a recorded evidence concern. Consult its source page before using the claim. Audit details Computed by scripts/omics/derive/ahlmann_eltze_2025.py (sha256 452a7a7aaab7e4965142de87ed9f00209a6d9664760919cb39b921bb45aec45c) from the re-downloaded workbook, whose SHA-256 the script checks along with every row count. Not printed in the source. Independent review 2026-10-11: value recomputed and matches; not printed in the source and not a reproduction of any model run. See docs/reviews/use-cases/genetic-perturbation-response-2026-10-11.md. Field: `attributes.printed_value` Source artifact SHA-256: `040dae4985b4461817b96eb807390c8fe3f2c115523f4dfcb7692485aa0734e3` Hash scope: Hash scope not separately documented; inspect source record Extraction artifact SHA-256: `040dae4985b4461817b96eb807390c8fe3f2c115523f4dfcb7692485aa0734e3` Extraction artifact

How to read the evidence

Sources and history

Release 2026-10-22-1b7cf027e4f6 · Record review: source checked

3 source records and release history

Deep-learning-based gene perturbation effect prediction does not yet outperform simple linear baselines · Original source · Nature Methods 22(8):1657, published online 2025-08-04; PMC12328236 full-text XML
Source Data Extended Data Fig. 8, Ahlmann-Eltze et al. 2025 · Original source · Source Data Extended Data Fig. 8 (41592_2025_2772_MOESM10_ESM.xlsx) as published with the article
Source Data Fig. 2, Ahlmann-Eltze et al. 2025 · Original source · Source Data Fig. 2 (41592_2025_2772_MOESM4_ESM.xlsx) as published with the article

Download this release (gzip)

Technical metadata and extraction receipts

Stable ID: perturbation-ahlmann-20261011-result-ed8a-adamson-uce

areas: cells-tissues; single-cell
contexts: research
printed value: 0.724
numeric value: 0.724
metric: pearson-delta
metric qualifier: 1,000 most highly expressed control genes; mean over held-out perturbations and splits
metric direction: higher
unit: unitless
source locator: Source Data Extended Data Fig. 8 (MOESM10), sheet "Panel A", rows with dataset_name "adamson" and method "uce", column "r2_delta"; plotted as the red line in Extended Data Fig. 8a
coverage: scored: 48; eligible: 48; unit: perturbation-split rows
derivation: method: computed-from-source-data; inputs: source id: perturbation-ahlmann-20261011-source-data-ed-fig8; artifact sha256: 040dae4985b4461817b96eb807390c8fe3f2c115523f4dfcb7692485aa0734e3; locator: Source Data Extended Data Fig. 8 (MOESM10), sheet "Panel A"; row filter: dataset_name == "adamson" and method == "uce"; train in {test, val}; seed in {1, 2}; column r2_delta; row count: 48; aggregation: The horizontal red lines show the mean per model; aggregation source id: perturbation-ahlmann-20261011-source-article; aggregation locator: Extended Data Fig. 8 legend, panel a; script: scripts/omics/derive/ahlmann_eltze_2025.py; script sha256: 452a7a7aaab7e4965142de87ed9f00209a6d9664760919cb39b921bb45aec45c; precision: Exact arithmetic mean of the stored cell values, rounded half to even to 3 decimal places; note: The sheet labels each held-out perturbation test or val; both are pooled, as for Fig. 1. The Fig. 2 legend counts are the split 1 counts only; this mean uses both splits as the sheet does (see the source's evidence concerns).
review: method: source-hash-verification; source-data-recomputation; independent-cell-check; method note: Re-downloaded all four workbooks and the article XML and matched each SHA-256. Checked the script's SHA-256, reran it on the fresh downloads (output identical to derived-values.jsonl), and recomputed every mean with a separate openpyxl reader written for this review. Checked the row filter and count, the quoted aggregation at its locator, rounding (no value within 0.001 of a rounding tie), metric, qualifier, unit, direction, and the evaluation's configuration, protocol, dataset and origin.; reviewer: claude; reviewer note: Separate Claude (Opus 5.5) review agent, independent of the extractor; no human review claimed; reviewed at: 2026-10-11T03:00:00Z; artifact sha256: 040dae4985b4461817b96eb807390c8fe3f2c115523f4dfcb7692485aa0734e3; retrieval url: https://static-content.springer.com/esm/art%3A10.1038%2Fs41592-025-02772-6/MediaObjects/41592_2025_2772_MOESM10_ESM.xlsx; note: Computed by scripts/omics/derive/ahlmann_eltze_2025.py (sha256 452a7a7aaab7e4965142de87ed9f00209a6d9664760919cb39b921bb45aec45c) from the re-downloaded workbook, whose SHA-256 the script checks along with every row count. Not printed in the source. Independent review 2026-10-11: value recomputed and matches; not printed in the source and not a reproduction of any model run. See docs/reviews/use-cases/genetic-perturbation-response-2026-10-11.md.
missing metadata: uncertainty: reason: unreported; note: No spread of the mean is stated; Rewire did not compute one

Related records

evaluation: UCE on Adamson (Ahlmann-Eltze et al. 2025)

Suggest a correction