rewirebio.iobenchmarks
Configuration

Absolute Spearman correlation edges (Kendiukhov 2026)

Absolute Spearman correlation between the perturbed gene and each other gene across the same control cells used for attention extraction.

5 evaluations · 5 results

Overview

An explanatory profile has not yet been reviewed for this record.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Evaluations and results

5 evaluations · 5 results. Different protocols are not a single leaderboard.

Sorted by AUROC (per-perturbation AUROC for DE targets (LFC > 0.5), summarised over perturbations; K562 CRISPRi) (higher is better). The best value in each column is highlighted. Decimals are rounded for display; each value links to the printed value and its source.

Tested configurationProtocol and datasetAUROC (per-perturbation AUROC for DE targets (LFC > 0.5), summarised over perturbations; K562 CRISPRi)AUROC (per-perturbation AUROC for DE targets, summarised over perturbations; RPE1 CRISPRi)AUROC (AUROC over propensity-matched perturbation-gene pairs (k = 5 negatives per positive))
Absolute Spearman correlation edges (Kendiukhov 2026)EvaluationPerturbation-first AUROC, K562 CRISPRi (Kendiukhov 2026), Replogle genome-scale CRISPRi, K562, 280 evaluable perturbations (Kendiukhov 2026)0.703 (best in column)Not reportedNot reported
Absolute Spearman correlation edges (Kendiukhov 2026)EvaluationPerturbation-first AUROC, K562 CRISPRi (Kendiukhov 2026), Replogle genome-scale CRISPRi, K562, 151 perturbations (Kendiukhov 2026)0.696Not reportedNot reported
Absolute Spearman correlation edges (Kendiukhov 2026)EvaluationPerturbation-first AUROC, RPE1 CRISPRi (Kendiukhov 2026), Replogle genome-scale CRISPRi, RPE1, 1,167 perturbations, confound battery (Kendiukhov 2026)Not reported0.658 (best in column)Not reported
Absolute Spearman correlation edges (Kendiukhov 2026)EvaluationPerturbation-first AUROC, RPE1 CRISPRi (Kendiukhov 2026), Replogle genome-scale CRISPRi, RPE1, 1,251 evaluable perturbations (Kendiukhov 2026)Not reported0.658 (best in column)Not reported
Absolute Spearman correlation edges (Kendiukhov 2026)EvaluationPropensity-matched edge AUROC (Kendiukhov 2026), Replogle CRISPRi RPE1, propensity-matched pairs (Kendiukhov 2026)Not reportedNot reported0.561
All 5 result rows with coverage, uncertainty and sources
Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: Absolute Spearman correlation edges (Kendiukhov 2026)Protocol: Perturbation-first AUROC, K562 CRISPRi (Kendiukhov 2026)
Dataset subset: Replogle genome-scale CRISPRi, K562, 151 perturbations (Kendiukhov 2026)
0.696 AUROC (per-perturbation AUROC for DE targets (LFC > 0.5), summarised over perturbations; K562 CRISPRi)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Absolute Spearman correlation edges on Replogle genome-scale CRISPRi, K562, 151 perturbations

gfm-guides-20261014-kendiukhov2026-protocol-pf-k562-crispri

Aggregation: Not reported

Systematic evaluation of single-cell foundation model interpretability: attention-derived edge scores add no incremental value over gene-level features for perturbation-target prediction (Kendiukhov 2026, BMC Genomics 27:634) · Page 7, 'Perturbation-first validation reveals gene-level dominance', paragraph 1, sentence 3: 'AUROC = 0.696 under the primary parameterisation'
Configuration: Absolute Spearman correlation edges (Kendiukhov 2026)Protocol: Perturbation-first AUROC, K562 CRISPRi (Kendiukhov 2026)
Dataset subset: Replogle genome-scale CRISPRi, K562, 280 evaluable perturbations (Kendiukhov 2026)
0.703 AUROC (per-perturbation AUROC for DE targets (LFC > 0.5), summarised over perturbations; K562 CRISPRi)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Absolute Spearman correlation edges on Replogle genome-scale CRISPRi, K562, 280 evaluable perturbations

gfm-guides-20261014-kendiukhov2026-protocol-pf-k562-crispri

Aggregation: Not reported

Systematic evaluation of single-cell foundation model interpretability: attention-derived edge scores add no incremental value over gene-level features for perturbation-target prediction (Kendiukhov 2026, BMC Genomics 27:634) · Page 7, 'Perturbation-first validation reveals gene-level dominance', paragraph 2, sentence 1: '(0.703; Wilcoxon p = 0.73'
Configuration: Absolute Spearman correlation edges (Kendiukhov 2026)Protocol: Perturbation-first AUROC, RPE1 CRISPRi (Kendiukhov 2026)
Dataset subset: Replogle genome-scale CRISPRi, RPE1, 1,167 perturbations, confound battery (Kendiukhov 2026)
0.658 AUROC (per-perturbation AUROC for DE targets, summarised over perturbations; RPE1 CRISPRi)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Absolute Spearman correlation edges on Replogle genome-scale CRISPRi, RPE1, 1,167 perturbations, confound battery

gfm-guides-20261014-kendiukhov2026-protocol-pf-rpe1-crispri

Aggregation: Not reported

Systematic evaluation of single-cell foundation model interpretability: attention-derived edge scores add no incremental value over gene-level features for perturbation-target prediction (Kendiukhov 2026, BMC Genomics 27:634) · Page 10, 'Cross-cell-type generalisation of confound pattern', item (i): 'variance AUROC = 0.866, mean expression = 0.851, dropout = 0.797 vs. attention = 0.747 and correlation = 0.658'
Configuration: Absolute Spearman correlation edges (Kendiukhov 2026)Protocol: Perturbation-first AUROC, RPE1 CRISPRi (Kendiukhov 2026)
Dataset subset: Replogle genome-scale CRISPRi, RPE1, 1,251 evaluable perturbations (Kendiukhov 2026)
0.658 AUROC (per-perturbation AUROC for DE targets, summarised over perturbations; RPE1 CRISPRi)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Absolute Spearman correlation edges on Replogle genome-scale CRISPRi, RPE1, 1,251 evaluable perturbations

gfm-guides-20261014-kendiukhov2026-protocol-pf-rpe1-crispri

Aggregation: Not reported

Systematic evaluation of single-cell foundation model interpretability: attention-derived edge scores add no incremental value over gene-level features for perturbation-target prediction (Kendiukhov 2026, BMC Genomics 27:634) · Page 10, 'Context-dependent attention-correlation relationship', sentence 4: '(L15: 0.748 vs. 0.658'
Configuration: Absolute Spearman correlation edges (Kendiukhov 2026)Protocol: Propensity-matched edge AUROC (Kendiukhov 2026)
Dataset subset: Replogle CRISPRi RPE1, propensity-matched pairs (Kendiukhov 2026)
0.561 AUROC (AUROC over propensity-matched perturbation-gene pairs (k = 5 negatives per positive))
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Absolute Spearman correlation edges on Replogle CRISPRi RPE1, propensity-matched pairs

gfm-guides-20261014-kendiukhov2026-protocol-propensity-matched

Aggregation: Not reported

Systematic evaluation of single-cell foundation model interpretability: attention-derived edge scores add no incremental value over gene-level features for perturbation-target prediction (Kendiukhov 2026, BMC Genomics 27:634) · Page 10, 'Cross-cell-type generalisation of confound pattern', item (iii): '(attention = 0.568, correlation = 0.561)'

Source checking is not independent reproduction. Release 2026-11-02-a7f03c9e55a5.

Use this configuration

How it works, versions and access

Additional methodological details, versions and access terms have not yet been extracted into a structured profile for this configuration. Consult the linked sources and evaluation records below.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-02-a7f03c9e55a5
Property and statementOriginal source and locationReview and provenance

No evidence rows match these filters. Choose another scope or clear the search.

Sources and history

Release 2026-11-02-a7f03c9e55a5 · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: gfm-guides-20261014-kendiukhov2026-config-spearman-edge

areas
single-cell; biological-networks
contexts
research
method types
conventional_pipeline
reported name
correlation
foundation model eligible
false
representation
Absolute Spearman correlation between the perturbed gene and each other gene across the same control cells used for attention extraction.
source locator
Page 13 'Models and data', 'Attention extraction and edge score computation', 'Model coverage by analysis family'
training setting
Computed from each dataset's control cells
access reuse
Analysis code github.com/Biodyn-AI/biomechinterp-framework and Zenodo 10.5281/zenodo.18701417; not pinned to a commit in the article
missing metadata
version: reason: inapplicable; note: Defined in the article
Related records

Suggest a correction