rewirebio.iobenchmarks
Contested result

scFoundation and scGPT: Wu et al. 2025, Additional file 3 (Supplementary Tables S1-S13) reverses the order

  • Low severity
  • Not yet reviewed
  • Ordering reversal
  • Different tasks across studies

Wu et al. 2025, Additional file 3 (Supplementary Tables S1-S13) ranks scFoundation above scGPT in 3 of 3 comparisons; other studies rank scGPT above scFoundation in 16 of 18.

An automatic lead, not a finding of error. The results below are shown as published, everywhere on the site, until a reviewer decides otherwise.

Which studies agree

2 papers rank scGPT above scFoundation in 16 of their 22 comparisons and scFoundation higher in 2; 4 are ties. Wu et al. 2025 ranks scFoundation above scGPT in all 3 comparisons that are not ties (1 is a tie).

Papers grouped by which system they rank higher: scGPT or scFoundationRank scGPT higher: Csendes et al. 2025. Rank scFoundation higher: Wu et al. 2025 (disagrees). Mixed: Deep-learning-based gene perturbation….Rank scGPT higherMixedRank scFoundation higherCsendes et al. 2025Csendes et al. 2025, Supplementary Material 4 (Supplementary Tables 1-3)Deep-learning-basedgene perturbation…Deep-learning-based gene perturbation effect prediction does not yet outperform simple linear baselinesWu et al. 2025Wu et al. 2025, Additional file 3 (Supplementary Tables S1-S13)
  • Rank scGPT higher (1): Csendes et al. 2025
  • Rank scFoundation higher (1): Wu et al. 2025 (disagrees)
  • Mixed (1): Deep-learning-based gene perturbation…

Each paper sits where at least two thirds of its comparisons point; Mixed means neither model reaches two thirds. The larger, outlined dot is the paper that disagrees.

Comparisons in which each paper scores scGPT or scFoundation higherWu et al. 2025 (disagrees): scGPT higher in 0, scFoundation higher in 3, 1 tie. Csendes et al. 2025: scGPT higher in 15, scFoundation higher in 1, 4 ties. Deep-learning-based gene perturbation…: scGPT higher in 1, scFoundation higher in 1, 0 ties.Disagrees: Wu et al. 2025Wu et al. 2025, Additional file 3 (Supplementary Tables S1-S13)1 tie13 scFoundation higher3Csendes et al. 2025Csendes et al. 2025, Supplementary Material 4 (Supplementary Tables 1-3)15 scGPT higher154 tie41 scFoundation higherDeep-learning-based gene perturbation…Deep-learning-based gene perturbation effect prediction does not yet outperform simple linear baselines1 scGPT higher11 scFoundation higher1
scGPT higherTiescFoundation higherNumbers are counts of comparisons; the outlined bar is the paper that disagrees.
Comparisons in Wu et al. 2025 (4)
ProtocolDatasetMetricscGPTscFoundationHigher
Cross-atlas annotation transfer, HLCA to Tabula Sapiens, 14 shared cell types (Wu et al. 2025 Table S3)Tabula Sapiens (CELLxGENE), 120 leaf cell types after processingMacro F1 (test cells of the 14 shared cell types; averaged over 'all classes' (Methods 'Macro-F1'), not stated as the 14 shared types or every source-atlas type), fraction0.2090.259scFoundation
Cross-atlas annotation transfer, HLCA to Tabula Sapiens, 14 shared cell types (Wu et al. 2025 Table S3)Tabula Sapiens (CELLxGENE), 120 leaf cell types after processingTop-1 accuracy (Accuracy@1 over cells of the 14 shared cell types), fraction0.6140.782scFoundation
Cross-atlas annotation transfer, Tabula Sapiens to HLCA, 14 shared cell types (Wu et al. 2025 Table S2)HLCA core (CELLxGENE), 37 leaf cell types after processingMacro F1 (test cells of the 14 shared cell types; averaged over 'all classes' (Methods 'Macro-F1'), not stated as the 14 shared types or every source-atlas type), fraction0.0810.083scFoundation
Cross-atlas annotation transfer, Tabula Sapiens to HLCA, 14 shared cell types (Wu et al. 2025 Table S2)HLCA core (CELLxGENE), 37 leaf cell types after processingTop-1 accuracy (Accuracy@1 over cells of the 14 shared cell types), fraction0.6740.672Tie
Comparisons in Csendes et al. 2025 (20)
ProtocolDatasetMetricscGPTscFoundationHigher
Adamson et al. 2016 Perturb-seq, K562 CRISPRi single perturbations: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Adamson et al. 2016 Perturb-seq, K562 CRISPRi single perturbations (GEARS processing, Csendes et al. 2025)Pearson (raw expression, pseudo-bulk, all genes), unitless0.990.985Tie
Adamson et al. 2016 Perturb-seq, K562 CRISPRi single perturbations: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Adamson et al. 2016 Perturb-seq, K562 CRISPRi single perturbations (GEARS processing, Csendes et al. 2025)Pearson (raw expression, top 20 DE genes (t-test, GEARS list)), unitless0.9790.969scGPT
Adamson et al. 2016 Perturb-seq, K562 CRISPRi single perturbations: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Adamson et al. 2016 Perturb-seq, K562 CRISPRi single perturbations (GEARS processing, Csendes et al. 2025)Pearson delta, unitless0.6410.552scGPT
Adamson et al. 2016 Perturb-seq, K562 CRISPRi single perturbations: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Adamson et al. 2016 Perturb-seq, K562 CRISPRi single perturbations (GEARS processing, Csendes et al. 2025)Pearson delta (top 20 DE genes (t-test) excluding the CRISPR target gene(s)), unitless0.7950.78scGPT
Adamson et al. 2016 Perturb-seq, K562 CRISPRi single perturbations: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Adamson et al. 2016 Perturb-seq, K562 CRISPRi single perturbations (GEARS processing, Csendes et al. 2025)Pearson delta (top 20 DE genes (t-test, GEARS list)), unitless0.7970.719scGPT
Norman et al. 2019 Perturb-seq, K562 CRISPRa single and double perturbations: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Norman et al. 2019 Perturb-seq, K562 CRISPRa single and double perturbations (GEARS processing, Csendes et al. 2025)Pearson (raw expression, pseudo-bulk, all genes), unitless0.9880.966scGPT
Norman et al. 2019 Perturb-seq, K562 CRISPRa single and double perturbations: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Norman et al. 2019 Perturb-seq, K562 CRISPRa single and double perturbations (GEARS processing, Csendes et al. 2025)Pearson (raw expression, top 20 DE genes (t-test, GEARS list)), unitless0.9350.924scGPT
Norman et al. 2019 Perturb-seq, K562 CRISPRa single and double perturbations: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Norman et al. 2019 Perturb-seq, K562 CRISPRa single and double perturbations (GEARS processing, Csendes et al. 2025)Pearson delta, unitless0.5540.459scGPT
Norman et al. 2019 Perturb-seq, K562 CRISPRa single and double perturbations: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Norman et al. 2019 Perturb-seq, K562 CRISPRa single and double perturbations (GEARS processing, Csendes et al. 2025)Pearson delta (top 20 DE genes (t-test) excluding the CRISPR target gene(s)), unitless0.70.71scFoundation
Norman et al. 2019 Perturb-seq, K562 CRISPRa single and double perturbations: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Norman et al. 2019 Perturb-seq, K562 CRISPRa single and double perturbations (GEARS processing, Csendes et al. 2025)Pearson delta (top 20 DE genes (t-test, GEARS list)), unitless0.7320.705scGPT
Replogle et al. 2022 genome-wide Perturb-seq subset, K562 CRISPRi: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Replogle et al. 2022 genome-wide Perturb-seq subset, K562 CRISPRi (GEARS processing, Csendes et al. 2025)Pearson (raw expression, pseudo-bulk, all genes), unitless0.9860.977Tie
Replogle et al. 2022 genome-wide Perturb-seq subset, K562 CRISPRi: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Replogle et al. 2022 genome-wide Perturb-seq subset, K562 CRISPRi (GEARS processing, Csendes et al. 2025)Pearson (raw expression, top 20 DE genes (t-test, GEARS list)), unitless0.960.952Tie
Replogle et al. 2022 genome-wide Perturb-seq subset, K562 CRISPRi: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Replogle et al. 2022 genome-wide Perturb-seq subset, K562 CRISPRi (GEARS processing, Csendes et al. 2025)Pearson delta, unitless0.3270.269scGPT
Replogle et al. 2022 genome-wide Perturb-seq subset, K562 CRISPRi: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Replogle et al. 2022 genome-wide Perturb-seq subset, K562 CRISPRi (GEARS processing, Csendes et al. 2025)Pearson delta (top 20 DE genes (t-test) excluding the CRISPR target gene(s)), unitless0.4420.394scGPT
Replogle et al. 2022 genome-wide Perturb-seq subset, K562 CRISPRi: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Replogle et al. 2022 genome-wide Perturb-seq subset, K562 CRISPRi (GEARS processing, Csendes et al. 2025)Pearson delta (top 20 DE genes (t-test, GEARS list)), unitless0.4810.383scGPT
Replogle et al. 2022 genome-wide Perturb-seq subset, RPE1 CRISPRi: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Replogle et al. 2022 genome-wide Perturb-seq subset, RPE1 CRISPRi (GEARS processing, Csendes et al. 2025)Pearson (raw expression, pseudo-bulk, all genes), unitless0.9740.971Tie
Replogle et al. 2022 genome-wide Perturb-seq subset, RPE1 CRISPRi: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Replogle et al. 2022 genome-wide Perturb-seq subset, RPE1 CRISPRi (GEARS processing, Csendes et al. 2025)Pearson (raw expression, top 20 DE genes (t-test, GEARS list)), unitless0.9240.912scGPT
Replogle et al. 2022 genome-wide Perturb-seq subset, RPE1 CRISPRi: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Replogle et al. 2022 genome-wide Perturb-seq subset, RPE1 CRISPRi (GEARS processing, Csendes et al. 2025)Pearson delta, unitless0.5960.471scGPT
Replogle et al. 2022 genome-wide Perturb-seq subset, RPE1 CRISPRi: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Replogle et al. 2022 genome-wide Perturb-seq subset, RPE1 CRISPRi (GEARS processing, Csendes et al. 2025)Pearson delta (top 20 DE genes (t-test) excluding the CRISPR target gene(s)), unitless0.6290.49scGPT
Replogle et al. 2022 genome-wide Perturb-seq subset, RPE1 CRISPRi: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Replogle et al. 2022 genome-wide Perturb-seq subset, RPE1 CRISPRi (GEARS processing, Csendes et al. 2025)Pearson delta (top 20 DE genes (t-test, GEARS list)), unitless0.6520.495scGPT
Comparisons in Deep-learning-based gene perturbation… (2)

What disagrees

Other studies
rank scGPT above scFoundation in 16 of 18 comparisons
This study
ranks scFoundation above scGPT in 3 of 3 comparisons
Compared
scFoundation, scGPT
Study that disagrees
Wu et al. 2025, Additional file 3 (Supplementary Tables S1-S13)
Other studies
6 studiesDeep-learning-based gene perturbation effect prediction does not yet outperform simple linear baselines, Source Data Extended Data Fig. 2, Ahlmann-Eltze et al. 2025, Source Data Extended Data Fig. 8, Ahlmann-Eltze et al. 2025, Source Data Fig. 1, Ahlmann-Eltze et al. 2025, Source Data Fig. 2, Ahlmann-Eltze et al. 2025, Csendes et al. 2025, Supplementary Material 4 (Supplementary Tables 1-3)
Rule
Ordering reversal; different tasks across studies
Model identity
Matched across studies partly through links not yet reviewed

The compared numbers

Each value links to its result record and source. Compare values within one protocol; the rule compares rankings, not raw values across protocols.

In the study that disagrees (6)
StudyToolProtocol or benchmarkMetricValue
Wu et al. 2025, Additional file 3 (Supplementary Tables S1-S13); Biology-driven insights into the power of single-cell foundation modelsscFoundation zero-shot embeddings with OnClass (Wu et al. 2025)Cross-atlas annotation transfer, HLCA to Tabula Sapiens, 14 shared cell types (Wu et al. 2025 Table S3)Top-1 accuracy (Accuracy@1 over cells of the 14 shared cell types)0.782
Wu et al. 2025, Additional file 3 (Supplementary Tables S1-S13); Biology-driven insights into the power of single-cell foundation modelsscFoundation zero-shot embeddings with OnClass (Wu et al. 2025)Cross-atlas annotation transfer, HLCA to Tabula Sapiens, 14 shared cell types (Wu et al. 2025 Table S3)Macro F1 (test cells of the 14 shared cell types; averaged over 'all classes' (Methods 'Macro-F1'), not stated as the 14 shared types or every source-atlas type)0.259
Wu et al. 2025, Additional file 3 (Supplementary Tables S1-S13); Biology-driven insights into the power of single-cell foundation modelsscGPT zero-shot embeddings with OnClass (Wu et al. 2025)Cross-atlas annotation transfer, HLCA to Tabula Sapiens, 14 shared cell types (Wu et al. 2025 Table S3)Top-1 accuracy (Accuracy@1 over cells of the 14 shared cell types)0.614
Wu et al. 2025, Additional file 3 (Supplementary Tables S1-S13); Biology-driven insights into the power of single-cell foundation modelsscGPT zero-shot embeddings with OnClass (Wu et al. 2025)Cross-atlas annotation transfer, HLCA to Tabula Sapiens, 14 shared cell types (Wu et al. 2025 Table S3)Macro F1 (test cells of the 14 shared cell types; averaged over 'all classes' (Methods 'Macro-F1'), not stated as the 14 shared types or every source-atlas type)0.209
Wu et al. 2025, Additional file 3 (Supplementary Tables S1-S13); Biology-driven insights into the power of single-cell foundation modelsscFoundation zero-shot embeddings with OnClass (Wu et al. 2025)Cross-atlas annotation transfer, Tabula Sapiens to HLCA, 14 shared cell types (Wu et al. 2025 Table S2)Macro F1 (test cells of the 14 shared cell types; averaged over 'all classes' (Methods 'Macro-F1'), not stated as the 14 shared types or every source-atlas type)0.083
Wu et al. 2025, Additional file 3 (Supplementary Tables S1-S13); Biology-driven insights into the power of single-cell foundation modelsscGPT zero-shot embeddings with OnClass (Wu et al. 2025)Cross-atlas annotation transfer, Tabula Sapiens to HLCA, 14 shared cell types (Wu et al. 2025 Table S2)Macro F1 (test cells of the 14 shared cell types; averaged over 'all classes' (Methods 'Macro-F1'), not stated as the 14 shared types or every source-atlas type)0.081
In the other studies (36)
StudyToolProtocol or benchmarkMetricValue
Deep-learning-based gene perturbation effect prediction does not yet outperform simple linear baselines; Source Data Extended Data Fig. 2, Ahlmann-Eltze et al. 2025; Source Data Fig. 1, Ahlmann-Eltze et al. 2025scFoundation (Ahlmann-Eltze et al. 2025)Norman double perturbations: expression prediction for held-out double perturbations (Ahlmann-Eltze et al. 2025 Fig. 1a and Extended Data Fig. 2a)Pearson delta (1,000 most highly expressed control genes; mean over held-out perturbations and splits)0.537
Deep-learning-based gene perturbation effect prediction does not yet outperform simple linear baselines; Source Data Extended Data Fig. 2, Ahlmann-Eltze et al. 2025; Source Data Fig. 1, Ahlmann-Eltze et al. 2025scGPT (Ahlmann-Eltze et al. 2025)Norman double perturbations: expression prediction for held-out double perturbations (Ahlmann-Eltze et al. 2025 Fig. 1a and Extended Data Fig. 2a)Pearson delta (1,000 most highly expressed control genes; mean over held-out perturbations and splits)0.527
Deep-learning-based gene perturbation effect prediction does not yet outperform simple linear baselines; Source Data Fig. 1, Ahlmann-Eltze et al. 2025scFoundation (Ahlmann-Eltze et al. 2025)Norman double perturbations: expression prediction for held-out double perturbations (Ahlmann-Eltze et al. 2025 Fig. 1a and Extended Data Fig. 2a)L2 distance (1,000 most highly expressed control genes; mean over held-out perturbations and splits)4.72
Deep-learning-based gene perturbation effect prediction does not yet outperform simple linear baselines; Source Data Fig. 1, Ahlmann-Eltze et al. 2025scGPT (Ahlmann-Eltze et al. 2025)Norman double perturbations: expression prediction for held-out double perturbations (Ahlmann-Eltze et al. 2025 Fig. 1a and Extended Data Fig. 2a)L2 distance (1,000 most highly expressed control genes; mean over held-out perturbations and splits)4.62
Csendes et al. 2025, Supplementary Material 4 (Supplementary Tables 1-3); Benchmarking foundation cell models for post-perturbation RNA-seq predictionscFoundation (Csendes et al. 2025)Adamson et al. 2016 Perturb-seq, K562 CRISPRi single perturbations: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Pearson (raw expression, top 20 DE genes (t-test, GEARS list))0.969
Csendes et al. 2025, Supplementary Material 4 (Supplementary Tables 1-3); Benchmarking foundation cell models for post-perturbation RNA-seq predictionscFoundation (Csendes et al. 2025)Adamson et al. 2016 Perturb-seq, K562 CRISPRi single perturbations: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Pearson delta0.552
Csendes et al. 2025, Supplementary Material 4 (Supplementary Tables 1-3); Benchmarking foundation cell models for post-perturbation RNA-seq predictionscFoundation (Csendes et al. 2025)Adamson et al. 2016 Perturb-seq, K562 CRISPRi single perturbations: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Pearson delta (top 20 DE genes (t-test, GEARS list))0.719
Csendes et al. 2025, Supplementary Material 4 (Supplementary Tables 1-3); Benchmarking foundation cell models for post-perturbation RNA-seq predictionscFoundation (Csendes et al. 2025)Adamson et al. 2016 Perturb-seq, K562 CRISPRi single perturbations: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Pearson delta (top 20 DE genes (t-test) excluding the CRISPR target gene(s))0.78
Csendes et al. 2025, Supplementary Material 4 (Supplementary Tables 1-3); Benchmarking foundation cell models for post-perturbation RNA-seq predictionscGPT (Csendes et al. 2025)Adamson et al. 2016 Perturb-seq, K562 CRISPRi single perturbations: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Pearson (raw expression, top 20 DE genes (t-test, GEARS list))0.979
Csendes et al. 2025, Supplementary Material 4 (Supplementary Tables 1-3); Benchmarking foundation cell models for post-perturbation RNA-seq predictionscGPT (Csendes et al. 2025)Adamson et al. 2016 Perturb-seq, K562 CRISPRi single perturbations: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Pearson delta0.641
Csendes et al. 2025, Supplementary Material 4 (Supplementary Tables 1-3); Benchmarking foundation cell models for post-perturbation RNA-seq predictionscGPT (Csendes et al. 2025)Adamson et al. 2016 Perturb-seq, K562 CRISPRi single perturbations: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Pearson delta (top 20 DE genes (t-test, GEARS list))0.797
Csendes et al. 2025, Supplementary Material 4 (Supplementary Tables 1-3); Benchmarking foundation cell models for post-perturbation RNA-seq predictionscGPT (Csendes et al. 2025)Adamson et al. 2016 Perturb-seq, K562 CRISPRi single perturbations: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Pearson delta (top 20 DE genes (t-test) excluding the CRISPR target gene(s))0.795
Csendes et al. 2025, Supplementary Material 4 (Supplementary Tables 1-3); Benchmarking foundation cell models for post-perturbation RNA-seq predictionscFoundation (Csendes et al. 2025)Norman et al. 2019 Perturb-seq, K562 CRISPRa single and double perturbations: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Pearson (raw expression, pseudo-bulk, all genes)0.966
Csendes et al. 2025, Supplementary Material 4 (Supplementary Tables 1-3); Benchmarking foundation cell models for post-perturbation RNA-seq predictionscFoundation (Csendes et al. 2025)Norman et al. 2019 Perturb-seq, K562 CRISPRa single and double perturbations: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Pearson (raw expression, top 20 DE genes (t-test, GEARS list))0.924
Csendes et al. 2025, Supplementary Material 4 (Supplementary Tables 1-3); Benchmarking foundation cell models for post-perturbation RNA-seq predictionscFoundation (Csendes et al. 2025)Norman et al. 2019 Perturb-seq, K562 CRISPRa single and double perturbations: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Pearson delta0.459
Csendes et al. 2025, Supplementary Material 4 (Supplementary Tables 1-3); Benchmarking foundation cell models for post-perturbation RNA-seq predictionscFoundation (Csendes et al. 2025)Norman et al. 2019 Perturb-seq, K562 CRISPRa single and double perturbations: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Pearson delta (top 20 DE genes (t-test, GEARS list))0.705
Csendes et al. 2025, Supplementary Material 4 (Supplementary Tables 1-3); Benchmarking foundation cell models for post-perturbation RNA-seq predictionscFoundation (Csendes et al. 2025)Norman et al. 2019 Perturb-seq, K562 CRISPRa single and double perturbations: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Pearson delta (top 20 DE genes (t-test) excluding the CRISPR target gene(s))0.71
Csendes et al. 2025, Supplementary Material 4 (Supplementary Tables 1-3); Benchmarking foundation cell models for post-perturbation RNA-seq predictionscGPT (Csendes et al. 2025)Norman et al. 2019 Perturb-seq, K562 CRISPRa single and double perturbations: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Pearson (raw expression, pseudo-bulk, all genes)0.988
Csendes et al. 2025, Supplementary Material 4 (Supplementary Tables 1-3); Benchmarking foundation cell models for post-perturbation RNA-seq predictionscGPT (Csendes et al. 2025)Norman et al. 2019 Perturb-seq, K562 CRISPRa single and double perturbations: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Pearson (raw expression, top 20 DE genes (t-test, GEARS list))0.935
Csendes et al. 2025, Supplementary Material 4 (Supplementary Tables 1-3); Benchmarking foundation cell models for post-perturbation RNA-seq predictionscGPT (Csendes et al. 2025)Norman et al. 2019 Perturb-seq, K562 CRISPRa single and double perturbations: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Pearson delta0.554
Csendes et al. 2025, Supplementary Material 4 (Supplementary Tables 1-3); Benchmarking foundation cell models for post-perturbation RNA-seq predictionscGPT (Csendes et al. 2025)Norman et al. 2019 Perturb-seq, K562 CRISPRa single and double perturbations: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Pearson delta (top 20 DE genes (t-test, GEARS list))0.732
Csendes et al. 2025, Supplementary Material 4 (Supplementary Tables 1-3); Benchmarking foundation cell models for post-perturbation RNA-seq predictionscGPT (Csendes et al. 2025)Norman et al. 2019 Perturb-seq, K562 CRISPRa single and double perturbations: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Pearson delta (top 20 DE genes (t-test) excluding the CRISPR target gene(s))0.7
Csendes et al. 2025, Supplementary Material 4 (Supplementary Tables 1-3); Benchmarking foundation cell models for post-perturbation RNA-seq predictionscFoundation (Csendes et al. 2025)Replogle et al. 2022 genome-wide Perturb-seq subset, K562 CRISPRi: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Pearson delta0.269
Csendes et al. 2025, Supplementary Material 4 (Supplementary Tables 1-3); Benchmarking foundation cell models for post-perturbation RNA-seq predictionscFoundation (Csendes et al. 2025)Replogle et al. 2022 genome-wide Perturb-seq subset, K562 CRISPRi: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Pearson delta (top 20 DE genes (t-test, GEARS list))0.383
Csendes et al. 2025, Supplementary Material 4 (Supplementary Tables 1-3); Benchmarking foundation cell models for post-perturbation RNA-seq predictionscFoundation (Csendes et al. 2025)Replogle et al. 2022 genome-wide Perturb-seq subset, K562 CRISPRi: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Pearson delta (top 20 DE genes (t-test) excluding the CRISPR target gene(s))0.394
Csendes et al. 2025, Supplementary Material 4 (Supplementary Tables 1-3); Benchmarking foundation cell models for post-perturbation RNA-seq predictionscGPT (Csendes et al. 2025)Replogle et al. 2022 genome-wide Perturb-seq subset, K562 CRISPRi: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Pearson delta0.327
Csendes et al. 2025, Supplementary Material 4 (Supplementary Tables 1-3); Benchmarking foundation cell models for post-perturbation RNA-seq predictionscGPT (Csendes et al. 2025)Replogle et al. 2022 genome-wide Perturb-seq subset, K562 CRISPRi: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Pearson delta (top 20 DE genes (t-test, GEARS list))0.481
Csendes et al. 2025, Supplementary Material 4 (Supplementary Tables 1-3); Benchmarking foundation cell models for post-perturbation RNA-seq predictionscGPT (Csendes et al. 2025)Replogle et al. 2022 genome-wide Perturb-seq subset, K562 CRISPRi: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Pearson delta (top 20 DE genes (t-test) excluding the CRISPR target gene(s))0.442
Csendes et al. 2025, Supplementary Material 4 (Supplementary Tables 1-3); Benchmarking foundation cell models for post-perturbation RNA-seq predictionscFoundation (Csendes et al. 2025)Replogle et al. 2022 genome-wide Perturb-seq subset, RPE1 CRISPRi: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Pearson (raw expression, top 20 DE genes (t-test, GEARS list))0.912
Csendes et al. 2025, Supplementary Material 4 (Supplementary Tables 1-3); Benchmarking foundation cell models for post-perturbation RNA-seq predictionscFoundation (Csendes et al. 2025)Replogle et al. 2022 genome-wide Perturb-seq subset, RPE1 CRISPRi: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Pearson delta0.471
Csendes et al. 2025, Supplementary Material 4 (Supplementary Tables 1-3); Benchmarking foundation cell models for post-perturbation RNA-seq predictionscFoundation (Csendes et al. 2025)Replogle et al. 2022 genome-wide Perturb-seq subset, RPE1 CRISPRi: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Pearson delta (top 20 DE genes (t-test, GEARS list))0.495
Csendes et al. 2025, Supplementary Material 4 (Supplementary Tables 1-3); Benchmarking foundation cell models for post-perturbation RNA-seq predictionscFoundation (Csendes et al. 2025)Replogle et al. 2022 genome-wide Perturb-seq subset, RPE1 CRISPRi: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Pearson delta (top 20 DE genes (t-test) excluding the CRISPR target gene(s))0.49
Csendes et al. 2025, Supplementary Material 4 (Supplementary Tables 1-3); Benchmarking foundation cell models for post-perturbation RNA-seq predictionscGPT (Csendes et al. 2025)Replogle et al. 2022 genome-wide Perturb-seq subset, RPE1 CRISPRi: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Pearson (raw expression, top 20 DE genes (t-test, GEARS list))0.924
Csendes et al. 2025, Supplementary Material 4 (Supplementary Tables 1-3); Benchmarking foundation cell models for post-perturbation RNA-seq predictionscGPT (Csendes et al. 2025)Replogle et al. 2022 genome-wide Perturb-seq subset, RPE1 CRISPRi: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Pearson delta0.596
Csendes et al. 2025, Supplementary Material 4 (Supplementary Tables 1-3); Benchmarking foundation cell models for post-perturbation RNA-seq predictionscGPT (Csendes et al. 2025)Replogle et al. 2022 genome-wide Perturb-seq subset, RPE1 CRISPRi: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Pearson delta (top 20 DE genes (t-test, GEARS list))0.652
Csendes et al. 2025, Supplementary Material 4 (Supplementary Tables 1-3); Benchmarking foundation cell models for post-perturbation RNA-seq predictionscGPT (Csendes et al. 2025)Replogle et al. 2022 genome-wide Perturb-seq subset, RPE1 CRISPRi: unseen-perturbation expression prediction (Csendes et al. 2025 Supplementary Table 2)Pearson delta (top 20 DE genes (t-test) excluding the CRISPR target gene(s))0.629

Follow-up

Current state: Not yet reviewed.

No one has reviewed this finding yet.

How to help resolve this

If you know why these studies disagree, for example a different population, metric or preprocessing step, or you have a corrected value, tell us through the contribution form. A reviewer checks every submission against its source before anything changes, and the step is added to the follow-up above.

Finding discrepancy-ba3676cdb7c7c320 · All contested results · How findings are made and followed up