Where one study disagrees with what other studies report for the same models, and what we are doing to resolve each case.
These are automatic leads, not findings of error. Each release, a check compares how every study ranks the models it shares with other studies. It flags a study that reverses the order the others agree on, or whose gap to a shared reference model lies well outside theirs. Different tasks, populations or metrics often explain a flag.
A flag never hides a result. Flagged results stay in every table, page and download, marked Contested. A result is withheld only when a reviewer marks it disputed.
Deep-learning-based gene perturbation effect prediction does not yet outperform simple linear baselines ranks Geneformer above scFoundation in 2 of 2 comparisons; 2 of 2 other studies rank scFoundation above Geneformer.
2 papers rank scFoundation above Geneformer in 13 of their 16 comparisons and Geneformer higher in 3. Deep-learning-based gene perturbation… ranks Geneformer above scFoundation in all 2 of its comparisons.
Csendes et al. 2025, Supplementary Material 4 (Supplementary Tables 1-3) ranks scGPT above scFoundation in 15 of 16 comparisons; 2 of 2 other studies rank scFoundation above scGPT.
3 papers rank scFoundation above scGPT in 18 of their 25 comparisons and scGPT higher in 5; 2 are ties. Csendes et al. 2025 ranks scGPT above scFoundation in 15 of its 20 comparisons and scFoundation higher in 1; 4 are ties.
Kedzierska et al. 2025, Additional file 1 (Supplementary Tables S1-S7, xlsx) ranks scGPT above Geneformer in 83 of 89 comparisons; 2 of 2 other studies rank Geneformer above scGPT.
4 papers rank Geneformer above scGPT in 10 of their 19 comparisons and scGPT higher in 5; 4 are ties. Of those papers, Parameter-Efficient Fine-Tuning… ranks scGPT higher on its own (1 of 1). Kedzierska et al. 2025 ranks scGPT above Geneformer in 83 of its 97 comparisons and Geneformer higher in 6; 8 are ties.
Deep-learning-based gene perturbation effect prediction does not yet outperform simple linear baselines ranks Geneformer above UCE (Universal Cell Embeddings) in 2 of 2 comparisons; Wu et al. 2025, Additional file 3 (Supplementary Tables S1-S13) ranks UCE (Universal Cell Embeddings) above Geneformer in 3 of 3 comparisons. No other study gives a verdict, so neither is the outlier.
3 papers rank Geneformer above UCE (Universal Cell Embeddings) in 6 of their 18 comparisons and UCE (Universal Cell Embeddings) higher in 9; 3 are ties. Of those papers, Wu et al. 2025 ranks UCE (Universal Cell Embeddings) higher on its own (3 of 4).