Beyond Expression Prediction: Benchmarking Differential Expression Classification in Single-Cell Perturbation Models
bioRxiv preprint version 1, posted 2026-07-24 · Preprint
What this source contributed
Records in this release that cite this source. A record can cite several sources.
Results
Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.
Claims
Statements this source supports, each with where in the source it was checked.
- Relevance of Held-out cell line to "Assess models for genetic perturbation experiments": Assessed by Sun et al. 2026 cellular-context DE classification (cross cell line) (lit-cells-networks-20261011-sun2026de-source-sun2026: Tables 3-4; Sections 2.2 and 3.1-3.3)
- Relevance of Unseen perturbations within a cell line to "Assess models for genetic perturbation experiments": Assessed by Sun et al. 2026 unseen-perturbation DE classification (within cell line) (lit-cells-networks-20261011-sun2026de-source-sun2026: Tables 1-2; Sections 2.1 and 3.1-3.3)
- True DE prevalence, Average, cross-cell-line test set (Table 3): True de prevalence 3.31% (Table 3, row 'True DE prevalence', column 'Average')
- True DE prevalence, Average, within-cell-line test set (Table 1): True de prevalence 2.90% (Table 1, row 'True DE prevalence', column 'Average')
- True DE prevalence, HepG2, cross-cell-line test set (Table 3): True de prevalence 2.70% (Table 3, row 'True DE prevalence', column 'HepG2')
- True DE prevalence, HepG2, within-cell-line test set (Table 1): True de prevalence 2.36% (Table 1, row 'True DE prevalence', column 'HepG2')
- True DE prevalence, Jurkat, cross-cell-line test set (Table 3): True de prevalence 2.09% (Table 3, row 'True DE prevalence', column 'Jurkat')
- True DE prevalence, Jurkat, within-cell-line test set (Table 1): True de prevalence 1.75% (Table 1, row 'True DE prevalence', column 'Jurkat')
- True DE prevalence, K562, cross-cell-line test set (Table 3): True de prevalence 4.03% (Table 3, row 'True DE prevalence', column 'K562')
- True DE prevalence, K562, within-cell-line test set (Table 1): True de prevalence 3.54% (Table 1, row 'True DE prevalence', column 'K562')
- True DE prevalence, RPE1, cross-cell-line test set (Table 3): True de prevalence 4.41% (Table 3, row 'True DE prevalence', column 'RPE1')
- True DE prevalence, RPE1, within-cell-line test set (Table 1): True de prevalence 3.94% (Table 1, row 'True DE prevalence', column 'RPE1')
Models, benchmarks and other records
Configurations (10)
- 1-NN on GenePT embeddings (Sun et al. 2026)
- Per-gene L2 logistic regression on GenePT embeddings (Sun et al. 2026)
- Perturbation majority vote (Sun et al. 2026)
- Scouter (Sun et al. 2026)
- scVI perturbation model, mean output (Sun et al. 2026)
- scVI perturbation model, sampled output (Sun et al. 2026)
- STATE (few-shot cross-cell-line) (Sun et al. 2026)
- TranScouter (Sun et al. 2026)
- VAE adapted from scGen (Sun et al. 2026)
- Weighted 10-NN on GenePT embeddings (Sun et al. 2026)
Benchmarks (1)
Protocols (2)
Dataset subsets (5)
- HepG2 essential-gene Perturb-seq, 40% test perturbations (Sun et al. 2026)
- Jurkat essential-gene Perturb-seq, 40% test perturbations (Sun et al. 2026)
- K562 essential-gene Perturb-seq, 40% test perturbations (Sun et al. 2026)
- K562, RPE1, HepG2 and Jurkat test sets (Sun et al. 2026)
- RPE1 essential-gene Perturb-seq, 40% test perturbations (Sun et al. 2026)
Evaluations (85)
- 1-NN on Sun et al. 2026 cross-cell-line DE classification, four cell lines
- 1-NN on Sun et al. 2026 cross-cell-line DE classification, HepG2
- 1-NN on Sun et al. 2026 cross-cell-line DE classification, Jurkat
- 1-NN on Sun et al. 2026 cross-cell-line DE classification, K562
- 1-NN on Sun et al. 2026 cross-cell-line DE classification, RPE1
- 1-NN on Sun et al. 2026 within-cell-line DE classification, four cell lines
- 1-NN on Sun et al. 2026 within-cell-line DE classification, HepG2
- 1-NN on Sun et al. 2026 within-cell-line DE classification, Jurkat
- 1-NN on Sun et al. 2026 within-cell-line DE classification, K562
- 1-NN on Sun et al. 2026 within-cell-line DE classification, RPE1
- 10-NN on Sun et al. 2026 cross-cell-line DE classification, four cell lines
- 10-NN on Sun et al. 2026 cross-cell-line DE classification, HepG2
- 10-NN on Sun et al. 2026 cross-cell-line DE classification, Jurkat
- 10-NN on Sun et al. 2026 cross-cell-line DE classification, K562
- 10-NN on Sun et al. 2026 cross-cell-line DE classification, RPE1
- 10-NN on Sun et al. 2026 within-cell-line DE classification, four cell lines
- 10-NN on Sun et al. 2026 within-cell-line DE classification, HepG2
- 10-NN on Sun et al. 2026 within-cell-line DE classification, Jurkat
- 10-NN on Sun et al. 2026 within-cell-line DE classification, K562
- 10-NN on Sun et al. 2026 within-cell-line DE classification, RPE1
- Logistic regression on Sun et al. 2026 cross-cell-line DE classification, four cell lines
- Logistic regression on Sun et al. 2026 cross-cell-line DE classification, HepG2
- Logistic regression on Sun et al. 2026 cross-cell-line DE classification, Jurkat
- Logistic regression on Sun et al. 2026 cross-cell-line DE classification, K562
- Logistic regression on Sun et al. 2026 cross-cell-line DE classification, RPE1
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
25 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| Artifact SHA-256 fa1c6a6345c45e14b9c373dfa8aff12633ae646feece1cfa3899c3ed61f6cfdf Source metadata | Beyond Expression Prediction: Benchmarking Differential Expression Classification in Single-Cell Perturbation Models No field-specific location recorded Version: bioRxiv preprint version 1, posted 2026-07-24 | catalogued No individual claim review recorded Source has a recorded evidence concern. Consult its source page before using the claim. Audit detailsField: Source artifact SHA-256: Hash scope: Exact bytes of one download; bioRxiv serves slightly different PDF bytes per download, so the gzip copy in artifacts/ is the reference. |
| Artifact url https://www.biorxiv.org/content/10.64898/2026.07.20.739620v1.full.pdf Source metadata | Beyond Expression Prediction: Benchmarking Differential Expression Classification in Single-Cell Perturbation Models No field-specific location recorded Version: bioRxiv preprint version 1, posted 2026-07-24 | catalogued No individual claim review recorded Source has a recorded evidence concern. Consult its source page before using the claim. Audit detailsField: Source artifact SHA-256: Hash scope: Exact bytes of one download; bioRxiv serves slightly different PDF bytes per download, so the gzip copy in artifacts/ is the reference. |
| Doi 10.64898/2026.07.20.739620 Source metadata | Beyond Expression Prediction: Benchmarking Differential Expression Classification in Single-Cell Perturbation Models No field-specific location recorded Version: bioRxiv preprint version 1, posted 2026-07-24 | catalogued No individual claim review recorded Source has a recorded evidence concern. Consult its source page before using the claim. Audit detailsField: Source artifact SHA-256: Hash scope: Exact bytes of one download; bioRxiv serves slightly different PDF bytes per download, so the gzip copy in artifacts/ is the reference. |
Evidence concerns1 values
| Beyond Expression Prediction: Benchmarking Differential Expression Classification in Single-Cell Perturbation Models No field-specific location recorded Version: bioRxiv preprint version 1, posted 2026-07-24 | catalogued No individual claim review recorded Source has a recorded evidence concern. Consult its source page before using the claim. Audit detailsField: Source artifact SHA-256: Hash scope: Exact bytes of one download; bioRxiv serves slightly different PDF bytes per download, so the gzip copy in artifacts/ is the reference. |
| Hash scope Exact bytes of one download; bioRxiv serves slightly different PDF bytes per download, so the gzip copy in artifacts/ is the reference. Source metadata | Beyond Expression Prediction: Benchmarking Differential Expression Classification in Single-Cell Perturbation Models No field-specific location recorded Version: bioRxiv preprint version 1, posted 2026-07-24 | catalogued No individual claim review recorded Source has a recorded evidence concern. Consult its source page before using the claim. Audit detailsField: Source artifact SHA-256: Hash scope: Exact bytes of one download; bioRxiv serves slightly different PDF bytes per download, so the gzip copy in artifacts/ is the reference. |
| Licence CC-BY-4.0 Source metadata | Beyond Expression Prediction: Benchmarking Differential Expression Classification in Single-Cell Perturbation Models No field-specific location recorded Version: bioRxiv preprint version 1, posted 2026-07-24 | catalogued No individual claim review recorded Source has a recorded evidence concern. Consult its source page before using the claim. Audit detailsField: Source artifact SHA-256: Hash scope: Exact bytes of one download; bioRxiv serves slightly different PDF bytes per download, so the gzip copy in artifacts/ is the reference. |
Limitations3 values
| Beyond Expression Prediction: Benchmarking Differential Expression Classification in Single-Cell Perturbation Models No field-specific location recorded Version: bioRxiv preprint version 1, posted 2026-07-24 | catalogued No individual claim review recorded Source has a recorded evidence concern. Consult its source page before using the claim. Audit detailsField: Source artifact SHA-256: Hash scope: Exact bytes of one download; bioRxiv serves slightly different PDF bytes per download, so the gzip copy in artifacts/ is the reference. |
| Media type application/pdf Source metadata | Beyond Expression Prediction: Benchmarking Differential Expression Classification in Single-Cell Perturbation Models No field-specific location recorded Version: bioRxiv preprint version 1, posted 2026-07-24 | catalogued No individual claim review recorded Source has a recorded evidence concern. Consult its source page before using the claim. Audit detailsField: Source artifact SHA-256: Hash scope: Exact bytes of one download; bioRxiv serves slightly different PDF bytes per download, so the gzip copy in artifacts/ is the reference. |
| Publication status preprint Source metadata | Beyond Expression Prediction: Benchmarking Differential Expression Classification in Single-Cell Perturbation Models No field-specific location recorded Version: bioRxiv preprint version 1, posted 2026-07-24 | catalogued No individual claim review recorded Source has a recorded evidence concern. Consult its source page before using the claim. Audit detailsField: Source artifact SHA-256: Hash scope: Exact bytes of one download; bioRxiv serves slightly different PDF bytes per download, so the gzip copy in artifacts/ is the reference. |
| Retrieved at 2026-10-11T21:35:10Z Source metadata | Beyond Expression Prediction: Benchmarking Differential Expression Classification in Single-Cell Perturbation Models No field-specific location recorded Version: bioRxiv preprint version 1, posted 2026-07-24 | catalogued No individual claim review recorded Source has a recorded evidence concern. Consult its source page before using the claim. Audit detailsField: Source artifact SHA-256: Hash scope: Exact bytes of one download; bioRxiv serves slightly different PDF bytes per download, so the gzip copy in artifacts/ is the reference. |
Sources and history
Release 2026-10-23-5347695500ed · Record review: source checked
bioRxiv PDF, retrieved and hashed for the 2026-10-11 cells-spatial literature pass.
Technical metadata and extraction receipts
Stable ID: lit-cells-networks-20261011-sun2026de-source-sun2026
- areas
- single-cell
- contexts
- research
- url
- https://doi.org/10.64898/2026.07.20.739620
- artifact url
- https://www.biorxiv.org/content/10.64898/2026.07.20.739620v1.full.pdf
- version
- bioRxiv preprint version 1, posted 2026-07-24
- retrieved at
- 2026-10-11T21:35:10Z
- artifact sha256
- fa1c6a6345c45e14b9c373dfa8aff12633ae646feece1cfa3899c3ed61f6cfdf
- doi
- 10.64898/2026.07.20.739620
- publication status
- preprint
- licence
- CC-BY-4.0
- media type
- application/pdf
- hash scope
- Exact bytes of one download; bioRxiv serves slightly different PDF bytes per download, so the gzip copy in artifacts/ is the reference.
- limitations
- Preprint, not peer reviewed.; Single train/test split (60/40 by perturbation); no spread printed in Tables 1-4.; The authors did not develop scVI, scGen or STATE. Co-author Ouyang Zhu developed Scouter and TranScouter (references 14 and 31), and co-author Yiqun T. Chen developed the GenePT embeddings used by the KNN, logistic-regression, VAE and scVI configurations (reference 30). The majority vote, KNN and logistic regression baselines and the scGen-based VAE adaptation are the authors' own.
- evidence concerns
- source id: lit-cells-networks-20261011-sun2026de-source-sun2026; message: Methods describe results on both the full data and a PerturbQA-downsampled subset ('We annotate our results to distinguish between these two settings'), but the captions of Tables 1-4 do not say which setting they report. The printed true DE prevalence (1.75-4.41%) matches the full data's 95-98% non-DE share (Table 5), not the downsampled set; this is an inference, not a printed statement.; source locator: Section 3.2 'Full vs. Curated Dataset'; Tables 1-5; artifact sha256: fa1c6a6345c45e14b9c373dfa8aff12633ae646feece1cfa3899c3ed61f6cfdf; review date: 2026-10-11
- review
- method: source-hash-verification; method note: Archived gzip copy unpacked and its SHA-256 matched; a fresh bioRxiv download was rate-limited (HTTP 429).; reviewer: claude; reviewer note: Claude review agent reviewer-cn-1, independent of the extractor lit-cells-networks; no human review claimed; date: 2026-10-12