Relevance of Adamson K562 Perturb-seq to "Assess models for genetic perturbation experiments"
- Use case
- Assess models for genetic perturbation experiments
- Assessed by
- Chen et al. 2026 genetic perturbation prediction, Adamson
- Relevance
- Proxy evidence
- Endpoint
- MSE, Pearson and Pearson delta (all genes and DE genes) of predicted post-perturbation expression on Adamson K562 Perturb-seq for CellPLM, scGPT-spatial, GenePT-w and scELMo with a shared GEARS decoder
Compares foundation-model representations as inputs to the same GEARS perturbation decoder on held-out perturbations. Proxy and narrow: no no-change, mean or linear control is reported, which the use case asks for, and the endpoint is expression agreement only.
4 reviewed evaluations
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
19 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
Citation locations1 values
| Harmonised benchmarking of foundation models for single-cell and spatial transcriptomics reveals context-dependent generalisation lit-cells-networks-20261011-chen2026-source-chen2026: Table 5; Results 'Perturbation prediction separates expression reconstruction from functional response modelling' Version: arXiv 2607.17227v2, updated 2026-09-17 (v1 posted 2026-07-19) | not individually reviewed No individual claim review recorded Source has a recorded evidence concern. Consult its source page before using the claim. Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Comparison group chen2026-harmonised-fm Context-only references | Harmonised benchmarking of foundation models for single-cell and spatial transcriptomics reveals context-dependent generalisation lit-cells-networks-20261011-chen2026-source-chen2026: Table 5; Results 'Perturbation prediction separates expression reconstruction from functional response modelling' Version: arXiv 2607.17227v2, updated 2026-09-17 (v1 posted 2026-07-19) | not individually reviewed No individual claim review recorded Source has a recorded evidence concern. Consult its source page before using the claim. Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Comparison title Harmonised single-cell and spatial foundation model benchmark (Chen et al. 2026) Context-only references | Harmonised benchmarking of foundation models for single-cell and spatial transcriptomics reveals context-dependent generalisation lit-cells-networks-20261011-chen2026-source-chen2026: Table 5; Results 'Perturbation prediction separates expression reconstruction from functional response modelling' Version: arXiv 2607.17227v2, updated 2026-09-17 (v1 posted 2026-07-19) | not individually reviewed No individual claim review recorded Source has a recorded evidence concern. Consult its source page before using the claim. Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Constraints3 values
| Harmonised benchmarking of foundation models for single-cell and spatial transcriptomics reveals context-dependent generalisation lit-cells-networks-20261011-chen2026-source-chen2026: Table 5; Results 'Perturbation prediction separates expression reconstruction from functional response modelling' Version: arXiv 2607.17227v2, updated 2026-09-17 (v1 posted 2026-07-19) | not individually reviewed No individual claim review recorded Source has a recorded evidence concern. Consult its source page before using the claim. Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Endpoint MSE, Pearson and Pearson delta (all genes and DE genes) of predicted post-perturbation expression on Adamson K562 Perturb-seq for CellPLM, scGPT-spatial, GenePT-w and scELMo with a shared GEARS decoder Context-only references | Harmonised benchmarking of foundation models for single-cell and spatial transcriptomics reveals context-dependent generalisation lit-cells-networks-20261011-chen2026-source-chen2026: Table 5; Results 'Perturbation prediction separates expression reconstruction from functional response modelling' Version: arXiv 2607.17227v2, updated 2026-09-17 (v1 posted 2026-07-19) | not individually reviewed No individual claim review recorded Source has a recorded evidence concern. Consult its source page before using the claim. Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Claimed field links:assessed_by:lit-cells-networks-20261011-chen2026-protocol-perturbation-adamson Context-only references | Harmonised benchmarking of foundation models for single-cell and spatial transcriptomics reveals context-dependent generalisation lit-cells-networks-20261011-chen2026-source-chen2026: Table 5; Results 'Perturbation prediction separates expression reconstruction from functional response modelling' Version: arXiv 2607.17227v2, updated 2026-09-17 (v1 posted 2026-07-19) | not individually reviewed No individual claim review recorded Source has a recorded evidence concern. Consult its source page before using the claim. Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Headline metric pearson-delta Context-only references | Harmonised benchmarking of foundation models for single-cell and spatial transcriptomics reveals context-dependent generalisation lit-cells-networks-20261011-chen2026-source-chen2026: Table 5; Results 'Perturbation prediction separates expression reconstruction from functional response modelling' Version: arXiv 2607.17227v2, updated 2026-09-17 (v1 posted 2026-07-19) | not individually reviewed No individual claim review recorded Source has a recorded evidence concern. Consult its source page before using the claim. Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Limitations3 values
| Harmonised benchmarking of foundation models for single-cell and spatial transcriptomics reveals context-dependent generalisation lit-cells-networks-20261011-chen2026-source-chen2026: Table 5; Results 'Perturbation prediction separates expression reconstruction from functional response modelling' Version: arXiv 2607.17227v2, updated 2026-09-17 (v1 posted 2026-07-19) | not individually reviewed No individual claim review recorded Source has a recorded evidence concern. Consult its source page before using the claim. Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Pinned records31 values
| Harmonised benchmarking of foundation models for single-cell and spatial transcriptomics reveals context-dependent generalisation lit-cells-networks-20261011-chen2026-source-chen2026: Table 5; Results 'Perturbation prediction separates expression reconstruction from functional response modelling' Version: arXiv 2607.17227v2, updated 2026-09-17 (v1 posted 2026-07-19) | not individually reviewed No individual claim review recorded Source has a recorded evidence concern. Consult its source page before using the claim. Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Rationale Compares foundation-model representations as inputs to the same GEARS perturbation decoder on held-out perturbations. Proxy and narrow: no no-change, mean or linear control is reported, which the use case asks for, and the endpoint is expression agreement only. Context-only references | Harmonised benchmarking of foundation models for single-cell and spatial transcriptomics reveals context-dependent generalisation lit-cells-networks-20261011-chen2026-source-chen2026: Table 5; Results 'Perturbation prediction separates expression reconstruction from functional response modelling' Version: arXiv 2607.17227v2, updated 2026-09-17 (v1 posted 2026-07-19) | not individually reviewed No individual claim review recorded Source has a recorded evidence concern. Consult its source page before using the claim. Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Sources and history
Release 2026-10-23-5347695500ed · Record review: source checked
1 source record and release history
- Harmonised benchmarking of foundation models for single-cell and spatial transcriptomics reveals context-dependent generalisation · Original source · arXiv 2607.17227v2, updated 2026-09-17 (v1 posted 2026-07-19)
Technical metadata and extraction receipts
Stable ID: use-case-mapping-lit-cells-networks-20261011-chen2026-perturbation-adamson
- field
- links:assessed_by:lit-cells-networks-20261011-chen2026-protocol-perturbation-adamson
- value
- lit-cells-networks-20261011-chen2026-protocol-perturbation-adamson
- relevance
- proxy
- endpoint
- MSE, Pearson and Pearson delta (all genes and DE genes) of predicted post-perturbation expression on Adamson K562 Perturb-seq for CellPLM, scGPT-spatial, GenePT-w and scELMo with a shared GEARS decoder
- rationale
- Compares foundation-model representations as inputs to the same GEARS perturbation decoder on held-out perturbations. Proxy and narrow: no no-change, mean or linear control is reported, which the use case asks for, and the endpoint is expression agreement only.
- constraints
- Inspect every linked evaluation's source locator before citing a result.; Do not compare with other sources' Norman, Adamson or Replogle results; gene sets and splits differ.; Use Pearson Delta and the DE-gene metrics; global Pearson is about 0.98-0.99 for every model (Results).
- limitations
- Preprint; single run with seed 42 and no spread, so small differences are not testable.; The authors did not develop any of the six models (independent comparison), but no conventional baseline is in the tables.; DE metrics use the top 20 differentially expressed genes per perturbation condition (Methods); the DE gene sets are not printed.
- citation locators
- source id: lit-cells-networks-20261011-chen2026-source-chen2026; locator: Table 5; Results 'Perturbation prediction separates expression reconstruction from functional response modelling'
- source locator
- lit-cells-networks-20261011-chen2026-source-chen2026: Table 5; Results 'Perturbation prediction separates expression reconstruction from functional response modelling'
- headline metric
- pearson-delta
- comparison group
- chen2026-harmonised-fm
- comparison title
- Harmonised single-cell and spatial foundation model benchmark (Chen et al. 2026)
- stratum label
- Adamson K562 Perturb-seq
- stratum order
- 2
- reviewed evaluations
- lit-cells-networks-20261011-chen2026-eval-perturbation-adamson-cellplm; lit-cells-networks-20261011-chen2026-eval-perturbation-adamson-genept-w; lit-cells-networks-20261011-chen2026-eval-perturbation-adamson-scelmo; lit-cells-networks-20261011-chen2026-eval-perturbation-adamson-scgpt-spatial
- reason
- Add a relevance judgement for a protocol from the 2026-10-11 cells-spatial and networks-mechanistic literature pass, reviewed in docs/reviews/2026-10-12-cells-networks-batches.md.
- review
- method: ai-assisted-source-review; scope-review; method note: Reviewer checked the endpoint against the use case's inputs, output and exclusions, the relevance rating and the limitations; every evaluation on the protocol had its values checked in the batch review. Corrections listed in review.md were applied by the extractor.; reviewer: claude; reviewer note: Claude review agent reviewer-cn-2, independent of the extractor lit-cells-networks; no human review claimed; reviewed at: 2026-10-12T08:44:00Z; note: Automated review; not human scientific review.
- pins
- record id: lit-cells-networks-20261011-chen2026-eval-perturbation-adamson-cellplm; fields: status; links; attributes.origin; attributes.comparison; sha256: 6dd5b81483c603d946fddac8b3b90dba28396768752539fe1d8d495c3c9dee28; record id: lit-cells-networks-20261011-chen2026-eval-perturbation-adamson-genept-w; fields: status; links; attributes.origin; attributes.comparison; sha256: 21ada4c0179e4ee6ff4a56091a51277b6608007306e3d1502465cfd62bd3ddd8; record id: lit-cells-networks-20261011-chen2026-eval-perturbation-adamson-scelmo; fields: status; links; attributes.origin; attributes.comparison; sha256: 34a57c5baffc3e6041a07bd1c4183d86f225cdf8d9adfe8f275b534919505540; record id: lit-cells-networks-20261011-chen2026-eval-perturbation-adamson-scgpt-spatial; fields: status; links; attributes.origin; attributes.comparison; sha256: 3d8aa8d2f23819a264afc2b603e8f291058b153fe7a02b2221c87d630a7c790d; record id: lit-cells-networks-20261011-chen2026-protocol-perturbation-adamson; fields: status; name; description; facets; source_ids; links; attributes; sha256: eb4c9bd9b4f221f759318ba91542d51d7585a327c4331b50350ce0cef78490b0; record id: lit-cells-networks-20261011-chen2026-result-perturbation-adamson-cellplm-mse; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 34b76ab07ba5396cdf56e66a3585cb872ce83b9b0f1b59d0b50d60b5164f9ce7; record id: lit-cells-networks-20261011-chen2026-result-perturbation-adamson-cellplm-mse-de; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: e28dcfa30aaf47187e0bbd00d1621fc41a9fc507d28f118382501f6ba9d509bb; record id: lit-cells-networks-20261011-chen2026-result-perturbation-adamson-cellplm-pearson; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: b674f450468c5868042f02cd5aeaea6e13a886ae514b8a39bf2162ed8ecaa1c4; record id: lit-cells-networks-20261011-chen2026-result-perturbation-adamson-cellplm-pearson-de; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 7e4516274d0da5379aa5641e550f6c4f0e90e8ea33e7e4f6a0c90cd450af532d; record id: lit-cells-networks-20261011-chen2026-result-perturbation-adamson-cellplm-pearson-delta; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 2051cadd8f8e023c887960a53b6c80c1686a4aa2ba0218881bf50f5f45b0f0bc; record id: lit-cells-networks-20261011-chen2026-result-perturbation-adamson-cellplm-pearson-delta-de; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 558152432f6c9181edb9515f56cf2a038dfa0d2d9f16efaeaf494c927caf09a9; record id: lit-cells-networks-20261011-chen2026-result-perturbation-adamson-genept-w-mse; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 595f12bf5f29d3422f4a5a655401d6614724c8fbef2e9aee1b4e5750f75dcd16; record id: lit-cells-networks-20261011-chen2026-result-perturbation-adamson-genept-w-mse-de; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: f49ae3c33529a4c193dac84fdf9457ec169fb3ebd2568bc05578fe200a72e4a9; record id: lit-cells-networks-20261011-chen2026-result-perturbation-adamson-genept-w-pearson; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: af5bb42e86346636e525b9e62d4f51f57e0b5407d9db591bec08f3e976bc1eae; record id: lit-cells-networks-20261011-chen2026-result-perturbation-adamson-genept-w-pearson-de; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: d374e3dadd8b49cc166db645819e155ef0345dee8bda26439fa53a2ad1ee4074; record id: lit-cells-networks-20261011-chen2026-result-perturbation-adamson-genept-w-pearson-delta; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: b1d2989adc77e33be4e2494e564ecd1d7c1104a553066cd1cf60ddd79e7d8859; record id: lit-cells-networks-20261011-chen2026-result-perturbation-adamson-genept-w-pearson-delta-de; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 653997457bcd5e225c6f254eccbf20b19cf254ebac794b174b8bd3b6a5702a3b; record id: lit-cells-networks-20261011-chen2026-result-perturbation-adamson-scelmo-mse; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 7626217033963cb0e65b44717828064077ac2e9c23902104d2cdd407a7626470; record id: lit-cells-networks-20261011-chen2026-result-perturbation-adamson-scelmo-mse-de; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: f9ca1f594f8e2af60c26d4759190d3d2f6d41c646a79803ec6484ddbb9a32ce6; record id: lit-cells-networks-20261011-chen2026-result-perturbation-adamson-scelmo-pearson; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: c24186ad29d85cf7057aec95cf930ce2f1f9dad160e9d32e5aae7ebdffe8431f; record id: lit-cells-networks-20261011-chen2026-result-perturbation-adamson-scelmo-pearson-de; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: d77393304bb2a47944b120a57db90eeda6a2eef9cf38fb7175ecc7ef743293fc; record id: lit-cells-networks-20261011-chen2026-result-perturbation-adamson-scelmo-pearson-delta; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 79f39fd189b16d2a12219ca472f51f4259a6e9f13df25b6c62dc573b7efae693; record id: lit-cells-networks-20261011-chen2026-result-perturbation-adamson-scelmo-pearson-delta-de; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: f10402840b4e32a725843bf7f5ad6cdb5ef2206a0224df4ab8670fe48615eda5; record id: lit-cells-networks-20261011-chen2026-result-perturbation-adamson-scgpt-spatial-mse; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 5c81d01cc5ee6b7f62024e6431ed4810dfe7cf55e832d83e55b3e7352ea30ea3; record id: lit-cells-networks-20261011-chen2026-result-perturbation-adamson-scgpt-spatial-mse-de; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: c5eb6c2e988b1c82ad78ce4abc7b73b13c9e998029556f8d78e6d27c8c834fc9; record id: lit-cells-networks-20261011-chen2026-result-perturbation-adamson-scgpt-spatial-pearson; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 992d72dc7a648915e151965856bb54e4a950983bb07ec61708967ef54c7fa9d0; record id: lit-cells-networks-20261011-chen2026-result-perturbation-adamson-scgpt-spatial-pearson-de; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 348a4071cf829ace602936c907df7352ed38432122efc7115b908b9c8a58a777; record id: lit-cells-networks-20261011-chen2026-result-perturbation-adamson-scgpt-spatial-pearson-delta; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 21ea40e3968d941d026d5383630da6724f52e62cf50214d1b7ec1999e7775e43; record id: lit-cells-networks-20261011-chen2026-result-perturbation-adamson-scgpt-spatial-pearson-delta-de; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: dd82275e34ec6312f6bcc1fd94f7407c43c4e324e8466eadad1632555125d85b; record id: lit-cells-networks-20261011-chen2026-source-chen2026; fields: status; attributes.artifact_sha256; sha256: 0b42f541d5ca376dc4e14f043f2eef02b5f307d7820685e0a1e3ef4a31def2b5; record id: use-case-genetic-perturbation-response; fields: status; name; description; facets; attributes.question; attributes.decision; attributes.inputs; attributes.output; attributes.exclusions; attributes.setting; attributes.clinical_scope; attributes.intended_users; sha256: 440f0f2e30cb7c828212bed728de2420ba8e13521280be58be7bdcdfe57ac973