Evidence claim

Relevance of SEAAD held-out annotation to "Transfer cell-type annotations to a new dataset"

Use case: Transfer cell-type annotations to a new dataset
Assessed by: Chen et al. 2026 supervised cell type annotation, SEAAD
Relevance: Proxy evidence
Endpoint: Accuracy, precision, recall, macro-F1, PR-AUC and ROC-AUC of supervised cell type annotation on a stratified held-out split of SEAAD

Scores foundation models fine-tuned on reference labels and tested on held-out cells of the same dataset. Proxy: the use case transfers labels to a new dataset, while this split keeps train and test cells from the same study and batch structure.

6 reviewed evaluations

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

19 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-10-23-5347695500ed
Property and statement	Original source and location	Review and provenance
Citation locations 1 values source id lit-cells-networks-20261011-chen2026-source-chen2026 locator Table 4; Results on supervised annotation; Methods 'Cell type annotation' Context-only references	Harmonised benchmarking of foundation models for single-cell and spatial transcriptomics reveals context-dependent generalisation Original source ↗ lit-cells-networks-20261011-chen2026-source-chen2026: Table 4; Results on supervised annotation; Methods 'Cell type annotation' Version: arXiv 2607.17227v2, updated 2026-09-17 (v1 posted 2026-07-19) Retrieved: 2026-10-11T21:29:34Z	not individually reviewed No individual claim review recorded Source has a recorded evidence concern. Consult its source page before using the claim. Audit details Field: `attributes.citation_locators` Source artifact SHA-256: `8137338c6146f570a6546f30707d4244baca9dab848b32c51539665a5ba539da` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Comparison group chen2026-harmonised-fm Context-only references	Harmonised benchmarking of foundation models for single-cell and spatial transcriptomics reveals context-dependent generalisation Original source ↗ lit-cells-networks-20261011-chen2026-source-chen2026: Table 4; Results on supervised annotation; Methods 'Cell type annotation' Version: arXiv 2607.17227v2, updated 2026-09-17 (v1 posted 2026-07-19) Retrieved: 2026-10-11T21:29:34Z	not individually reviewed No individual claim review recorded Source has a recorded evidence concern. Consult its source page before using the claim. Audit details Field: `attributes.comparison_group` Source artifact SHA-256: `8137338c6146f570a6546f30707d4244baca9dab848b32c51539665a5ba539da` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Comparison title Harmonised single-cell and spatial foundation model benchmark (Chen et al. 2026) Context-only references	Harmonised benchmarking of foundation models for single-cell and spatial transcriptomics reveals context-dependent generalisation Original source ↗ lit-cells-networks-20261011-chen2026-source-chen2026: Table 4; Results on supervised annotation; Methods 'Cell type annotation' Version: arXiv 2607.17227v2, updated 2026-09-17 (v1 posted 2026-07-19) Retrieved: 2026-10-11T21:29:34Z	not individually reviewed No individual claim review recorded Source has a recorded evidence concern. Consult its source page before using the claim. Audit details Field: `attributes.comparison_title` Source artifact SHA-256: `8137338c6146f570a6546f30707d4244baca9dab848b32c51539665a5ba539da` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Constraints 2 values Inspect every linked evaluation's source locator before citing a result. Prefer macro-F1 and PR-AUC; accuracy and ROC-AUC saturate on ATAA (Results). Context-only references	Harmonised benchmarking of foundation models for single-cell and spatial transcriptomics reveals context-dependent generalisation Original source ↗ lit-cells-networks-20261011-chen2026-source-chen2026: Table 4; Results on supervised annotation; Methods 'Cell type annotation' Version: arXiv 2607.17227v2, updated 2026-09-17 (v1 posted 2026-07-19) Retrieved: 2026-10-11T21:29:34Z	not individually reviewed No individual claim review recorded Source has a recorded evidence concern. Consult its source page before using the claim. Audit details Field: `attributes.constraints` Source artifact SHA-256: `8137338c6146f570a6546f30707d4244baca9dab848b32c51539665a5ba539da` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Endpoint Accuracy, precision, recall, macro-F1, PR-AUC and ROC-AUC of supervised cell type annotation on a stratified held-out split of SEAAD Context-only references	Harmonised benchmarking of foundation models for single-cell and spatial transcriptomics reveals context-dependent generalisation Original source ↗ lit-cells-networks-20261011-chen2026-source-chen2026: Table 4; Results on supervised annotation; Methods 'Cell type annotation' Version: arXiv 2607.17227v2, updated 2026-09-17 (v1 posted 2026-07-19) Retrieved: 2026-10-11T21:29:34Z	not individually reviewed No individual claim review recorded Source has a recorded evidence concern. Consult its source page before using the claim. Audit details Field: `attributes.endpoint` Source artifact SHA-256: `8137338c6146f570a6546f30707d4244baca9dab848b32c51539665a5ba539da` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Claimed field links:assessed_by:lit-cells-networks-20261011-chen2026-protocol-annotation-seaad Context-only references	Harmonised benchmarking of foundation models for single-cell and spatial transcriptomics reveals context-dependent generalisation Original source ↗ lit-cells-networks-20261011-chen2026-source-chen2026: Table 4; Results on supervised annotation; Methods 'Cell type annotation' Version: arXiv 2607.17227v2, updated 2026-09-17 (v1 posted 2026-07-19) Retrieved: 2026-10-11T21:29:34Z	not individually reviewed No individual claim review recorded Source has a recorded evidence concern. Consult its source page before using the claim. Audit details Field: `attributes.field` Source artifact SHA-256: `8137338c6146f570a6546f30707d4244baca9dab848b32c51539665a5ba539da` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Headline metric macro-f1 Context-only references	Harmonised benchmarking of foundation models for single-cell and spatial transcriptomics reveals context-dependent generalisation Original source ↗ lit-cells-networks-20261011-chen2026-source-chen2026: Table 4; Results on supervised annotation; Methods 'Cell type annotation' Version: arXiv 2607.17227v2, updated 2026-09-17 (v1 posted 2026-07-19) Retrieved: 2026-10-11T21:29:34Z	not individually reviewed No individual claim review recorded Source has a recorded evidence concern. Consult its source page before using the claim. Audit details Field: `attributes.headline_metric` Source artifact SHA-256: `8137338c6146f570a6546f30707d4244baca9dab848b32c51539665a5ba539da` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Limitations 6 values Preprint; single run with seed 42 and no spread, so small differences are not testable. The authors did not develop any of the six models (independent comparison), but no conventional baseline is in the tables. Within-dataset split by tissue section (whole sections held out; train and test from the same study), not cross-dataset transfer. PR-AUC and ROC-AUC are macro-averaged (Methods); precision and recall are called global without a definition and appear to be averaged differently between models (source evidence concern), so do not compare them across models. Reference labels are the datasets' curated marker-gene and expert annotations, not independent ground truth. No rejection of unseen cell types or unassigned output is evaluated. Context-only references	Harmonised benchmarking of foundation models for single-cell and spatial transcriptomics reveals context-dependent generalisation Original source ↗ lit-cells-networks-20261011-chen2026-source-chen2026: Table 4; Results on supervised annotation; Methods 'Cell type annotation' Version: arXiv 2607.17227v2, updated 2026-09-17 (v1 posted 2026-07-19) Retrieved: 2026-10-11T21:29:34Z	not individually reviewed No individual claim review recorded Source has a recorded evidence concern. Consult its source page before using the claim. Audit details Field: `attributes.limitations` Source artifact SHA-256: `8137338c6146f570a6546f30707d4244baca9dab848b32c51539665a5ba539da` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Pinned records 45 values record id lit-cells-networks-20261011-chen2026-eval-annotation-seaad-cellplm fields status links attributes.origin attributes.comparison sha256 890834e9634f86c5546821e9e9ad49aca9ffafd0d9a38470e787b3629bc4cb18 record id lit-cells-networks-20261011-chen2026-eval-annotation-seaad-genept-w fields status links attributes.origin attributes.comparison sha256 28c8585c4e9f8755296f3d0740d1538a01b9d13b41b8476b431efa5e49a5aa70 record id lit-cells-networks-20261011-chen2026-eval-annotation-seaad-nicheformer fields status links attributes.origin attributes.comparison sha256 3b01b38b4f8efdee2869ed0d96e5e3ed621ef0a7468b16013714fb8a47cc7edc record id lit-cells-networks-20261011-chen2026-eval-annotation-seaad-novae fields status links attributes.origin attributes.comparison sha256 78fc63f6f5eed0eb49d8ab7151ed0c5bf3bc1aa68aa0ead289dae22c704fc185 record id lit-cells-networks-20261011-chen2026-eval-annotation-seaad-scelmo fields status links attributes.origin attributes.comparison sha256 deaf8db0a275710b4b042a52247ca80ecbe38ced5a3a312a9e79ee9e904944fb record id lit-cells-networks-20261011-chen2026-eval-annotation-seaad-scgpt-spatial fields status links attributes.origin attributes.comparison sha256 83161773c5d9d6beb3851c99c7f36d7ebc40867cf6903e644e22884f51f5659e record id lit-cells-networks-20261011-chen2026-protocol-annotation-seaad fields status name description facets source_ids links attributes sha256 543e1bd4bc85f6bc4b1bf80dcce17d748cbad79d8830240b13712895d64f6fb8 record id lit-cells-networks-20261011-chen2026-result-annotation-seaad-cellplm-accuracy fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 2034fa09363fa80194e259d86a95a269d7685cdce629838d83e14875fbe75738 record id lit-cells-networks-20261011-chen2026-result-annotation-seaad-cellplm-macro-f1 fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 0b6cdeceee5eb4673e2302b8943909cd5cccb55ff049ea22016b92d71a0aa1a3 record id lit-cells-networks-20261011-chen2026-result-annotation-seaad-cellplm-pr-auc fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 c55986af7ee5440144cdd4127b37c4afec4704614a35ef08ddd3005adf047420 record id lit-cells-networks-20261011-chen2026-result-annotation-seaad-cellplm-precision fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 afbb48a9be1b524c8eb9548b2b23c07af02da134cf57ccd3e0b586c5ebab7326 record id lit-cells-networks-20261011-chen2026-result-annotation-seaad-cellplm-recall fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 f31261ba2a79d8ba2c859d0a7ef046b31b7b8f7644e13073168673360d6ef85c record id lit-cells-networks-20261011-chen2026-result-annotation-seaad-cellplm-roc-auc fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 9b999931a75aafb766fe8efc8145bb499ffdaa2b17fac4206f62df642c37341e record id lit-cells-networks-20261011-chen2026-result-annotation-seaad-genept-w-accuracy fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 0d7625a8d8aeb79e5cfb42af493a232a4ecf9e1f1fc5b1132bfe11a563d584fb record id lit-cells-networks-20261011-chen2026-result-annotation-seaad-genept-w-macro-f1 fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 547682ee5d8c61db32a045b1065073a84efe5c84bc83c8bfa6e0abbc287516bf record id lit-cells-networks-20261011-chen2026-result-annotation-seaad-genept-w-pr-auc fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 366543eb4e923c07360ca8f36d8dc69b57ff987b6da168b433bf88c10f8b315b record id lit-cells-networks-20261011-chen2026-result-annotation-seaad-genept-w-precision fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 04e2b177b8d7db7637bc12d9212a342395e900ac34e2277fe6307c21af809bae record id lit-cells-networks-20261011-chen2026-result-annotation-seaad-genept-w-recall fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 91747f6498effebac3a76e1c965ac6f6781844c750751e34b8fd56894ae98116 record id lit-cells-networks-20261011-chen2026-result-annotation-seaad-genept-w-roc-auc fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 d9e527dda40f96508e6022f2573624f951f1a4fdcc4eb2578a1e2f82c5e1d49d record id lit-cells-networks-20261011-chen2026-result-annotation-seaad-nicheformer-accuracy fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 6c3d103a032975358846714c102cadfd4ec356f297bc016b250937049536f559 record id lit-cells-networks-20261011-chen2026-result-annotation-seaad-nicheformer-macro-f1 fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 fa6b29002216ecb0462608594e36fc8abb5e578cfc278eddc9f5ea6407c5e4e4 record id lit-cells-networks-20261011-chen2026-result-annotation-seaad-nicheformer-pr-auc fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 0c6a4c3361ab780e303f50d8ef52388ca017dd7ef0535668fd8aeaa892c0d18e record id lit-cells-networks-20261011-chen2026-result-annotation-seaad-nicheformer-precision fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 c86f6481d0a8d66cf6d9f8556d4552c36e323418dc3d7276c77e3311568ca48c record id lit-cells-networks-20261011-chen2026-result-annotation-seaad-nicheformer-recall fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 53ee1dff11e6096fefd865aceb6d413c7c069bed248c990798be7e67f43e24fe record id lit-cells-networks-20261011-chen2026-result-annotation-seaad-nicheformer-roc-auc fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 9b999931a75aafb766fe8efc8145bb499ffdaa2b17fac4206f62df642c37341e record id lit-cells-networks-20261011-chen2026-result-annotation-seaad-novae-accuracy fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 1f87ac0aefd7e13cda05f14af679819c87acf158daf9d2b3e184ac2f1f36deec record id lit-cells-networks-20261011-chen2026-result-annotation-seaad-novae-macro-f1 fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 c08794935df0a9c620288e0460050f245091d31807a021991cfd15878759672e record id lit-cells-networks-20261011-chen2026-result-annotation-seaad-novae-pr-auc fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 c3c81b5084c7a3ea43c0ef81dfbfe6bd64c6642bbc405e9f616e3d6f71efc0ea record id lit-cells-networks-20261011-chen2026-result-annotation-seaad-novae-precision fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 d4c4f8457405f06cb92ca63c7785b4670eaada306451451093e3d3d6c1d7c8f9 record id lit-cells-networks-20261011-chen2026-result-annotation-seaad-novae-recall fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 fb9888a703603d55aa299bceac37b5b4015eaf97f1155c0b04ff1dd09d7022a3 record id lit-cells-networks-20261011-chen2026-result-annotation-seaad-novae-roc-auc fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 fe40724a156a6ecc9f48fbd94483f37575c54f530f906d5e73987853d9808c39 record id lit-cells-networks-20261011-chen2026-result-annotation-seaad-scelmo-accuracy fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 dd48f157da75905d5a242d83f7fd62cb70d6aa1c234a14b6da2cbe6285aba971 record id lit-cells-networks-20261011-chen2026-result-annotation-seaad-scelmo-macro-f1 fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 547682ee5d8c61db32a045b1065073a84efe5c84bc83c8bfa6e0abbc287516bf record id lit-cells-networks-20261011-chen2026-result-annotation-seaad-scelmo-pr-auc fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 854099a5a17731dead7765ae56127d42361ce955ca44ddef4422788060e63e48 record id lit-cells-networks-20261011-chen2026-result-annotation-seaad-scelmo-precision fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 6c71f3c920e381c6b8be76e2af5f8b9b4ac87f08592387cc6cf86dd5dc0a1780 record id lit-cells-networks-20261011-chen2026-result-annotation-seaad-scelmo-recall fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 91747f6498effebac3a76e1c965ac6f6781844c750751e34b8fd56894ae98116 record id lit-cells-networks-20261011-chen2026-result-annotation-seaad-scelmo-roc-auc fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 8f9cfbeab6d024771bd135a8856d9f925d0e9ed376d551cc80ebde5c42e8df71 record id lit-cells-networks-20261011-chen2026-result-annotation-seaad-scgpt-spatial-accuracy fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 6c3d103a032975358846714c102cadfd4ec356f297bc016b250937049536f559 record id lit-cells-networks-20261011-chen2026-result-annotation-seaad-scgpt-spatial-macro-f1 fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 9e761e2f0b2b8ed4a77a36c87cab9f79dd4cab5c72ff4d7b2fe3addf5cbba63f record id lit-cells-networks-20261011-chen2026-result-annotation-seaad-scgpt-spatial-pr-auc fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 845446bf5f689fa4bc204c448a4281d295e3fe4111de106eafc17e714cc1b0c7 record id lit-cells-networks-20261011-chen2026-result-annotation-seaad-scgpt-spatial-precision fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 7667281e09f9be7da4573caefa17cd5ca28bdd58587a6611354669f43659a1c3 record id lit-cells-networks-20261011-chen2026-result-annotation-seaad-scgpt-spatial-recall fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 38c8ba3adab8d7d370cef28942a01aa785d6db56ffa0a9e67ad90cd1a09dcd46 record id lit-cells-networks-20261011-chen2026-result-annotation-seaad-scgpt-spatial-roc-auc fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 9b999931a75aafb766fe8efc8145bb499ffdaa2b17fac4206f62df642c37341e record id lit-cells-networks-20261011-chen2026-source-chen2026 fields status attributes.artifact_sha256 sha256 0b42f541d5ca376dc4e14f043f2eef02b5f307d7820685e0a1e3ef4a31def2b5 record id use-case-cell-type-annotation-transfer fields status name description facets attributes.question attributes.decision attributes.inputs attributes.output attributes.exclusions attributes.setting attributes.clinical_scope attributes.intended_users sha256 f4ef70c0d86c1d3ea8ff8600431eb0792da0bd5f355e7137bc364a42aa284bd9 Context-only references	Harmonised benchmarking of foundation models for single-cell and spatial transcriptomics reveals context-dependent generalisation Original source ↗ lit-cells-networks-20261011-chen2026-source-chen2026: Table 4; Results on supervised annotation; Methods 'Cell type annotation' Version: arXiv 2607.17227v2, updated 2026-09-17 (v1 posted 2026-07-19) Retrieved: 2026-10-11T21:29:34Z	not individually reviewed No individual claim review recorded Source has a recorded evidence concern. Consult its source page before using the claim. Audit details Field: `attributes.pins` Source artifact SHA-256: `8137338c6146f570a6546f30707d4244baca9dab848b32c51539665a5ba539da` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Rationale Scores foundation models fine-tuned on reference labels and tested on held-out cells of the same dataset. Proxy: the use case transfers labels to a new dataset, while this split keeps train and test cells from the same study and batch structure. Context-only references	Harmonised benchmarking of foundation models for single-cell and spatial transcriptomics reveals context-dependent generalisation Original source ↗ lit-cells-networks-20261011-chen2026-source-chen2026: Table 4; Results on supervised annotation; Methods 'Cell type annotation' Version: arXiv 2607.17227v2, updated 2026-09-17 (v1 posted 2026-07-19) Retrieved: 2026-10-11T21:29:34Z	not individually reviewed No individual claim review recorded Source has a recorded evidence concern. Consult its source page before using the claim. Audit details Field: `attributes.rationale` Source artifact SHA-256: `8137338c6146f570a6546f30707d4244baca9dab848b32c51539665a5ba539da` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact

How to read the evidence

Sources and history

Release 2026-10-23-5347695500ed · Record review: source checked

1 source record and release history

Harmonised benchmarking of foundation models for single-cell and spatial transcriptomics reveals context-dependent generalisation · Original source · arXiv 2607.17227v2, updated 2026-09-17 (v1 posted 2026-07-19)

Download this release (gzip)

Technical metadata and extraction receipts

Stable ID: use-case-mapping-lit-cells-networks-20261011-chen2026-annotation-seaad

field: links:assessed_by:lit-cells-networks-20261011-chen2026-protocol-annotation-seaad
value: lit-cells-networks-20261011-chen2026-protocol-annotation-seaad
relevance: proxy
endpoint: Accuracy, precision, recall, macro-F1, PR-AUC and ROC-AUC of supervised cell type annotation on a stratified held-out split of SEAAD
rationale: Scores foundation models fine-tuned on reference labels and tested on held-out cells of the same dataset. Proxy: the use case transfers labels to a new dataset, while this split keeps train and test cells from the same study and batch structure.
constraints: Inspect every linked evaluation's source locator before citing a result.; Prefer macro-F1 and PR-AUC; accuracy and ROC-AUC saturate on ATAA (Results).
limitations: Preprint; single run with seed 42 and no spread, so small differences are not testable.; The authors did not develop any of the six models (independent comparison), but no conventional baseline is in the tables.; Within-dataset split by tissue section (whole sections held out; train and test from the same study), not cross-dataset transfer.; PR-AUC and ROC-AUC are macro-averaged (Methods); precision and recall are called global without a definition and appear to be averaged differently between models (source evidence concern), so do not compare them across models.; Reference labels are the datasets' curated marker-gene and expert annotations, not independent ground truth.; No rejection of unseen cell types or unassigned output is evaluated.
citation locators: source id: lit-cells-networks-20261011-chen2026-source-chen2026; locator: Table 4; Results on supervised annotation; Methods 'Cell type annotation'
source locator: lit-cells-networks-20261011-chen2026-source-chen2026: Table 4; Results on supervised annotation; Methods 'Cell type annotation'
headline metric: macro-f1
comparison group: chen2026-harmonised-fm
comparison title: Harmonised single-cell and spatial foundation model benchmark (Chen et al. 2026)
stratum label: SEAAD held-out annotation
stratum order: 4
reviewed evaluations: lit-cells-networks-20261011-chen2026-eval-annotation-seaad-cellplm; lit-cells-networks-20261011-chen2026-eval-annotation-seaad-genept-w; lit-cells-networks-20261011-chen2026-eval-annotation-seaad-nicheformer; lit-cells-networks-20261011-chen2026-eval-annotation-seaad-novae; lit-cells-networks-20261011-chen2026-eval-annotation-seaad-scelmo; lit-cells-networks-20261011-chen2026-eval-annotation-seaad-scgpt-spatial
reason: Add a relevance judgement for a protocol from the 2026-10-11 cells-spatial and networks-mechanistic literature pass, reviewed in docs/reviews/2026-10-12-cells-networks-batches.md.
review: method: ai-assisted-source-review; scope-review; method note: Reviewer checked the endpoint against the use case's inputs, output and exclusions, the relevance rating and the limitations; every evaluation on the protocol had its values checked in the batch review. Corrections listed in review.md were applied by the extractor.; reviewer: claude; reviewer note: Claude review agent reviewer-cn-2, independent of the extractor lit-cells-networks; no human review claimed; reviewed at: 2026-10-12T08:44:00Z; note: Automated review; not human scientific review.
pins: record id: lit-cells-networks-20261011-chen2026-eval-annotation-seaad-cellplm; fields: status; links; attributes.origin; attributes.comparison; sha256: 890834e9634f86c5546821e9e9ad49aca9ffafd0d9a38470e787b3629bc4cb18; record id: lit-cells-networks-20261011-chen2026-eval-annotation-seaad-genept-w; fields: status; links; attributes.origin; attributes.comparison; sha256: 28c8585c4e9f8755296f3d0740d1538a01b9d13b41b8476b431efa5e49a5aa70; record id: lit-cells-networks-20261011-chen2026-eval-annotation-seaad-nicheformer; fields: status; links; attributes.origin; attributes.comparison; sha256: 3b01b38b4f8efdee2869ed0d96e5e3ed621ef0a7468b16013714fb8a47cc7edc; record id: lit-cells-networks-20261011-chen2026-eval-annotation-seaad-novae; fields: status; links; attributes.origin; attributes.comparison; sha256: 78fc63f6f5eed0eb49d8ab7151ed0c5bf3bc1aa68aa0ead289dae22c704fc185; record id: lit-cells-networks-20261011-chen2026-eval-annotation-seaad-scelmo; fields: status; links; attributes.origin; attributes.comparison; sha256: deaf8db0a275710b4b042a52247ca80ecbe38ced5a3a312a9e79ee9e904944fb; record id: lit-cells-networks-20261011-chen2026-eval-annotation-seaad-scgpt-spatial; fields: status; links; attributes.origin; attributes.comparison; sha256: 83161773c5d9d6beb3851c99c7f36d7ebc40867cf6903e644e22884f51f5659e; record id: lit-cells-networks-20261011-chen2026-protocol-annotation-seaad; fields: status; name; description; facets; source_ids; links; attributes; sha256: 543e1bd4bc85f6bc4b1bf80dcce17d748cbad79d8830240b13712895d64f6fb8; record id: lit-cells-networks-20261011-chen2026-result-annotation-seaad-cellplm-accuracy; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 2034fa09363fa80194e259d86a95a269d7685cdce629838d83e14875fbe75738; record id: lit-cells-networks-20261011-chen2026-result-annotation-seaad-cellplm-macro-f1; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 0b6cdeceee5eb4673e2302b8943909cd5cccb55ff049ea22016b92d71a0aa1a3; record id: lit-cells-networks-20261011-chen2026-result-annotation-seaad-cellplm-pr-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: c55986af7ee5440144cdd4127b37c4afec4704614a35ef08ddd3005adf047420; record id: lit-cells-networks-20261011-chen2026-result-annotation-seaad-cellplm-precision; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: afbb48a9be1b524c8eb9548b2b23c07af02da134cf57ccd3e0b586c5ebab7326; record id: lit-cells-networks-20261011-chen2026-result-annotation-seaad-cellplm-recall; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: f31261ba2a79d8ba2c859d0a7ef046b31b7b8f7644e13073168673360d6ef85c; record id: lit-cells-networks-20261011-chen2026-result-annotation-seaad-cellplm-roc-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 9b999931a75aafb766fe8efc8145bb499ffdaa2b17fac4206f62df642c37341e; record id: lit-cells-networks-20261011-chen2026-result-annotation-seaad-genept-w-accuracy; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 0d7625a8d8aeb79e5cfb42af493a232a4ecf9e1f1fc5b1132bfe11a563d584fb; record id: lit-cells-networks-20261011-chen2026-result-annotation-seaad-genept-w-macro-f1; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 547682ee5d8c61db32a045b1065073a84efe5c84bc83c8bfa6e0abbc287516bf; record id: lit-cells-networks-20261011-chen2026-result-annotation-seaad-genept-w-pr-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 366543eb4e923c07360ca8f36d8dc69b57ff987b6da168b433bf88c10f8b315b; record id: lit-cells-networks-20261011-chen2026-result-annotation-seaad-genept-w-precision; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 04e2b177b8d7db7637bc12d9212a342395e900ac34e2277fe6307c21af809bae; record id: lit-cells-networks-20261011-chen2026-result-annotation-seaad-genept-w-recall; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 91747f6498effebac3a76e1c965ac6f6781844c750751e34b8fd56894ae98116; record id: lit-cells-networks-20261011-chen2026-result-annotation-seaad-genept-w-roc-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: d9e527dda40f96508e6022f2573624f951f1a4fdcc4eb2578a1e2f82c5e1d49d; record id: lit-cells-networks-20261011-chen2026-result-annotation-seaad-nicheformer-accuracy; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 6c3d103a032975358846714c102cadfd4ec356f297bc016b250937049536f559; record id: lit-cells-networks-20261011-chen2026-result-annotation-seaad-nicheformer-macro-f1; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: fa6b29002216ecb0462608594e36fc8abb5e578cfc278eddc9f5ea6407c5e4e4; record id: lit-cells-networks-20261011-chen2026-result-annotation-seaad-nicheformer-pr-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 0c6a4c3361ab780e303f50d8ef52388ca017dd7ef0535668fd8aeaa892c0d18e; record id: lit-cells-networks-20261011-chen2026-result-annotation-seaad-nicheformer-precision; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: c86f6481d0a8d66cf6d9f8556d4552c36e323418dc3d7276c77e3311568ca48c; record id: lit-cells-networks-20261011-chen2026-result-annotation-seaad-nicheformer-recall; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 53ee1dff11e6096fefd865aceb6d413c7c069bed248c990798be7e67f43e24fe; record id: lit-cells-networks-20261011-chen2026-result-annotation-seaad-nicheformer-roc-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 9b999931a75aafb766fe8efc8145bb499ffdaa2b17fac4206f62df642c37341e; record id: lit-cells-networks-20261011-chen2026-result-annotation-seaad-novae-accuracy; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 1f87ac0aefd7e13cda05f14af679819c87acf158daf9d2b3e184ac2f1f36deec; record id: lit-cells-networks-20261011-chen2026-result-annotation-seaad-novae-macro-f1; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: c08794935df0a9c620288e0460050f245091d31807a021991cfd15878759672e; record id: lit-cells-networks-20261011-chen2026-result-annotation-seaad-novae-pr-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: c3c81b5084c7a3ea43c0ef81dfbfe6bd64c6642bbc405e9f616e3d6f71efc0ea; record id: lit-cells-networks-20261011-chen2026-result-annotation-seaad-novae-precision; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: d4c4f8457405f06cb92ca63c7785b4670eaada306451451093e3d3d6c1d7c8f9; record id: lit-cells-networks-20261011-chen2026-result-annotation-seaad-novae-recall; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: fb9888a703603d55aa299bceac37b5b4015eaf97f1155c0b04ff1dd09d7022a3; record id: lit-cells-networks-20261011-chen2026-result-annotation-seaad-novae-roc-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: fe40724a156a6ecc9f48fbd94483f37575c54f530f906d5e73987853d9808c39; record id: lit-cells-networks-20261011-chen2026-result-annotation-seaad-scelmo-accuracy; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: dd48f157da75905d5a242d83f7fd62cb70d6aa1c234a14b6da2cbe6285aba971; record id: lit-cells-networks-20261011-chen2026-result-annotation-seaad-scelmo-macro-f1; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 547682ee5d8c61db32a045b1065073a84efe5c84bc83c8bfa6e0abbc287516bf; record id: lit-cells-networks-20261011-chen2026-result-annotation-seaad-scelmo-pr-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 854099a5a17731dead7765ae56127d42361ce955ca44ddef4422788060e63e48; record id: lit-cells-networks-20261011-chen2026-result-annotation-seaad-scelmo-precision; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 6c71f3c920e381c6b8be76e2af5f8b9b4ac87f08592387cc6cf86dd5dc0a1780; record id: lit-cells-networks-20261011-chen2026-result-annotation-seaad-scelmo-recall; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 91747f6498effebac3a76e1c965ac6f6781844c750751e34b8fd56894ae98116; record id: lit-cells-networks-20261011-chen2026-result-annotation-seaad-scelmo-roc-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 8f9cfbeab6d024771bd135a8856d9f925d0e9ed376d551cc80ebde5c42e8df71; record id: lit-cells-networks-20261011-chen2026-result-annotation-seaad-scgpt-spatial-accuracy; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 6c3d103a032975358846714c102cadfd4ec356f297bc016b250937049536f559; record id: lit-cells-networks-20261011-chen2026-result-annotation-seaad-scgpt-spatial-macro-f1; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 9e761e2f0b2b8ed4a77a36c87cab9f79dd4cab5c72ff4d7b2fe3addf5cbba63f; record id: lit-cells-networks-20261011-chen2026-result-annotation-seaad-scgpt-spatial-pr-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 845446bf5f689fa4bc204c448a4281d295e3fe4111de106eafc17e714cc1b0c7; record id: lit-cells-networks-20261011-chen2026-result-annotation-seaad-scgpt-spatial-precision; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 7667281e09f9be7da4573caefa17cd5ca28bdd58587a6611354669f43659a1c3; record id: lit-cells-networks-20261011-chen2026-result-annotation-seaad-scgpt-spatial-recall; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 38c8ba3adab8d7d370cef28942a01aa785d6db56ffa0a9e67ad90cd1a09dcd46; record id: lit-cells-networks-20261011-chen2026-result-annotation-seaad-scgpt-spatial-roc-auc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 9b999931a75aafb766fe8efc8145bb499ffdaa2b17fac4206f62df642c37341e; record id: lit-cells-networks-20261011-chen2026-source-chen2026; fields: status; attributes.artifact_sha256; sha256: 0b42f541d5ca376dc4e14f043f2eef02b5f307d7820685e0a1e3ef4a31def2b5; record id: use-case-cell-type-annotation-transfer; fields: status; name; description; facets; attributes.question; attributes.decision; attributes.inputs; attributes.output; attributes.exclusions; attributes.setting; attributes.clinical_scope; attributes.intended_users; sha256: f4ef70c0d86c1d3ea8ff8600431eb0792da0bd5f355e7137bc364a42aa284bd9

Related records

subject: Transfer cell-type annotations to a new dataset

Suggest a correction