Relevance of Abdelaal et al. 2019 inter-dataset brain comparison: VISp/ALM/MTG, 34-population annotation (Figure S10 Panel B) to "Transfer cell-type annotations to a new dataset"
- Use case
- Transfer cell-type annotations to a new dataset
- Assessed by
- Abdelaal et al. 2019 inter-dataset brain comparison: VISp/ALM/MTG, 34-population annotation (Figure S10 Panel B)
- Relevance
- Proxy evidence
- Endpoint
- Inter-dataset (cross-dataset, cross-species where applicable) SVMrejection conventional rejection-option baseline: percentage of test-set cells left unlabeled across all 9 VISp/ALM/MTG train-test combinations, 34-cell-population annotation level.
A conventional-classifier rejection-option baseline on a genuine cross-dataset brain annotation-transfer design. VISp and ALM share GSE115746. MTG is a separate human single-nucleus dataset; combinations involving MTG include cross-species data. Some two-dataset training combinations still share the mouse study with the test dataset, so independent-study holdout must not be inferred for all nine combinations. This is directly relevant to the use case's 'identify cells that require expert review' endpoint. It is NOT a known-type accuracy result, NOT an unknown/absent-type-detection accuracy result, and NOT a comparison against any other classifier (only SVMrejection is ingested); it predates and does not evaluate scTab, CellTypist, Azimuth, scANVI or scParadise.
9 reviewed evaluations
- abdelaal brain svmrejection test=ALM train=MTG
- abdelaal brain svmrejection test=ALM train=VISp
- abdelaal brain svmrejection test=ALM train=VISp & MTG (concatenated)
- abdelaal brain svmrejection test=MTG train=ALM
- abdelaal brain svmrejection test=MTG train=VISp
- abdelaal brain svmrejection test=MTG train=VISp & ALM (concatenated)
- abdelaal brain svmrejection test=VISp train=ALM
- abdelaal brain svmrejection test=VISp train=ALM & MTG (concatenated)
- abdelaal brain svmrejection test=VISp train=MTG
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
30 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
Citation locations2 values
| A comparison of automatic cell identification methods for single-cell RNA sequencing data ucc-research-source-abdelaal-2019-supplement: Figure S10, Panel B (page 15 of 18), row "SVMrejection"; ucc-research-source-abdelaal-2019-paper: Methods, "Brain" (train-test design); Table 2 (VISp/ALM/MTG raw dataset sizes, context only) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 10.1186/s13059-019-1795-z; published article XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Citation locations2 values
| A comparison of automatic cell identification methods for single-cell RNA sequencing data — Additional File 1 (Supplementary Data) ucc-research-source-abdelaal-2019-supplement: Figure S10, Panel B (page 15 of 18), row "SVMrejection"; ucc-research-source-abdelaal-2019-paper: Methods, "Brain" (train-test design); Table 2 (VISp/ALM/MTG raw dataset sizes, context only) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 10.1186/s13059-019-1795-z; Additional File 1 (Supplementary Data PDF) | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Page-level pdftoppm image render (2400 dpi for Figure S10 panels; up to 4800 dpi spot-checked on Figure S9 Panel A, which carries no printed digits and is not ingested here), read directly as an image. Not pdftotext (the heatmap values are not present in the PDF's text layer), not OCR, not color-to-value inference. |
Constraints3 values
| A comparison of automatic cell identification methods for single-cell RNA sequencing data ucc-research-source-abdelaal-2019-supplement: Figure S10, Panel B (page 15 of 18), row "SVMrejection"; ucc-research-source-abdelaal-2019-paper: Methods, "Brain" (train-test design); Table 2 (VISp/ALM/MTG raw dataset sizes, context only) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 10.1186/s13059-019-1795-z; published article XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Constraints3 values
| A comparison of automatic cell identification methods for single-cell RNA sequencing data — Additional File 1 (Supplementary Data) ucc-research-source-abdelaal-2019-supplement: Figure S10, Panel B (page 15 of 18), row "SVMrejection"; ucc-research-source-abdelaal-2019-paper: Methods, "Brain" (train-test design); Table 2 (VISp/ALM/MTG raw dataset sizes, context only) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 10.1186/s13059-019-1795-z; Additional File 1 (Supplementary Data PDF) | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Page-level pdftoppm image render (2400 dpi for Figure S10 panels; up to 4800 dpi spot-checked on Figure S9 Panel A, which carries no printed digits and is not ingested here), read directly as an image. Not pdftotext (the heatmap values are not present in the PDF's text layer), not OCR, not color-to-value inference. |
| Endpoint Inter-dataset (cross-dataset, cross-species where applicable) SVMrejection conventional rejection-option baseline: percentage of test-set cells left unlabeled across all 9 VISp/ALM/MTG train-test combinations, 34-cell-population annotation level. Context-only references | A comparison of automatic cell identification methods for single-cell RNA sequencing data ucc-research-source-abdelaal-2019-supplement: Figure S10, Panel B (page 15 of 18), row "SVMrejection"; ucc-research-source-abdelaal-2019-paper: Methods, "Brain" (train-test design); Table 2 (VISp/ALM/MTG raw dataset sizes, context only) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 10.1186/s13059-019-1795-z; published article XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Endpoint Inter-dataset (cross-dataset, cross-species where applicable) SVMrejection conventional rejection-option baseline: percentage of test-set cells left unlabeled across all 9 VISp/ALM/MTG train-test combinations, 34-cell-population annotation level. Context-only references | A comparison of automatic cell identification methods for single-cell RNA sequencing data — Additional File 1 (Supplementary Data) ucc-research-source-abdelaal-2019-supplement: Figure S10, Panel B (page 15 of 18), row "SVMrejection"; ucc-research-source-abdelaal-2019-paper: Methods, "Brain" (train-test design); Table 2 (VISp/ALM/MTG raw dataset sizes, context only) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 10.1186/s13059-019-1795-z; Additional File 1 (Supplementary Data PDF) | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Page-level pdftoppm image render (2400 dpi for Figure S10 panels; up to 4800 dpi spot-checked on Figure S9 Panel A, which carries no printed digits and is not ingested here), read directly as an image. Not pdftotext (the heatmap values are not present in the PDF's text layer), not OCR, not color-to-value inference. |
| Claimed field links:assessed_by:ucc-research-protocol-abdelaal-brain-inter-34pop Context-only references | A comparison of automatic cell identification methods for single-cell RNA sequencing data ucc-research-source-abdelaal-2019-supplement: Figure S10, Panel B (page 15 of 18), row "SVMrejection"; ucc-research-source-abdelaal-2019-paper: Methods, "Brain" (train-test design); Table 2 (VISp/ALM/MTG raw dataset sizes, context only) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 10.1186/s13059-019-1795-z; published article XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Claimed field links:assessed_by:ucc-research-protocol-abdelaal-brain-inter-34pop Context-only references | A comparison of automatic cell identification methods for single-cell RNA sequencing data — Additional File 1 (Supplementary Data) ucc-research-source-abdelaal-2019-supplement: Figure S10, Panel B (page 15 of 18), row "SVMrejection"; ucc-research-source-abdelaal-2019-paper: Methods, "Brain" (train-test design); Table 2 (VISp/ALM/MTG raw dataset sizes, context only) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 10.1186/s13059-019-1795-z; Additional File 1 (Supplementary Data PDF) | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Page-level pdftoppm image render (2400 dpi for Figure S10 panels; up to 4800 dpi spot-checked on Figure S9 Panel A, which carries no printed digits and is not ingested here), read directly as an image. Not pdftotext (the heatmap values are not present in the PDF's text layer), not OCR, not color-to-value inference. |
Limitations8 values
| A comparison of automatic cell identification methods for single-cell RNA sequencing data ucc-research-source-abdelaal-2019-supplement: Figure S10, Panel B (page 15 of 18), row "SVMrejection"; ucc-research-source-abdelaal-2019-paper: Methods, "Brain" (train-test design); Table 2 (VISp/ALM/MTG raw dataset sizes, context only) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 10.1186/s13059-019-1795-z; published article XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Limitations8 values
| A comparison of automatic cell identification methods for single-cell RNA sequencing data — Additional File 1 (Supplementary Data) ucc-research-source-abdelaal-2019-supplement: Figure S10, Panel B (page 15 of 18), row "SVMrejection"; ucc-research-source-abdelaal-2019-paper: Methods, "Brain" (train-test design); Table 2 (VISp/ALM/MTG raw dataset sizes, context only) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 10.1186/s13059-019-1795-z; Additional File 1 (Supplementary Data PDF) | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Page-level pdftoppm image render (2400 dpi for Figure S10 panels; up to 4800 dpi spot-checked on Figure S9 Panel A, which carries no printed digits and is not ingested here), read directly as an image. Not pdftotext (the heatmap values are not present in the PDF's text layer), not OCR, not color-to-value inference. |
Sources and history
Release 2026-11-21-c8bea25e5abb · Record review: source checked
2 source records and release history
- A comparison of automatic cell identification methods for single-cell RNA sequencing data — Additional File 1 (Supplementary Data) · Original source · 10.1186/s13059-019-1795-z; Additional File 1 (Supplementary Data PDF)
- A comparison of automatic cell identification methods for single-cell RNA sequencing data · Original source · 10.1186/s13059-019-1795-z; published article XML
Technical metadata and extraction receipts
Stable ID: use-case-mapping-20261007-349-b12e5dc4f5b4
- field
- links:assessed_by:ucc-research-protocol-abdelaal-brain-inter-34pop
- value
- ucc-research-protocol-abdelaal-brain-inter-34pop
- relevance
- proxy
- endpoint
- Inter-dataset (cross-dataset, cross-species where applicable) SVMrejection conventional rejection-option baseline: percentage of test-set cells left unlabeled across all 9 VISp/ALM/MTG train-test combinations, 34-cell-population annotation level.
- rationale
- A conventional-classifier rejection-option baseline on a genuine cross-dataset brain annotation-transfer design. VISp and ALM share GSE115746. MTG is a separate human single-nucleus dataset; combinations involving MTG include cross-species data. Some two-dataset training combinations still share the mouse study with the test dataset, so independent-study holdout must not be inferred for all nine combinations. This is directly relevant to the use case's 'identify cells that require expert review' endpoint. It is NOT a known-type accuracy result, NOT an unknown/absent-type-detection accuracy result, and NOT a comparison against any other classifier (only SVMrejection is ingested); it predates and does not evaluate scTab, CellTypist, Azimuth, scANVI or scParadise.
- constraints
- Inter-dataset (whole-dataset train/test combinations across VISp, ALM, MTG), not a within-dataset cross-validation split.; 34-cell-population (deeper) annotation level only (Figure S10 Panel B); the 3-population major-lineage level (Figure S10 Panel A) is not included.; SVMrejection only; the other 17 classifiers shown in the same source figure are not included in this mapping.
- limitations
- Scored denominator is UNREPORTED in the retrieved main text and supplement. Table 2's raw per-dataset cell counts (VISp 12,832; ALM 8,758; MTG 14,636) are recorded on the linked dataset records as context only, not a confirmed denominator, and must not be used to back-calculate an implied rejected-cell count.; metric_direction is "unknown" for every result under this mapping's protocol: percentage unlabeled is a coverage/rejection-rate figure, not a standalone performance metric with one universal better/worse direction.; Not a known-type accuracy claim, not an unknown/absent-type-detection accuracy claim, and not a superiority claim over any other classifier; no comparison across methods is asserted by this mapping.; Figure S9 Panel A (PBMC) carries no printed digit labels in the source PDF at any resolution checked, and separately shows an unresolved conflict between its own caption ("median F1-score"), the page's only legend ("Unlabeled (%)"), and the figure's overall title ("Percentage of unlabeled cells"); nothing from Figure S9 is part of this mapping.; Reference labels are the original brain-atlas studies' author-assigned cell-population annotations, not independently adjudicated ground truth.; VISp and ALM share GSE115746. MTG is a separate human single-nucleus dataset; combinations involving MTG include cross-species data. Some two-dataset training combinations still share the mouse study with the test dataset, so independent-study holdout must not be inferred for all nine combinations.; Automated source review only; independent human scientific review remains outstanding.; Predates scTab, CellTypist, Azimuth, scANVI and scParadise; does not evaluate them. Does not measure or substitute for the common-protocol cross-study benchmark gap tracked separately at rewire-benchmarks #27.
- revision
- 1
- reason
- Bounded additive intake (issue #349), continuing the 2026-10-06/2026-10-07 dossier series, independently reviewed by Codex before ingestion: Abdelaal et al. 2019 Figure S10 Panel B (34-population inter-dataset, cross-dataset/cross-species-where-applicable brain comparison), SVMrejection row only (9 values). VISp and ALM share GSE115746. MTG is a separate human single-nucleus dataset; combinations involving MTG include cross-species data. Some two-dataset training combinations still share the mouse study with the test dataset, so independent-study holdout must not be inferred for all nine combinations. A conventional rejection-option baseline, not a known-type accuracy or unknown-type-detection accuracy claim, and not a superiority claim across methods. Kept as a separate mapping from the existing Baron Human INTRA-dataset mapping (a different, non-transfer design) and from the two scTab uncertainty mappings.
- citation locators
- source id: ucc-research-source-abdelaal-2019-supplement; locator: Figure S10, Panel B (page 15 of 18), row "SVMrejection"; source id: ucc-research-source-abdelaal-2019-paper; locator: Methods, "Brain" (train-test design); Table 2 (VISp/ALM/MTG raw dataset sizes, context only)
- source locator
- ucc-research-source-abdelaal-2019-supplement: Figure S10, Panel B (page 15 of 18), row "SVMrejection"; ucc-research-source-abdelaal-2019-paper: Methods, "Brain" (train-test design); Table 2 (VISp/ALM/MTG raw dataset sizes, context only)
- review
- method: automated-source-review; reviewer: claude-sonnet; reviewer note: Claude Sonnet cell-type-annotation-transfer evidence-research worker; reviewed at: 2026-10-07T07:44:08Z; note: Source-backed primary-text transcription of Abdelaal et al. 2019 Figure S10 Panel B, bound by data/omics/use-case-coverage-20261007/research/review.json. Independently cross-checked against the original supplement PDF by a separate reviewer (Codex) before this mapping was added, including the nine printed values, column order, and the Figure S9 Panel A caption/legend/title conflict and Table 2 denominator-scope correction carried over from the preceding 2026-10-07 completion-assessment review. No new model execution, independent experimental replication, qualified human scientific review or clinical validation.
- reviewed evaluations
- ucc-research-eval-abdelaal-brain-alm-from-mtg; ucc-research-eval-abdelaal-brain-alm-from-visp; ucc-research-eval-abdelaal-brain-alm-from-visp-mtg; ucc-research-eval-abdelaal-brain-mtg-from-alm; ucc-research-eval-abdelaal-brain-mtg-from-visp; ucc-research-eval-abdelaal-brain-mtg-from-visp-alm; ucc-research-eval-abdelaal-brain-visp-from-alm; ucc-research-eval-abdelaal-brain-visp-from-alm-mtg; ucc-research-eval-abdelaal-brain-visp-from-mtg
- pins
- record id: ucc-research-eval-abdelaal-brain-alm-from-mtg; fields: status; links; attributes.origin; attributes.comparison; sha256: a2b59dd2f4600fbe238d2c33749aace6fa7eaf826e606bdc117fbda4ec557f68; record id: ucc-research-eval-abdelaal-brain-alm-from-visp; fields: status; links; attributes.origin; attributes.comparison; sha256: a69c73f913508972593ee139956e43c565460a590f53aca54c66080fef9bdf63; record id: ucc-research-eval-abdelaal-brain-alm-from-visp-mtg; fields: status; links; attributes.origin; attributes.comparison; sha256: b624ae5925f26221db74f37eb30681698d84fa8153c07c414a5b409c7d3ed7f9; record id: ucc-research-eval-abdelaal-brain-mtg-from-alm; fields: status; links; attributes.origin; attributes.comparison; sha256: f3000e67434904ceff9f81b8bcd368781e2afba74ca1aad255703b8baa5558b8; record id: ucc-research-eval-abdelaal-brain-mtg-from-visp; fields: status; links; attributes.origin; attributes.comparison; sha256: 5f15c0386791c5b5ba7a0fa2e8d90416b2347236bb84d27424ff8bbc432a66a6; record id: ucc-research-eval-abdelaal-brain-mtg-from-visp-alm; fields: status; links; attributes.origin; attributes.comparison; sha256: 585ab07927a23d1447ac3ea1aeddd4d25f5f7b6698c1550b54257a0b867057e5; record id: ucc-research-eval-abdelaal-brain-visp-from-alm; fields: status; links; attributes.origin; attributes.comparison; sha256: e36a3510f726d4e9f0b313c540859de0893eb55fab5d188bf921936c40df579c; record id: ucc-research-eval-abdelaal-brain-visp-from-alm-mtg; fields: status; links; attributes.origin; attributes.comparison; sha256: 437b9c0adef92e22eb168c633e9a8e0ec5bcadb86a6b41dddd5feb4424121894; record id: ucc-research-eval-abdelaal-brain-visp-from-mtg; fields: status; links; attributes.origin; attributes.comparison; sha256: 19d730335b5f0072da6158a91078ea148616f5ec3c251d82a361f78ebc11842e; record id: ucc-research-protocol-abdelaal-brain-inter-34pop; fields: status; name; description; facets; source_ids; links; attributes; sha256: 4d7f058c060f128511247cc1e16b57d956625fac84fc9103dd5519a98bfae71d; record id: ucc-research-result-abdelaal-brain-alm-from-mtg-unlabeled; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 6903052012c67d376a54267f030a651faad4e10bc4802c662c171a2240834995; record id: ucc-research-result-abdelaal-brain-alm-from-visp-mtg-unlabeled; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 28d88691ece7bc0d45cc3776e05ecb2bd9e31022b29ac8176d9f3970d493765e; record id: ucc-research-result-abdelaal-brain-alm-from-visp-unlabeled; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: c66cc52bcb59fd2caf7ee852b36215c19bb58cffc73fefc8389bd51c03c2510d; record id: ucc-research-result-abdelaal-brain-mtg-from-alm-unlabeled; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 9cd97b2d948db1b55553500e583a96e9e74de11ee551e672fe4e4323220df6ba; record id: ucc-research-result-abdelaal-brain-mtg-from-visp-alm-unlabeled; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 846513c71fce960716eaeecf88447214d43e4e87f0e209b9c193d70e87e5722f; record id: ucc-research-result-abdelaal-brain-mtg-from-visp-unlabeled; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: a05289b033eb96e319b62833be2e0465223d888aff8e21c493d50b0ca96516dd; record id: ucc-research-result-abdelaal-brain-visp-from-alm-mtg-unlabeled; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 01e313fed0f0aeacea3202e1e107fc5c4a7a1fa2076c6dc1ffe2fced2f266c42; record id: ucc-research-result-abdelaal-brain-visp-from-alm-unlabeled; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 9997072ef001ae0993c585fdb29a55d2865fffbab9cc054e262b9da86b439a59; record id: ucc-research-result-abdelaal-brain-visp-from-mtg-unlabeled; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 433be0b6c0d2cecc8ba46620baca03b50188641513e21e4d47c3a41c9822c731; record id: ucc-research-source-abdelaal-2019-paper; fields: status; attributes.artifact_sha256; sha256: e7c72be59b6152bcd5c356c70d58744cf8ec978a5be40d011422ee8f4c2b5f18; record id: ucc-research-source-abdelaal-2019-supplement; fields: status; attributes.artifact_sha256; sha256: 0f82266d1466f234a88ed121cc75fa8039f04739278da0f0c2acfd702beaefd7; record id: use-case-cell-type-annotation-transfer; fields: status; name; description; facets; attributes.question; attributes.decision; attributes.inputs; attributes.output; attributes.exclusions; attributes.setting; attributes.clinical_scope; attributes.intended_users; sha256: f4ef70c0d86c1d3ea8ff8600431eb0792da0bd5f355e7137bc364a42aa284bd9