Result

99.5% pct-unlabeled

pct-unlabeled — ucc-research-eval-abdelaal-brain-mtg-from-visp-alm

Tested configuration: SVMrejection — Abdelaal et al. 2019 Table 1
Protocol: Abdelaal et al. 2019 inter-dataset brain comparison: VISp/ALM/MTG, 34-population annotation (Figure S10 Panel B)
Dataset: MTG brain single-nucleus RNA-seq (snRNA-seq) dataset (Abdelaal et al. 2019, Table 2)
Procedure: Not reported
Evaluation: abdelaal brain svmrejection test=MTG train=VISp & ALM (concatenated)
Coverage: scored: unreported; eligible: unreported
Uncertainty: Not reported
Evidence: Author-reported evaluation · source checkedA comparison of automatic cell identification methods for single-cell RNA sequencing data — Additional File 1 (Supplementary Data) · Figure S10, Panel B (page 15 of 18), row "SVMrejection", test set MTG, training set(s) VISp & ALM (concatenated)

A source-checked result verifies the numerical transcription, not every model or protocol detail. Evaluation metadata: source checked. Source checked does not mean independently reproduced.

Reproduction

Split: Inter-dataset (cross-dataset, cross-species where applicable): trained on whole dataset(s) VISp & ALM (concatenated), tested on whole dataset MTG. Not a within-dataset cross-validation split.
Adaptation: Not reported
Scoring implementation: Not reported

No execution recipe has been verified for this exact configuration and evaluation. A benchmark's general instructions may use different inputs, splits or model settings.

Access requirements and official instructions: Abdelaal et al. 2019 inter-dataset brain comparison: VISp/ALM/MTG, 34-population annotation (Figure S10 Panel B)

Reproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

1 evidence row matching the loaded filters

Claims, original sources and review scope · Release 2026-10-07-e11db1d1c586
Property and statement	Original source and location	Review and provenance
Reported result 99.5% Individual claims	A comparison of automatic cell identification methods for single-cell RNA sequencing data — Additional File 1 (Supplementary Data) Original source ↗ Figure S10, Panel B (page 15 of 18), row "SVMrejection", test set MTG, training set(s) VISp & ALM (concatenated) Version: 10.1186/s13059-019-1795-z; Additional File 1 (Supplementary Data PDF) Retrieved: 2026-10-06T21:17:27Z	source checked automated source review · 2026-10-07T07:44:08Z author reported Audit details Source-backed transcription of Abdelaal et al. 2019 Additional File 1 (Supplementary Data PDF), a separate byte artifact from the already-catalogued main-text XML. Originally retrieved 2026-10-06T21:17:27Z via the Springer/BMC static-content route (https://static-content.springer.com/esm/art%3A10.1186%2Fs13059-019-1795-z/MediaObjects/13059_2019_1795_MOESM1_ESM.pdf), HTTP 200, 13,495,279 bytes. Re-verified byte-identical (SHA-256 unchanged) in this pass against the cached copy in the neighboring cell-type-evidence-20261006 worktree before archiving. Figure S10 (page 15 of 18) read directly from a pdftoppm image render at 2400 dpi (not OCR, not color inference); Panel B's printed numeric cell values independently re-confirmed against the original PDF by a separate reviewer prior to this ingestion. No new model execution, independent experimental replication, or qualified human scientific review. Field: `attributes.printed_value` Source artifact SHA-256: `Not recorded` Hash scope: Page-level pdftoppm image render (2400 dpi for Figure S10 panels; up to 4800 dpi spot-checked on Figure S9 Panel A, which carries no printed digits and is not ingested here), read directly as an image. Not pdftotext (the heatmap values are not present in the PDF's text layer), not OCR, not color-to-value inference. Inspected artifact

All evidence (CSV)All evidence (JSONL)How to read the evidence

Sources and history

View linked audit checks and correction history

Release 2026-10-07-e11db1d1c586 · Record review: source checked

1 source records and release history

A comparison of automatic cell identification methods for single-cell RNA sequencing data — Additional File 1 (Supplementary Data) · Original source · 10.1186/s13059-019-1795-z; Additional File 1 (Supplementary Data PDF)

Download this release

Technical metadata and extraction receipts

Stable ID: ucc-research-result-abdelaal-brain-mtg-from-visp-alm-unlabeled

metric: pct-unlabeled
metric direction: unknown
unit: percent
printed value: 99.5%
numeric value: 99.5
source locator: Figure S10, Panel B (page 15 of 18), row "SVMrejection", test set MTG, training set(s) VISp & ALM (concatenated)
uncertainty: Not reported
review: method: automated_source_review; actor: Claude Sonnet cell-type-annotation-transfer evidence-research worker; reviewed at: 2026-10-07T07:44:08Z; note: Source-backed transcription of Abdelaal et al. 2019 Additional File 1 (Supplementary Data PDF), a separate byte artifact from the already-catalogued main-text XML. Originally retrieved 2026-10-06T21:17:27Z via the Springer/BMC static-content route (https://static-content.springer.com/esm/art%3A10.1186%2Fs13059-019-1795-z/MediaObjects/13059_2019_1795_MOESM1_ESM.pdf), HTTP 200, 13,495,279 bytes. Re-verified byte-identical (SHA-256 unchanged) in this pass against the cached copy in the neighboring cell-type-evidence-20261006 worktree before archiving. Figure S10 (page 15 of 18) read directly from a pdftoppm image render at 2400 dpi (not OCR, not color inference); Panel B's printed numeric cell values independently re-confirmed against the original PDF by a separate reviewer prior to this ingestion. No new model execution, independent experimental replication, or qualified human scientific review.
scope note: Inter-dataset (cross-dataset, cross-species where applicable) SVMrejection conventional rejection-option baseline: percentage of MTG test-set cells left unlabeled, 34-cell-population annotation level, trained on VISp & ALM (concatenated). This is a coverage/rejection-rate figure only — NOT a known-type accuracy claim, NOT an unknown/absent-type-detection accuracy claim, and NOT a superiority claim over any other classifier. Scored denominator is UNREPORTED; Table 2's raw per-dataset cell count is context only, not a confirmed denominator. metric_direction is "unknown" per the schema's higher/lower/unknown contract. See ucc-research-protocol-abdelaal-brain-inter-34pop for full scope and limitations.

Related records

evaluation: abdelaal brain svmrejection test=MTG train=VISp & ALM (concatenated)

Suggest a correction