rewirebio.iobenchmarks
Evidence claim

Relevance of scTab Table 1a: seeded model fits to "Transfer cell-type annotations to a new dataset"

Use case
Transfer cell-type annotations to a new dataset
Assessed by
scTab Table 1a: seeded model fits
Relevance
Proxy evidence
Endpoint
Donor-held-out, ontology-adjusted macro F1 for known cell types.

Direct annotation endpoint, but only partial evidence for transfer to a new study/platform and unsupported populations.

9 reviewed evaluations

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

48 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Citation locations
3 values
  • source id
    ucc-research-source-sctab-paper
    locator
    Supplementary Table 1a; Results and Methods
  • source id
    ucc-research-source-sctab-supp
    locator
    Supplementary Table 1a; Results and Methods
  • source id
    ucc-research-source-sctab-code
    locator
    Supplementary Table 1a; Results and Methods
Context-only references
scTab official reproducibility repository

Original source ↗

ucc-research-source-sctab-paper: Supplementary Table 1a; Results and Methods; ucc-research-source-sctab-supp: Supplementary Table 1a; Results and Methods; ucc-research-source-sctab-code: Supplementary Table 1a; Results and Methods

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: 5ede7f2ba1f9618b86924f2ff587931de18f4ada
Retrieved: 2026-09-30T21:26:16Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.citation_locators

Source artifact SHA-256: b9208a3232ffbcf835c2b3854bda2d1cb8d68f202638c4421d38e45485cde2ba

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Citation locations
3 values
  • source id
    ucc-research-source-sctab-paper
    locator
    Supplementary Table 1a; Results and Methods
  • source id
    ucc-research-source-sctab-supp
    locator
    Supplementary Table 1a; Results and Methods
  • source id
    ucc-research-source-sctab-code
    locator
    Supplementary Table 1a; Results and Methods
Context-only references
scTab: Scaling cross-tissue single-cell annotation models

Original source ↗

ucc-research-source-sctab-paper: Supplementary Table 1a; Results and Methods; ucc-research-source-sctab-supp: Supplementary Table 1a; Results and Methods; ucc-research-source-sctab-code: Supplementary Table 1a; Results and Methods

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: 10.1038/s41467-024-51059-5; published article XML retrieved 2026-09-30
Retrieved: 2026-09-30T21:23:28Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.citation_locators

Source artifact SHA-256: e61b11cd873f3d13e891e9c33bac0847070826200f8fbe0b3969d994f1c52290

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Citation locations
3 values
  • source id
    ucc-research-source-sctab-paper
    locator
    Supplementary Table 1a; Results and Methods
  • source id
    ucc-research-source-sctab-supp
    locator
    Supplementary Table 1a; Results and Methods
  • source id
    ucc-research-source-sctab-code
    locator
    Supplementary Table 1a; Results and Methods
Context-only references
scTab supplementary comparison tables

Original source ↗

ucc-research-source-sctab-paper: Supplementary Table 1a; Results and Methods; ucc-research-source-sctab-supp: Supplementary Table 1a; Results and Methods; ucc-research-source-sctab-code: Supplementary Table 1a; Results and Methods

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Supplementary Information to 10.1038/s41467-024-51059-5
Retrieved: 2026-09-30T21:26:25Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.citation_locators

Source artifact SHA-256: 392c5da175e1a225faee9c2e15eaf71f12e0e44762d39b0d694cd8a5255986ae

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Constraints
2 values
  • 10x-related assays; rare cell types filtered; donor holdouts, not whole-study holdouts.
  • CellTypist/scGPT/CIForm training subsampling differs from full-data models.
Context-only references
scTab official reproducibility repository

Original source ↗

ucc-research-source-sctab-paper: Supplementary Table 1a; Results and Methods; ucc-research-source-sctab-supp: Supplementary Table 1a; Results and Methods; ucc-research-source-sctab-code: Supplementary Table 1a; Results and Methods

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: 5ede7f2ba1f9618b86924f2ff587931de18f4ada
Retrieved: 2026-09-30T21:26:16Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.constraints

Source artifact SHA-256: b9208a3232ffbcf835c2b3854bda2d1cb8d68f202638c4421d38e45485cde2ba

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Constraints
2 values
  • 10x-related assays; rare cell types filtered; donor holdouts, not whole-study holdouts.
  • CellTypist/scGPT/CIForm training subsampling differs from full-data models.
Context-only references
scTab: Scaling cross-tissue single-cell annotation models

Original source ↗

ucc-research-source-sctab-paper: Supplementary Table 1a; Results and Methods; ucc-research-source-sctab-supp: Supplementary Table 1a; Results and Methods; ucc-research-source-sctab-code: Supplementary Table 1a; Results and Methods

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: 10.1038/s41467-024-51059-5; published article XML retrieved 2026-09-30
Retrieved: 2026-09-30T21:23:28Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.constraints

Source artifact SHA-256: e61b11cd873f3d13e891e9c33bac0847070826200f8fbe0b3969d994f1c52290

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Constraints
2 values
  • 10x-related assays; rare cell types filtered; donor holdouts, not whole-study holdouts.
  • CellTypist/scGPT/CIForm training subsampling differs from full-data models.
Context-only references
scTab supplementary comparison tables

Original source ↗

ucc-research-source-sctab-paper: Supplementary Table 1a; Results and Methods; ucc-research-source-sctab-supp: Supplementary Table 1a; Results and Methods; ucc-research-source-sctab-code: Supplementary Table 1a; Results and Methods

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Supplementary Information to 10.1038/s41467-024-51059-5
Retrieved: 2026-09-30T21:26:25Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.constraints

Source artifact SHA-256: 392c5da175e1a225faee9c2e15eaf71f12e0e44762d39b0d694cd8a5255986ae

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Endpoint
Donor-held-out, ontology-adjusted macro F1 for known cell types.
Context-only references
scTab official reproducibility repository

Original source ↗

ucc-research-source-sctab-paper: Supplementary Table 1a; Results and Methods; ucc-research-source-sctab-supp: Supplementary Table 1a; Results and Methods; ucc-research-source-sctab-code: Supplementary Table 1a; Results and Methods

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: 5ede7f2ba1f9618b86924f2ff587931de18f4ada
Retrieved: 2026-09-30T21:26:16Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.endpoint

Source artifact SHA-256: b9208a3232ffbcf835c2b3854bda2d1cb8d68f202638c4421d38e45485cde2ba

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Endpoint
Donor-held-out, ontology-adjusted macro F1 for known cell types.
Context-only references
scTab: Scaling cross-tissue single-cell annotation models

Original source ↗

ucc-research-source-sctab-paper: Supplementary Table 1a; Results and Methods; ucc-research-source-sctab-supp: Supplementary Table 1a; Results and Methods; ucc-research-source-sctab-code: Supplementary Table 1a; Results and Methods

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: 10.1038/s41467-024-51059-5; published article XML retrieved 2026-09-30
Retrieved: 2026-09-30T21:23:28Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.endpoint

Source artifact SHA-256: e61b11cd873f3d13e891e9c33bac0847070826200f8fbe0b3969d994f1c52290

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Endpoint
Donor-held-out, ontology-adjusted macro F1 for known cell types.
Context-only references
scTab supplementary comparison tables

Original source ↗

ucc-research-source-sctab-paper: Supplementary Table 1a; Results and Methods; ucc-research-source-sctab-supp: Supplementary Table 1a; Results and Methods; ucc-research-source-sctab-code: Supplementary Table 1a; Results and Methods

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Supplementary Information to 10.1038/s41467-024-51059-5
Retrieved: 2026-09-30T21:26:25Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.endpoint

Source artifact SHA-256: 392c5da175e1a225faee9c2e15eaf71f12e0e44762d39b0d694cd8a5255986ae

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Excluded evaluations
2 values
  • id
    ucc-research-eval-sctab-default-celltypist
    reason
    Not in the reviewed mapping's evaluation list when use cases moved into the store (2026-10-09).
  • id
    ucc-research-eval-sctab-default-xgboost
    reason
    Not in the reviewed mapping's evaluation list when use cases moved into the store (2026-10-09).
Context-only references
scTab official reproducibility repository

Original source ↗

ucc-research-source-sctab-paper: Supplementary Table 1a; Results and Methods; ucc-research-source-sctab-supp: Supplementary Table 1a; Results and Methods; ucc-research-source-sctab-code: Supplementary Table 1a; Results and Methods

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: 5ede7f2ba1f9618b86924f2ff587931de18f4ada
Retrieved: 2026-09-30T21:26:16Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.excluded_evaluations

Source artifact SHA-256: b9208a3232ffbcf835c2b3854bda2d1cb8d68f202638c4421d38e45485cde2ba

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

3 source records and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: use-case-mapping-20260930-349-1af09c2e0e0f

field
links:assessed_by:ucc-research-protocol-sctab-seed
value
ucc-research-protocol-sctab-seed
relevance
proxy
endpoint
Donor-held-out, ontology-adjusted macro F1 for known cell types.
rationale
Direct annotation endpoint, but only partial evidence for transfer to a new study/platform and unsupported populations.
constraints
10x-related assays; rare cell types filtered; donor holdouts, not whole-study holdouts.; CellTypist/scGPT/CIForm training subsampling differs from full-data models.
limitations
Unknown-type rejection ROC appears in Supplementary Figure 4 but numerical curve labels are not extracted here.; Reference labels are author annotations, not independent ground truth.; Checkpoint and split hashes unextracted; no deployment calibration claim.; Automated source review only; independent human scientific review remains outstanding.
revision
1
reason
Add independently checked primary-source protocol evidence from the 17-use-case coverage audit; retain narrower endpoint and transfer limitations.
citation locators
source id: ucc-research-source-sctab-paper; locator: Supplementary Table 1a; Results and Methods; source id: ucc-research-source-sctab-supp; locator: Supplementary Table 1a; Results and Methods; source id: ucc-research-source-sctab-code; locator: Supplementary Table 1a; Results and Methods
source locator
ucc-research-source-sctab-paper: Supplementary Table 1a; Results and Methods; ucc-research-source-sctab-supp: Supplementary Table 1a; Results and Methods; ucc-research-source-sctab-code: Supplementary Table 1a; Results and Methods
excluded evaluations
id: ucc-research-eval-sctab-default-celltypist; reason: Not in the reviewed mapping's evaluation list when use cases moved into the store (2026-10-09).; id: ucc-research-eval-sctab-default-xgboost; reason: Not in the reviewed mapping's evaluation list when use cases moved into the store (2026-10-09).
review
method: automated-source-review; reviewer: codex; reviewer note: Codex source curation, independent worker cross-review and root integration review; reviewed at: 2026-09-30T21:54:30.217Z; note: Source-backed literature curation with independent automated transcription and scope checks. No new model execution, independent experimental replication, qualified human scientific review or clinical validation.
reviewed evaluations
ucc-research-eval-sctab-seed-celltypist; ucc-research-eval-sctab-seed-ciform; ucc-research-eval-sctab-seed-linear; ucc-research-eval-sctab-seed-mlp; ucc-research-eval-sctab-seed-scgpt-ft; ucc-research-eval-sctab-seed-scgpt-zero; ucc-research-eval-sctab-seed-sctab; ucc-research-eval-sctab-seed-uce; ucc-research-eval-sctab-seed-xgboost
pins
record id: ucc-research-eval-sctab-seed-celltypist; fields: status; links; attributes.origin; attributes.comparison; sha256: df266944f21190f407b9cce655ed28f0b036f3b6a4fdd897d8541200e01338a1; record id: ucc-research-eval-sctab-seed-ciform; fields: status; links; attributes.origin; attributes.comparison; sha256: 0320c9b6f7bb8f42e2d36f6e47332a9a9d69980648c882f1575e788b047d0215; record id: ucc-research-eval-sctab-seed-linear; fields: status; links; attributes.origin; attributes.comparison; sha256: 779bd569cf1451546b5f5734ec13049dac2bb177936aa7c3c6a95d708552c295; record id: ucc-research-eval-sctab-seed-mlp; fields: status; links; attributes.origin; attributes.comparison; sha256: dd9e22b11a9aec9ad2cd2a3ffc6cef64e1ab7450b93086b45be79c5b55460ca2; record id: ucc-research-eval-sctab-seed-scgpt-ft; fields: status; links; attributes.origin; attributes.comparison; sha256: cbc0f086646bb462551103576fdfbbfd8e04d42214ee824a311bf8639be7262d; record id: ucc-research-eval-sctab-seed-scgpt-zero; fields: status; links; attributes.origin; attributes.comparison; sha256: c3271d0efd9c34e0c3b2245a6ee435c8bfdde830591705da895f1dd493f0f66b; record id: ucc-research-eval-sctab-seed-sctab; fields: status; links; attributes.origin; attributes.comparison; sha256: aafa1ce1736f416d1521ce6648f8f58ca1795ac54fdefd4110a5e530bacfab25; record id: ucc-research-eval-sctab-seed-uce; fields: status; links; attributes.origin; attributes.comparison; sha256: 4fceb4f9f0a7623005c845505013713ce8fa68a02e31266d3f78cd85b8395903; record id: ucc-research-eval-sctab-seed-xgboost; fields: status; links; attributes.origin; attributes.comparison; sha256: fa3d5e30252efce061410ce8985d0487d478bc12aad56fa7c55556e5e8edeccc; record id: ucc-research-protocol-sctab-seed; fields: status; name; description; facets; source_ids; links; attributes; sha256: 96a496d6fdf585e8b9374011d6af2dba99b579dc72c863b14e27da77e03113bf; record id: ucc-research-result-sctab-seed-celltypist-macro-f1; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 63295ff011143bd12b9f1f3cc60ce1f51850d97141306dc822aa7dc00546ef22; record id: ucc-research-result-sctab-seed-ciform-macro-f1; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 731c4c5b339d350edaa2bffb76f46a19f5f09759ec1da61d524884c7798fa305; record id: ucc-research-result-sctab-seed-linear-macro-f1; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 4b4ed657b4c6e848442c56f5ab81603138a8a6e1753497ca15d02b6febceb2aa; record id: ucc-research-result-sctab-seed-mlp-macro-f1; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 7df33a62d69ee36797f0f7f517722766b9bf4a51b2c5709edf710bcf374899a8; record id: ucc-research-result-sctab-seed-scgpt-ft-macro-f1; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 8fb8d08f434961bb04a047f6b1a64d2a2b3876f2a78901851dbd2556d13d0910; record id: ucc-research-result-sctab-seed-scgpt-zero-macro-f1; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 4329483d2cb40713c8d70e289519b749b2c8f1147b69cb10fd607a668f3f229a; record id: ucc-research-result-sctab-seed-sctab-macro-f1; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 766cbf3df2332cb9f80356713dfdb2a155035815a1bf5136685faa77d7646df3; record id: ucc-research-result-sctab-seed-uce-macro-f1; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: baffa7ba5b6c5646c5e9d99248e1ca364c717c39ac923003a8e594bbfc2fa2be; record id: ucc-research-result-sctab-seed-xgboost-macro-f1; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 11a940badd4c64dc35efa5f65575d25bcf3537e982cac81a79c6c79458e53956; record id: ucc-research-source-sctab-code; fields: status; attributes.artifact_sha256; sha256: 95563d32f71774da19c87df7455d74c0e22dbfe3d924973a31df538a9b9fa7c0; record id: ucc-research-source-sctab-paper; fields: status; attributes.artifact_sha256; sha256: 12a4f59860912c8db02b1d56bf33636bdaccf99273cfcca9e9375ace19e54cc4; record id: ucc-research-source-sctab-supp; fields: status; attributes.artifact_sha256; sha256: 91637ab4979e296ece4734119bd447faca72e848f18b3141533d9eabecd50517; record id: use-case-cell-type-annotation-transfer; fields: status; name; description; facets; attributes.question; attributes.decision; attributes.inputs; attributes.output; attributes.exclusions; attributes.setting; attributes.clinical_scope; attributes.intended_users; sha256: f4ef70c0d86c1d3ea8ff8600431eb0792da0bd5f355e7137bc364a42aa284bd9
Related records

Suggest a correction