rewirebio.iobenchmarks
Evidence claim

Relevance of UCSF respiratory RNA mNGS original-testing sensitivity protocol to "Select an RNA pathogen-detection workflow for diagnostic testing"

Use case
Select an RNA pathogen-detection workflow for diagnostic testing
Assessed by
UCSF respiratory RNA mNGS original-testing sensitivity protocol
Relevance
Proxy evidence
Endpoint
Sensitivity against original clinical respiratory-virus-panel testing (103/110, 93.6%) for RNA mNGS on a residual-sample pre-DTCA mixed respiratory-target cohort, adenovirus transcripts included

Sensitivity against original clinical RVP testing (RNA extraction, DNase treatment, cDNA synthesis; mixed respiratory-virus target panel including transcriptionally detected adenovirus) is a proxy for the declared RNA-pathogen diagnostic-accuracy decision: the specimen prep is an RNA workflow, not a mixed DNA/RNA sample-prep comparison, and this is not an RNA-virus-only subgroup score. The conflicting composite PPA figure (98.7%, 110.5/113) is excluded.

1 reviewed evaluation

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

15 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Citation locations
1 values
  • source id
    amp-20261007-rna-pathogens-source
    locator
    See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/
Context-only references
Tan et al., Nature Communications 15, 9016 (2024)

Original source ↗

amp-20261007-rna-pathogens-source: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: Tan et al., Nature Communications 15, 9016 (2024)
Retrieved: 2026-10-07T12:24:59.206377+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.citation_locators

Source artifact SHA-256: 4b701cdeaf16c948591a34576390dbaed033a123ea9c8bace661b6822889abf6

Hash scope: Hash scope not separately documented; inspect source record

Constraints
2 values
  • Inspect every linked evaluation's source locator and preserved conflicts before citing a result.
  • Do not combine this mapping's evaluations with any other protocol's results.
Context-only references
Tan et al., Nature Communications 15, 9016 (2024)

Original source ↗

amp-20261007-rna-pathogens-source: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: Tan et al., Nature Communications 15, 9016 (2024)
Retrieved: 2026-10-07T12:24:59.206377+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.constraints

Source artifact SHA-256: 4b701cdeaf16c948591a34576390dbaed033a123ea9c8bace661b6822889abf6

Hash scope: Hash scope not separately documented; inspect source record

Endpoint
Sensitivity against original clinical respiratory-virus-panel testing (103/110, 93.6%) for RNA mNGS on a residual-sample pre-DTCA mixed respiratory-target cohort, adenovirus transcripts included
Context-only references
Tan et al., Nature Communications 15, 9016 (2024)

Original source ↗

amp-20261007-rna-pathogens-source: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: Tan et al., Nature Communications 15, 9016 (2024)
Retrieved: 2026-10-07T12:24:59.206377+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.endpoint

Source artifact SHA-256: 4b701cdeaf16c948591a34576390dbaed033a123ea9c8bace661b6822889abf6

Hash scope: Hash scope not separately documented; inspect source record

Claimed field
links:assessed_by:amp-20261007-rna-pathogens-protocol
Context-only references
Tan et al., Nature Communications 15, 9016 (2024)

Original source ↗

amp-20261007-rna-pathogens-source: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: Tan et al., Nature Communications 15, 9016 (2024)
Retrieved: 2026-10-07T12:24:59.206377+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.field

Source artifact SHA-256: 4b701cdeaf16c948591a34576390dbaed033a123ea9c8bace661b6822889abf6

Hash scope: Hash scope not separately documented; inspect source record

Limitations
6 values
  • RNA-only specimen preparation supports RNA pathogen-detection workflow; tested target mix includes adenovirus, a DNA virus detected via transcription. Do not describe the 93.6% as a pure RNA-virus-only subgroup score.
  • Multiple detected targets are weighted so each specimen contributes one observation; out-of-panel mNGS positive calls are not counted as false positives.
  • Positive-specimen BAL/swab count disagreement in Results vs Methods remains unresolved; total 110 positives and 81 negatives agree.
  • No confidence interval extracted for original sensitivity. After selective discrepancy adjudication, report PPA/NPA rather than sensitivity; DTCA measurements must remain separate.
  • No foundation model or independent external replication; clinical residual-sample validation study supplies conventional baseline evidence.
  • Post-DTCA printed PPA98.7% (110.5/113) is arithmetically inconsistent; no DTCA endpoint selected or corrected.
Context-only references
Tan et al., Nature Communications 15, 9016 (2024)

Original source ↗

amp-20261007-rna-pathogens-source: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: Tan et al., Nature Communications 15, 9016 (2024)
Retrieved: 2026-10-07T12:24:59.206377+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.limitations

Source artifact SHA-256: 4b701cdeaf16c948591a34576390dbaed033a123ea9c8bace661b6822889abf6

Hash scope: Hash scope not separately documented; inspect source record

Pinned records
5 values
  • record id
    amp-20261007-rna-pathogens-evaluation
    fields
    • status
    • links
    • attributes.origin
    • attributes.comparison
    sha256
    63b089b5e45283ca4551dec6e0306735252743f3498082ccb02686a71262c435
  • record id
    amp-20261007-rna-pathogens-protocol
    fields
    • status
    • name
    • description
    • facets
    • source_ids
    • links
    • attributes
    sha256
    ffbf0e70afb8de17ff480a05b0186f5b55a85ea3c057affa28920f2a0557c48c
  • record id
    amp-20261007-rna-pathogens-result
    fields
    • status
    • attributes.metric
    • attributes.metric_qualifier
    • attributes.printed_value
    • attributes.numeric_value
    sha256
    773011aed61b7bfc4c957b94521a384a1744e3ca075e7815013a99a6f15cfef2
  • record id
    amp-20261007-rna-pathogens-source
    fields
    • status
    • attributes.artifact_sha256
    sha256
    a75e7005f450b91837cce907a0aac78073361b0a20db4a61c4a1e894c1e461b4
  • record id
    use-case-diagnostic-rna-pathogen-detection
    fields
    • status
    • name
    • description
    • facets
    • attributes.question
    • attributes.decision
    • attributes.inputs
    • attributes.output
    • attributes.exclusions
    • attributes.setting
    • attributes.clinical_scope
    • attributes.intended_users
    sha256
    6b8b16df53f61fbf2ee9d4f65eb9863671985cd51f12fea5572b09972bce2aa5
Context-only references
Tan et al., Nature Communications 15, 9016 (2024)

Original source ↗

amp-20261007-rna-pathogens-source: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: Tan et al., Nature Communications 15, 9016 (2024)
Retrieved: 2026-10-07T12:24:59.206377+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.pins

Source artifact SHA-256: 4b701cdeaf16c948591a34576390dbaed033a123ea9c8bace661b6822889abf6

Hash scope: Hash scope not separately documented; inspect source record

Rationale
Sensitivity against original clinical RVP testing (RNA extraction, DNase treatment, cDNA synthesis; mixed respiratory-virus target panel including transcriptionally detected adenovirus) is a proxy for the declared RNA-pathogen diagnostic-accuracy decision: the specimen prep is an RNA workflow, not a mixed DNA/RNA sample-prep comparison, and this is not an RNA-virus-only subgroup score. The conflicting composite PPA figure (98.7%, 110.5/113) is excluded.
Context-only references
Tan et al., Nature Communications 15, 9016 (2024)

Original source ↗

amp-20261007-rna-pathogens-source: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: Tan et al., Nature Communications 15, 9016 (2024)
Retrieved: 2026-10-07T12:24:59.206377+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.rationale

Source artifact SHA-256: 4b701cdeaf16c948591a34576390dbaed033a123ea9c8bace661b6822889abf6

Hash scope: Hash scope not separately documented; inspect source record

Reason
Add Codex-checked primary-source protocol evidence from the bounded AMP intake (rewire.it#365).
Context-only references
Tan et al., Nature Communications 15, 9016 (2024)

Original source ↗

amp-20261007-rna-pathogens-source: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: Tan et al., Nature Communications 15, 9016 (2024)
Retrieved: 2026-10-07T12:24:59.206377+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.reason

Source artifact SHA-256: 4b701cdeaf16c948591a34576390dbaed033a123ea9c8bace661b6822889abf6

Hash scope: Hash scope not separately documented; inspect source record

Relevance
proxy
Context-only references
Tan et al., Nature Communications 15, 9016 (2024)

Original source ↗

amp-20261007-rna-pathogens-source: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: Tan et al., Nature Communications 15, 9016 (2024)
Retrieved: 2026-10-07T12:24:59.206377+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.relevance

Source artifact SHA-256: 4b701cdeaf16c948591a34576390dbaed033a123ea9c8bace661b6822889abf6

Hash scope: Hash scope not separately documented; inspect source record

Revision
1
Context-only references
Tan et al., Nature Communications 15, 9016 (2024)

Original source ↗

amp-20261007-rna-pathogens-source: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/

Version: Tan et al., Nature Communications 15, 9016 (2024)
Retrieved: 2026-10-07T12:24:59.206377+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.revision

Source artifact SHA-256: 4b701cdeaf16c948591a34576390dbaed033a123ea9c8bace661b6822889abf6

Hash scope: Hash scope not separately documented; inspect source record

How to read the evidence

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: use-case-mapping-amp-20261007-issue14

field
links:assessed_by:amp-20261007-rna-pathogens-protocol
value
amp-20261007-rna-pathogens-protocol
relevance
proxy
endpoint
Sensitivity against original clinical respiratory-virus-panel testing (103/110, 93.6%) for RNA mNGS on a residual-sample pre-DTCA mixed respiratory-target cohort, adenovirus transcripts included
rationale
Sensitivity against original clinical RVP testing (RNA extraction, DNase treatment, cDNA synthesis; mixed respiratory-virus target panel including transcriptionally detected adenovirus) is a proxy for the declared RNA-pathogen diagnostic-accuracy decision: the specimen prep is an RNA workflow, not a mixed DNA/RNA sample-prep comparison, and this is not an RNA-virus-only subgroup score. The conflicting composite PPA figure (98.7%, 110.5/113) is excluded.
constraints
Inspect every linked evaluation's source locator and preserved conflicts before citing a result.; Do not combine this mapping's evaluations with any other protocol's results.
limitations
RNA-only specimen preparation supports RNA pathogen-detection workflow; tested target mix includes adenovirus, a DNA virus detected via transcription. Do not describe the 93.6% as a pure RNA-virus-only subgroup score.; Multiple detected targets are weighted so each specimen contributes one observation; out-of-panel mNGS positive calls are not counted as false positives.; Positive-specimen BAL/swab count disagreement in Results vs Methods remains unresolved; total 110 positives and 81 negatives agree.; No confidence interval extracted for original sensitivity. After selective discrepancy adjudication, report PPA/NPA rather than sensitivity; DTCA measurements must remain separate.; No foundation model or independent external replication; clinical residual-sample validation study supplies conventional baseline evidence.; Post-DTCA printed PPA98.7% (110.5/113) is arithmetically inconsistent; no DTCA endpoint selected or corrected.
revision
1
reason
Add Codex-checked primary-source protocol evidence from the bounded AMP intake (rewire.it#365).
citation locators
source id: amp-20261007-rna-pathogens-source; locator: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/
source locator
amp-20261007-rna-pathogens-source: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/
review
method: automated-source-review; reviewer: codex; claude-sonnet; reviewer note: Claude Sonnet AMP-integration worker, bounded transcription of Codex-checked primary values; independently reviewed by Codex (workbench/amp-supervision/primary-review.md, integration-review-corrections.md); reviewed at: 2026-10-07T13:38:59Z; note: Bounded primary-source transcription, independently Codex-checked. No new model execution, independent experimental reproduction, qualified human scientific review or clinical validation.
reviewed evaluations
amp-20261007-rna-pathogens-evaluation
pins
record id: amp-20261007-rna-pathogens-evaluation; fields: status; links; attributes.origin; attributes.comparison; sha256: 63b089b5e45283ca4551dec6e0306735252743f3498082ccb02686a71262c435; record id: amp-20261007-rna-pathogens-protocol; fields: status; name; description; facets; source_ids; links; attributes; sha256: ffbf0e70afb8de17ff480a05b0186f5b55a85ea3c057affa28920f2a0557c48c; record id: amp-20261007-rna-pathogens-result; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 773011aed61b7bfc4c957b94521a384a1744e3ca075e7815013a99a6f15cfef2; record id: amp-20261007-rna-pathogens-source; fields: status; attributes.artifact_sha256; sha256: a75e7005f450b91837cce907a0aac78073361b0a20db4a61c4a1e894c1e461b4; record id: use-case-diagnostic-rna-pathogen-detection; fields: status; name; description; facets; attributes.question; attributes.decision; attributes.inputs; attributes.output; attributes.exclusions; attributes.setting; attributes.clinical_scope; attributes.intended_users; sha256: 6b8b16df53f61fbf2ee9d4f65eb9863671985cd51f12fea5572b09972bce2aa5
Related records

Suggest a correction