Tan et al., Nature Communications 15, 9016 (2024)
Tan et al., Nature Communications 15, 9016 (2024) · Peer-reviewed
What this source contributed
Records in this release that cite this source. A record can cite several sources.
Results
Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.
| Model or configuration | Metric | Value | Dataset | Evaluation |
|---|---|---|---|---|
| UCSF respiratory RNA mNGS original-testing sensitivity tested configuration | Recall (reference: original rvp testing) | 93.6% (103 of 110) percent | UCSF respiratory RNA mNGS original-testing sensitivity cohort | UCSF respiratory RNA mNGS original-testing sensitivity |
Claims
Statements this source supports, each with where in the source it was checked.
- Evidence summary: RNA pathogen detection workflows: Summary The single-assay results are a UCSF respiratory RNA metagenomic assay at 93.6% (103 of 110) sensitivity against original clinical respiratory panel testing, as reported by its developers, and the developers' own prospective validation of an Oxford nanopore workflow on 344 nasopharyngeal swabs (preprint). With thresholds fixed on a separate derivation set, the nanopore workflow detected 51% (133 of 260) of PCR-positive targets in the samples passing quality control, from 85% for RSV to 19% for rhinovirus/enterovirus, and 99.8% of PCR-negative targets were not detected; criteria chosen after the validation raised sensitivity to 58%, and the authors attributed all nine false positives to barcode crossover. Its swabs were selected mostly as PCR-positive at Ct 30 or below, with about one negative per eight positives, and reads were matched only to the 23 panel pathogens, so it does not test detection outside the panel. Three comparisons of several workflows add proxy evidence. On 88 nasal washings scored against 1144 respiratory virus PCR results (Carbo et al. 2022), all five classifiers detected 22 or 23 of the 24 PCR-positive results at species level at a read-count cut-off chosen on the same data, but 31% to 58% of their positive calls were PCR-negative. When 13 European clinical virology laboratories each ran their own pipeline on the same 13 clinical datasets (de Vries et al. 2021, preprint), 10 to 13 samples were correctly called positive, and the three pipelines that found every sample reported 6, 2 and 0 additional PCR-negative viruses. In the CAMI II blood metagenome challenge (Meyer et al. 2022), 4 of 10 submissions listed the causal virus. In a developer benchmark of five virus profilers on one shared database (Tisza et al. 2026, preprint), the model-estimated probability of reporting the correct family for reads from seven divergent viruses at 10 read pairs was 0.974 for EsViritu and 0.9998 for Metabuli but 0.045 for Kraken2, 0.012 for Centrifuger and 0.0009 for Sylph at the authors' headline settings, and Metabuli reported a median of 18 false species in seven pathogen-free libraries against 0 for EsViritu. None of this is clinical validation: the cohorts are small or single-site, reference databases and reporting rules differ, and the benchmark data are mostly synthetic. (amp-20261007-rna-pathogens-source: result amp-20261007-rna-pathogens-result; rna-pathogen-20261009-source-carbo2022-supp: Supplementary Table 1; rna-pathogen-20261009-source-devries2021-supp: Supplementary Tables 2 and 4; rna-pathogen-20261009-source-meyer2022-supp: Supplementary Table 39; articles: Methods and Results; rna-pathogen-20261011-sanderson2026-source: Results 'Validation Set: Diagnostic performance', 'Performance by pathogen'; rna-pathogen-20261011-tisza2026-source-supp: Supplemental Tables S2 and S6)
- Relevance of UCSF respiratory RNA mNGS original-testing sensitivity protocol to "Select an RNA pathogen-detection workflow for diagnostic testing": Assessed by UCSF respiratory RNA mNGS original-testing sensitivity protocol (amp-20261007-rna-pathogens-source: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/)
Models, benchmarks and other records
Configurations (1)
Protocols (1)
Datasets (1)
Evaluations (1)
Use cases (1)
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
22 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| Archive sha256 2ad9102005dc8eafead9a32ee24e429cd75055c6c0a07c1bbd8c94119e871814 Source metadata | Tan et al., Nature Communications 15, 9016 (2024) No field-specific location recorded Version: Tan et al., Nature Communications 15, 9016 (2024) | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Artifact SHA-256 4b701cdeaf16c948591a34576390dbaed033a123ea9c8bace661b6822889abf6 Source metadata | Tan et al., Nature Communications 15, 9016 (2024) No field-specific location recorded Version: Tan et al., Nature Communications 15, 9016 (2024) | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Doi 10.1038/s41467-024-51470-y Source metadata | Tan et al., Nature Communications 15, 9016 (2024) No field-specific location recorded Version: Tan et al., Nature Communications 15, 9016 (2024) | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Licence CC-BY-4.0 Source metadata | Tan et al., Nature Communications 15, 9016 (2024) No field-specific location recorded Version: Tan et al., Nature Communications 15, 9016 (2024) | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Media type application/octet-stream Source metadata | Tan et al., Nature Communications 15, 9016 (2024) No field-specific location recorded Version: Tan et al., Nature Communications 15, 9016 (2024) | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Original artifact sha256 4b701cdeaf16c948591a34576390dbaed033a123ea9c8bace661b6822889abf6 Source metadata | Tan et al., Nature Communications 15, 9016 (2024) No field-specific location recorded Version: Tan et al., Nature Communications 15, 9016 (2024) | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Publication status peer_reviewed Source metadata | Tan et al., Nature Communications 15, 9016 (2024) No field-specific location recorded Version: Tan et al., Nature Communications 15, 9016 (2024) | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Retrieved at 2026-10-07T12:24:59.206377+00:00 Source metadata | Tan et al., Nature Communications 15, 9016 (2024) No field-specific location recorded Version: Tan et al., Nature Communications 15, 9016 (2024) | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Review artifact format original_source_artifact Source metadata | Tan et al., Nature Communications 15, 9016 (2024) No field-specific location recorded Version: Tan et al., Nature Communications 15, 9016 (2024) | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Review artifact matches original artifact sha256 true Source metadata | Tan et al., Nature Communications 15, 9016 (2024) No field-specific location recorded Version: Tan et al., Nature Communications 15, 9016 (2024) | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Sources and history
Release 2026-11-21-c8bea25e5abb · Record review: source checked
Tan et al., Nature Communications 15, 9016 (2024); bounded primary-source candidate.
Technical metadata and extraction receipts
Stable ID: amp-20261007-rna-pathogens-source
- areas
- rna-transcriptomes
- method types
- conventional_pipeline
- tasks
- pathogen_detection
- archive sha256
- 2ad9102005dc8eafead9a32ee24e429cd75055c6c0a07c1bbd8c94119e871814
- artifact sha256
- 4b701cdeaf16c948591a34576390dbaed033a123ea9c8bace661b6822889abf6
- doi
- 10.1038/s41467-024-51470-y
- licence
- CC-BY-4.0
- media type
- application/octet-stream
- original artifact sha256
- 4b701cdeaf16c948591a34576390dbaed033a123ea9c8bace661b6822889abf6
- publication status
- peer_reviewed
- retrieved at
- 2026-10-07T12:24:59.206377+00:00
- review artifact
- data/omics/amp-coverage-20261007/pathogens-fragmentomics/rna.raw.gz
- review artifact format
- original_source_artifact
- review artifact matches original artifact sha256
- true
- url
- https://www.ebi.ac.uk/europepmc/webservices/rest/PMC11558004/fullTextXML
- version
- Tan et al., Nature Communications 15, 9016 (2024)