rewirebio.iobenchmarks
Source

Tan et al., Nature Communications 15, 9016 (2024)

Tan et al., Nature Communications 15, 9016 (2024) · Peer-reviewed

DOI: 10.1038/s41467-024-51470-yOriginal source

What this source contributed

Records in this release that cite this source. A record can cite several sources.

Results

Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.

Claims

Statements this source supports, each with where in the source it was checked.

  • Evidence summary: RNA pathogen detection workflows: Summary The single-assay results are a UCSF respiratory RNA metagenomic assay at 93.6% (103 of 110) sensitivity against original clinical respiratory panel testing, as reported by its developers, and the developers' own prospective validation of an Oxford nanopore workflow on 344 nasopharyngeal swabs (preprint). With thresholds fixed on a separate derivation set, the nanopore workflow detected 51% (133 of 260) of PCR-positive targets in the samples passing quality control, from 85% for RSV to 19% for rhinovirus/enterovirus, and 99.8% of PCR-negative targets were not detected; criteria chosen after the validation raised sensitivity to 58%, and the authors attributed all nine false positives to barcode crossover. Its swabs were selected mostly as PCR-positive at Ct 30 or below, with about one negative per eight positives, and reads were matched only to the 23 panel pathogens, so it does not test detection outside the panel. Three comparisons of several workflows add proxy evidence. On 88 nasal washings scored against 1144 respiratory virus PCR results (Carbo et al. 2022), all five classifiers detected 22 or 23 of the 24 PCR-positive results at species level at a read-count cut-off chosen on the same data, but 31% to 58% of their positive calls were PCR-negative. When 13 European clinical virology laboratories each ran their own pipeline on the same 13 clinical datasets (de Vries et al. 2021, preprint), 10 to 13 samples were correctly called positive, and the three pipelines that found every sample reported 6, 2 and 0 additional PCR-negative viruses. In the CAMI II blood metagenome challenge (Meyer et al. 2022), 4 of 10 submissions listed the causal virus. In a developer benchmark of five virus profilers on one shared database (Tisza et al. 2026, preprint), the model-estimated probability of reporting the correct family for reads from seven divergent viruses at 10 read pairs was 0.974 for EsViritu and 0.9998 for Metabuli but 0.045 for Kraken2, 0.012 for Centrifuger and 0.0009 for Sylph at the authors' headline settings, and Metabuli reported a median of 18 false species in seven pathogen-free libraries against 0 for EsViritu. None of this is clinical validation: the cohorts are small or single-site, reference databases and reporting rules differ, and the benchmark data are mostly synthetic. (amp-20261007-rna-pathogens-source: result amp-20261007-rna-pathogens-result; rna-pathogen-20261009-source-carbo2022-supp: Supplementary Table 1; rna-pathogen-20261009-source-devries2021-supp: Supplementary Tables 2 and 4; rna-pathogen-20261009-source-meyer2022-supp: Supplementary Table 39; articles: Methods and Results; rna-pathogen-20261011-sanderson2026-source: Results 'Validation Set: Diagnostic performance', 'Performance by pathogen'; rna-pathogen-20261011-tisza2026-source-supp: Supplemental Tables S2 and S6)
  • Relevance of UCSF respiratory RNA mNGS original-testing sensitivity protocol to "Select an RNA pathogen-detection workflow for diagnostic testing": Assessed by UCSF respiratory RNA mNGS original-testing sensitivity protocol (amp-20261007-rna-pathogens-source: See clinical/claims.csv and clinical/sources.md in data/omics/use-case-coverage-amp-20261007/)

Models, benchmarks and other records

Configurations (1)

Protocols (1)

Datasets (1)

Evaluations (1)

Use cases (1)

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

22 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Archive sha256
2ad9102005dc8eafead9a32ee24e429cd75055c6c0a07c1bbd8c94119e871814
Source metadata
Tan et al., Nature Communications 15, 9016 (2024)

Original source ↗

No field-specific location recorded

Version: Tan et al., Nature Communications 15, 9016 (2024)
Retrieved: 2026-10-07T12:24:59.206377+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.archive_sha256

Source artifact SHA-256: 4b701cdeaf16c948591a34576390dbaed033a123ea9c8bace661b6822889abf6

Hash scope: Hash scope not separately documented; inspect source record

Artifact SHA-256
4b701cdeaf16c948591a34576390dbaed033a123ea9c8bace661b6822889abf6
Source metadata
Tan et al., Nature Communications 15, 9016 (2024)

Original source ↗

No field-specific location recorded

Version: Tan et al., Nature Communications 15, 9016 (2024)
Retrieved: 2026-10-07T12:24:59.206377+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_sha256

Source artifact SHA-256: 4b701cdeaf16c948591a34576390dbaed033a123ea9c8bace661b6822889abf6

Hash scope: Hash scope not separately documented; inspect source record

Doi
10.1038/s41467-024-51470-y
Source metadata
Tan et al., Nature Communications 15, 9016 (2024)

Original source ↗

No field-specific location recorded

Version: Tan et al., Nature Communications 15, 9016 (2024)
Retrieved: 2026-10-07T12:24:59.206377+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.doi

Source artifact SHA-256: 4b701cdeaf16c948591a34576390dbaed033a123ea9c8bace661b6822889abf6

Hash scope: Hash scope not separately documented; inspect source record

Licence
CC-BY-4.0
Source metadata
Tan et al., Nature Communications 15, 9016 (2024)

Original source ↗

No field-specific location recorded

Version: Tan et al., Nature Communications 15, 9016 (2024)
Retrieved: 2026-10-07T12:24:59.206377+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.licence

Source artifact SHA-256: 4b701cdeaf16c948591a34576390dbaed033a123ea9c8bace661b6822889abf6

Hash scope: Hash scope not separately documented; inspect source record

Media type
application/octet-stream
Source metadata
Tan et al., Nature Communications 15, 9016 (2024)

Original source ↗

No field-specific location recorded

Version: Tan et al., Nature Communications 15, 9016 (2024)
Retrieved: 2026-10-07T12:24:59.206377+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.media_type

Source artifact SHA-256: 4b701cdeaf16c948591a34576390dbaed033a123ea9c8bace661b6822889abf6

Hash scope: Hash scope not separately documented; inspect source record

Original artifact sha256
4b701cdeaf16c948591a34576390dbaed033a123ea9c8bace661b6822889abf6
Source metadata
Tan et al., Nature Communications 15, 9016 (2024)

Original source ↗

No field-specific location recorded

Version: Tan et al., Nature Communications 15, 9016 (2024)
Retrieved: 2026-10-07T12:24:59.206377+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.original_artifact_sha256

Source artifact SHA-256: 4b701cdeaf16c948591a34576390dbaed033a123ea9c8bace661b6822889abf6

Hash scope: Hash scope not separately documented; inspect source record

Publication status
peer_reviewed
Source metadata
Tan et al., Nature Communications 15, 9016 (2024)

Original source ↗

No field-specific location recorded

Version: Tan et al., Nature Communications 15, 9016 (2024)
Retrieved: 2026-10-07T12:24:59.206377+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.publication_status

Source artifact SHA-256: 4b701cdeaf16c948591a34576390dbaed033a123ea9c8bace661b6822889abf6

Hash scope: Hash scope not separately documented; inspect source record

Retrieved at
2026-10-07T12:24:59.206377+00:00
Source metadata
Tan et al., Nature Communications 15, 9016 (2024)

Original source ↗

No field-specific location recorded

Version: Tan et al., Nature Communications 15, 9016 (2024)
Retrieved: 2026-10-07T12:24:59.206377+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.retrieved_at

Source artifact SHA-256: 4b701cdeaf16c948591a34576390dbaed033a123ea9c8bace661b6822889abf6

Hash scope: Hash scope not separately documented; inspect source record

Review artifact format
original_source_artifact
Source metadata
Tan et al., Nature Communications 15, 9016 (2024)

Original source ↗

No field-specific location recorded

Version: Tan et al., Nature Communications 15, 9016 (2024)
Retrieved: 2026-10-07T12:24:59.206377+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.review_artifact_format

Source artifact SHA-256: 4b701cdeaf16c948591a34576390dbaed033a123ea9c8bace661b6822889abf6

Hash scope: Hash scope not separately documented; inspect source record

Review artifact matches original artifact sha256
true
Source metadata
Tan et al., Nature Communications 15, 9016 (2024)

Original source ↗

No field-specific location recorded

Version: Tan et al., Nature Communications 15, 9016 (2024)
Retrieved: 2026-10-07T12:24:59.206377+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.review_artifact_matches_original_artifact_sha256

Source artifact SHA-256: 4b701cdeaf16c948591a34576390dbaed033a123ea9c8bace661b6822889abf6

Hash scope: Hash scope not separately documented; inspect source record

How to read the evidence

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

Tan et al., Nature Communications 15, 9016 (2024); bounded primary-source candidate.

Release history

No supporting source is linked yet.

Read original source

Download this release (gzip)
Technical metadata and extraction receipts

Stable ID: amp-20261007-rna-pathogens-source

areas
rna-transcriptomes
method types
conventional_pipeline
tasks
pathogen_detection
archive sha256
2ad9102005dc8eafead9a32ee24e429cd75055c6c0a07c1bbd8c94119e871814
artifact sha256
4b701cdeaf16c948591a34576390dbaed033a123ea9c8bace661b6822889abf6
doi
10.1038/s41467-024-51470-y
licence
CC-BY-4.0
media type
application/octet-stream
original artifact sha256
4b701cdeaf16c948591a34576390dbaed033a123ea9c8bace661b6822889abf6
publication status
peer_reviewed
retrieved at
2026-10-07T12:24:59.206377+00:00
review artifact
data/omics/amp-coverage-20261007/pathogens-fragmentomics/rna.raw.gz
review artifact format
original_source_artifact
review artifact matches original artifact sha256
true
url
https://www.ebi.ac.uk/europepmc/webservices/rest/PMC11558004/fullTextXML
version
Tan et al., Nature Communications 15, 9016 (2024)
Related records

    Suggest a correction