Respiratory virus detection against PCR, species level, read-count cut-off 10 (Carbo et al. 2022 Supplementary Table 1)
Per-classifier detection of 13 PCR-tested respiratory viruses in 88 nasal washings, scored against 1144 PCR results.
Overview
Per-classifier detection of 13 PCR-tested respiratory viruses in 88 nasal washings, scored against 1144 PCR results.
Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.
15 recorded evaluations, 165 metric rows. A comparison chart has not yet been validated for these results. The table retains the individual findings and their sources.
Results
Results are available, but no reviewed comparison panel is linked in this release.
All evaluations
15 evaluations · 165 results. Different protocols are not a single leaderboard.
Filter evaluations
Applied filters: All linked evaluations
| Tested configuration | Protocol and dataset | Finding | Evidence and details |
|---|---|---|---|
| Configuration: Centrifuge, human reads removed (Bowtie2 to GRCh38) before classification (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, species level, read-count cut-off 10 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 0.935 auroc unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-species-cutoff-10 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Species', block 'excl. human reads', cell S23, row 'Centrifuge', column 'AUC' |
| Configuration: Centrifuge, human reads removed (Bowtie2 to GRCh38) before classification (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, species level, read-count cut-off 10 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 32.5 regression-intercept unitless · unknown Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-species-cutoff-10 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Species', block 'excl. human reads', cell Y23, row 'Centrifuge', column 'LR intercept' |
| Configuration: Centrifuge, human reads removed (Bowtie2 to GRCh38) before classification (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, species level, read-count cut-off 10 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 14.2% pearson-r-squared percent · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-species-cutoff-10 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Species', block 'excl. human reads', cell Z23, row 'Centrifuge', column 'LR r2, %' |
| Configuration: Centrifuge, human reads removed (Bowtie2 to GRCh38) before classification (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, species level, read-count cut-off 10 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | -1.3 regression-slope unitless · unknown Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-species-cutoff-10 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Species', block 'excl. human reads', cell X23, row 'Centrifuge', column 'LR slope' |
| Configuration: Centrifuge, human reads removed, and assigned read counts normalised by target genome length (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, species level, read-count cut-off 10 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 0.562 auroc unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-species-cutoff-10 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Species', block 'excl. human reads and normalized', cell S31, row 'Centrifuge', column 'AUC' |
| Configuration: Centrifuge, human reads removed, and assigned read counts normalised by target genome length (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, species level, read-count cut-off 10 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 32.5 regression-intercept unitless · unknown Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-species-cutoff-10 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Species', block 'excl. human reads and normalized', cell Y31, row 'Centrifuge', column 'LR intercept' |
| Configuration: Centrifuge, human reads removed, and assigned read counts normalised by target genome length (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, species level, read-count cut-off 10 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 10.6% pearson-r-squared percent · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-species-cutoff-10 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Species', block 'excl. human reads and normalized', cell Z31, row 'Centrifuge', column 'LR r2, %' |
| Configuration: Centrifuge, human reads removed, and assigned read counts normalised by target genome length (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, species level, read-count cut-off 10 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | -5.21 regression-slope unitless · unknown Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-species-cutoff-10 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Species', block 'excl. human reads and normalized', cell X31, row 'Centrifuge', column 'LR slope' |
| Configuration: Centrifuge, human reads removed, and assigned read counts normalised by target genome length (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, species level, read-count cut-off 10 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 0.973 negative-predictive-value fraction · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-species-cutoff-10 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Species', block 'excl. human reads and normalized', cell W31, row 'Centrifuge', column 'NPV (ROC)' |
| Configuration: Centrifuge, human reads removed, and assigned read counts normalised by target genome length (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, species level, read-count cut-off 10 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 0.75 precision fraction · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-species-cutoff-10 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Species', block 'excl. human reads and normalized', cell V31, row 'Centrifuge', column 'PPV (ROC)' |
| Configuration: Centrifuge, human reads removed, and assigned read counts normalised by target genome length (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, species level, read-count cut-off 10 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 0.875 roc-distance unitless · lower Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-species-cutoff-10 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Species', block 'excl. human reads and normalized', cell R31, row 'Centrifuge', column 'Informedness' |
| Configuration: Centrifuge, human reads removed, and assigned read counts normalised by target genome length (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, species level, read-count cut-off 10 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 0.125 recall fraction · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-species-cutoff-10 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Species', block 'excl. human reads and normalized', cell T31, row 'Centrifuge', column 'SN (ROC)' |
| Configuration: Centrifuge, human reads removed, and assigned read counts normalised by target genome length (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, species level, read-count cut-off 10 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 0.999 specificity fraction · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-species-cutoff-10 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Species', block 'excl. human reads and normalized', cell U31, row 'Centrifuge', column 'SL (ROC)' |
| Configuration: Centrifuge, human reads removed, and assigned read counts normalised by target genome length (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, species level, read-count cut-off 10 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 17 count count · unknown Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-species-cutoff-10 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Species', block 'excl. human reads and normalized', cell AA31, row 'Centrifuge', column 'Taxa' |
| Configuration: Centrifuge, human reads removed, and assigned read counts normalised by target genome length (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, species level, read-count cut-off 10 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 17 count count · unknown Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-species-cutoff-10 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Species', block 'excl. human reads and normalized', cell AB31, row 'Centrifuge', column 'Taxa with reads >10' |
| Configuration: Centrifuge, human reads removed (Bowtie2 to GRCh38) before classification (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, species level, read-count cut-off 10 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 0.996 negative-predictive-value fraction · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-species-cutoff-10 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Species', block 'excl. human reads', cell W23, row 'Centrifuge', column 'NPV (ROC)' |
| Configuration: Centrifuge, human reads removed (Bowtie2 to GRCh38) before classification (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, species level, read-count cut-off 10 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 0.875 precision fraction · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-species-cutoff-10 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Species', block 'excl. human reads', cell V23, row 'Centrifuge', column 'PPV (ROC)' |
| Configuration: Centrifuge, human reads removed (Bowtie2 to GRCh38) before classification (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, species level, read-count cut-off 10 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 0.125 roc-distance unitless · lower Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-species-cutoff-10 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Species', block 'excl. human reads', cell R23, row 'Centrifuge', column 'Informedness' |
| Configuration: Centrifuge, human reads removed (Bowtie2 to GRCh38) before classification (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, species level, read-count cut-off 10 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 0.875 recall fraction · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-species-cutoff-10 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Species', block 'excl. human reads', cell T23, row 'Centrifuge', column 'SN (ROC)' |
| Configuration: Centrifuge, human reads removed (Bowtie2 to GRCh38) before classification (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, species level, read-count cut-off 10 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 0.996 specificity fraction · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-species-cutoff-10 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Species', block 'excl. human reads', cell U23, row 'Centrifuge', column 'SL (ROC)' |
| Configuration: Centrifuge, human reads removed (Bowtie2 to GRCh38) before classification (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, species level, read-count cut-off 10 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 17 count count · unknown Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-species-cutoff-10 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Species', block 'excl. human reads', cell AA23, row 'Centrifuge', column 'Taxa' |
| Configuration: Centrifuge, human reads removed (Bowtie2 to GRCh38) before classification (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, species level, read-count cut-off 10 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 17 count count · unknown Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-species-cutoff-10 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Species', block 'excl. human reads', cell AB23, row 'Centrifuge', column 'Taxa with reads >10' |
| Configuration: Centrifuge, all trimmed reads (human reads included) (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, species level, read-count cut-off 10 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 0.934 auroc unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-species-cutoff-10 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Species', block 'incl. human reads', cell S10, row 'Centrifuge', column 'AUC' |
| Configuration: Centrifuge, all trimmed reads (human reads included) (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, species level, read-count cut-off 10 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 32.5 regression-intercept unitless · unknown Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-species-cutoff-10 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Species', block 'incl. human reads', cell Y10, row 'Centrifuge', column 'LR intercept' |
| Configuration: Centrifuge, all trimmed reads (human reads included) (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, species level, read-count cut-off 10 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 14.2% pearson-r-squared percent · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-species-cutoff-10 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Species', block 'incl. human reads', cell Z10, row 'Centrifuge', column 'LR r2, %' |
Source checking is not independent reproduction. Release 2026-10-09-ba02f2f4a36e.
Methods and evaluation design
Procedure, tasks and evaluated configurations
Recorded evaluations
Each evaluation records what was tested and under which conditions.
- Centrifuge, human reads removed (Bowtie2 to GRCh38) before classification: species level, read-count cut-off 10 (Carbo et al. 2022)
- Centrifuge, human reads removed, and assigned read counts normalised by target genome length: species level, read-count cut-off 10 (Carbo et al. 2022)
- Centrifuge, all trimmed reads (human reads included): species level, read-count cut-off 10 (Carbo et al. 2022)
- CLARK, human reads removed (Bowtie2 to GRCh38) before classification: species level, read-count cut-off 10 (Carbo et al. 2022)
- CLARK, human reads removed, and assigned read counts normalised by target genome length: species level, read-count cut-off 10 (Carbo et al. 2022)
- CLARK, all trimmed reads (human reads included): species level, read-count cut-off 10 (Carbo et al. 2022)
- Genome Detective, human reads removed (Bowtie2 to GRCh38) before classification: species level, read-count cut-off 10 (Carbo et al. 2022)
- Genome Detective, human reads removed, and assigned read counts normalised by target genome length: species level, read-count cut-off 10 (Carbo et al. 2022)
- Genome Detective, all trimmed reads (human reads included): species level, read-count cut-off 10 (Carbo et al. 2022)
- Kaiju, human reads removed (Bowtie2 to GRCh38) before classification: species level, read-count cut-off 10 (Carbo et al. 2022)
- Kaiju, human reads removed, and assigned read counts normalised by target genome length: species level, read-count cut-off 10 (Carbo et al. 2022)
- Kaiju, all trimmed reads (human reads included): species level, read-count cut-off 10 (Carbo et al. 2022)
Baseline coverage
Reference methods help show what a model adds beyond simple controls. We track a null control and a conventional method for each protocol.
0 of 2 active baseline roles have published Rewire measurements in this release. Measurements on a selected protocol do not establish coverage of an entire suite.
No execution recipe linked to this protocol. Recipe availability does not establish a completed evaluation.
- External evaluations
- 15
Literature evidence is not a Rewire measurement. Executed but unpublished runs and private review status are not included.
Null control
Proposed control: requires review
Training-set class prior where supervised fitting is permitted
Protocol-specific applicability, permitted inputs, access, split, evaluator and execution requirements need review before implementation or execution.
This is a suggested selection rule, not a validated method or a measured score.
Conventional reference
Proposed control: requires review
Regularised classifier on simple permitted features, or protocol's conventional reference
Protocol-specific applicability, permitted inputs, access, split, evaluator and execution requirements need review before implementation or execution.
This is a suggested selection rule, not a validated method or a measured score.
Protocol coverage CSV (gzip) · Model evaluation matrix (gzip) · Source table (gzip) · Release and checksums (gzip)
Coverage is derived from release 2026-10-09-ba02f2f4a36e. Source citations describe the original records; they do not validate an unreviewed baseline proposal. No results have been generated by this audit.
Run instructions
No runnable recipe has been reviewed for this protocol. Dataset access, model requirements, licences and compute requirements must be checked against its sources before execution.
Strengths, limitations and unresolved questions
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
0 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|
No evidence rows match these filters. Choose another scope or clear the search.
Sources and history
Release 2026-10-09-ba02f2f4a36e · Record review: source checked
2 source records and release history
- Performance of Five Metagenomic Classifiers for Virus Pathogen Detection Using Respiratory Samples from a Clinical Cohort · Original source · Pathogens 11(3):340, published 2022-03-11; PMC8953373 full-text XML
- Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Original source · medRxiv 2022.01.21.22269647 version 1 (2022-01-21), supplementary file media-1.xlsx
Technical metadata and extraction receipts
Stable ID: rna-pathogen-20261009-protocol-carbo2022-species-cutoff-10
- areas
- microbes-communities
- contexts
- clinical_research
- protocol
- ROC curves over the read count used as the cut-off for a positive result (1000 steps from one read to the maximum per PCR target and sample); sensitivity (SN), selectivity (SL, specificity), PPV and NPV at the ROC-selected point, AUC, and the ROC distance to the error-free point, against 24 positive and 1120 negative PCR results; linear regression of assigned read counts against PCR Ct values. Assignment at species level; the supplement labels this block 'read-count cut-off 10' without further definition.
- version
- Supplementary Table 1, Species level, read-count cut-off 10
- denominator
- 1144
- source locator
- Section 2.7; Supplementary Table 1 sheet notes (rows 1-3)
- limitations
- Single cohort; 24 PCR-positive results.; The meaning of the 0 and 10 read cut-offs alongside the ROC-selected threshold is not defined beyond the sheet note.; Out-of-panel viruses are not scored.
- missing metadata
- uncertainty: reason: unreported
Related records
- uses data: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022)
- assessment: Centrifuge, human reads removed (Bowtie2 to GRCh38) before classification: species level, read-count cut-off 10 (Carbo et al. 2022)
- assessment: Centrifuge, human reads removed, and assigned read counts normalised by target genome length: species level, read-count cut-off 10 (Carbo et al. 2022)
- assessment: Centrifuge, all trimmed reads (human reads included): species level, read-count cut-off 10 (Carbo et al. 2022)
- assessment: CLARK, human reads removed (Bowtie2 to GRCh38) before classification: species level, read-count cut-off 10 (Carbo et al. 2022)
- assessment: CLARK, human reads removed, and assigned read counts normalised by target genome length: species level, read-count cut-off 10 (Carbo et al. 2022)
- assessment: CLARK, all trimmed reads (human reads included): species level, read-count cut-off 10 (Carbo et al. 2022)
- assessment: Genome Detective, human reads removed (Bowtie2 to GRCh38) before classification: species level, read-count cut-off 10 (Carbo et al. 2022)
- assessment: Genome Detective, human reads removed, and assigned read counts normalised by target genome length: species level, read-count cut-off 10 (Carbo et al. 2022)
- assessment: Genome Detective, all trimmed reads (human reads included): species level, read-count cut-off 10 (Carbo et al. 2022)
- assessment: Kaiju, human reads removed (Bowtie2 to GRCh38) before classification: species level, read-count cut-off 10 (Carbo et al. 2022)
- assessment: Kaiju, human reads removed, and assigned read counts normalised by target genome length: species level, read-count cut-off 10 (Carbo et al. 2022)
- assessment: Kaiju, all trimmed reads (human reads included): species level, read-count cut-off 10 (Carbo et al. 2022)
- assessment: Kraken2, human reads removed (Bowtie2 to GRCh38) before classification: species level, read-count cut-off 10 (Carbo et al. 2022)
- assessment: Kraken2, human reads removed, and assigned read counts normalised by target genome length: species level, read-count cut-off 10 (Carbo et al. 2022)
- assessment: Kraken2, all trimmed reads (human reads included): species level, read-count cut-off 10 (Carbo et al. 2022)
- assessed by: Select an RNA pathogen-detection workflow for diagnostic testing