Respiratory virus detection against PCR, family level, read-count cut-off 0 (Carbo et al. 2022 Supplementary Table 1)
Per-classifier detection of 13 PCR-tested respiratory viruses in 88 nasal washings, scored against 1144 PCR results.
Overview
Per-classifier detection of 13 PCR-tested respiratory viruses in 88 nasal washings, scored against 1144 PCR results.
Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.
15 recorded evaluations, 165 metric rows. A comparison chart has not yet been validated for these results. The table retains the individual findings and their sources.
Results
Results are available, but no reviewed comparison panel is linked in this release.
All evaluations
15 evaluations · 165 results. Different protocols are not a single leaderboard.
Filter evaluations
Applied filters: All linked evaluations
| Tested configuration | Protocol and dataset | Finding | Evidence and details |
|---|---|---|---|
| Configuration: Centrifuge, human reads removed (Bowtie2 to GRCh38) before classification (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, family level, read-count cut-off 0 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 0.941 auroc unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-family-cutoff-0 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Family', block 'excl. human reads', cell D19, row 'Centrifuge', column 'AUC' |
| Configuration: Centrifuge, human reads removed (Bowtie2 to GRCh38) before classification (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, family level, read-count cut-off 0 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 35.5 regression-intercept unitless · unknown Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-family-cutoff-0 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Family', block 'excl. human reads', cell J19, row 'Centrifuge', column 'LR intercept' |
| Configuration: Centrifuge, human reads removed (Bowtie2 to GRCh38) before classification (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, family level, read-count cut-off 0 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 34.8% pearson-r-squared percent · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-family-cutoff-0 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Family', block 'excl. human reads', cell K19, row 'Centrifuge', column 'LR r2, %' |
| Configuration: Centrifuge, human reads removed (Bowtie2 to GRCh38) before classification (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, family level, read-count cut-off 0 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | -1.97 regression-slope unitless · unknown Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-family-cutoff-0 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Family', block 'excl. human reads', cell I19, row 'Centrifuge', column 'LR slope' |
| Configuration: Centrifuge, human reads removed, and assigned read counts normalised by target genome length (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, family level, read-count cut-off 0 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 0.941 auroc unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-family-cutoff-0 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Family', block 'excl. human reads and normalized', cell D29, row 'Centrifuge', column 'AUC' |
| Configuration: Centrifuge, human reads removed, and assigned read counts normalised by target genome length (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, family level, read-count cut-off 0 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 27.3 regression-intercept unitless · unknown Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-family-cutoff-0 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Family', block 'excl. human reads and normalized', cell J29, row 'Centrifuge', column 'LR intercept' |
| Configuration: Centrifuge, human reads removed, and assigned read counts normalised by target genome length (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, family level, read-count cut-off 0 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 40.2% pearson-r-squared percent · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-family-cutoff-0 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Family', block 'excl. human reads and normalized', cell K29, row 'Centrifuge', column 'LR r2, %' |
| Configuration: Centrifuge, human reads removed, and assigned read counts normalised by target genome length (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, family level, read-count cut-off 0 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | -2.17 regression-slope unitless · unknown Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-family-cutoff-0 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Family', block 'excl. human reads and normalized', cell I29, row 'Centrifuge', column 'LR slope' |
| Configuration: Centrifuge, human reads removed, and assigned read counts normalised by target genome length (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, family level, read-count cut-off 0 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 0.999 negative-predictive-value fraction · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-family-cutoff-0 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Family', block 'excl. human reads and normalized', cell H29, row 'Centrifuge', column 'NPV (ROC)' |
| Configuration: Centrifuge, human reads removed, and assigned read counts normalised by target genome length (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, family level, read-count cut-off 0 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 0.354 precision fraction · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-family-cutoff-0 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Family', block 'excl. human reads and normalized', cell G29, row 'Centrifuge', column 'PPV (ROC)' |
| Configuration: Centrifuge, human reads removed, and assigned read counts normalised by target genome length (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, family level, read-count cut-off 0 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 0.0688 roc-distance unitless · lower Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-family-cutoff-0 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Family', block 'excl. human reads and normalized', cell C29, row 'Centrifuge', column 'Informedness' |
| Configuration: Centrifuge, human reads removed, and assigned read counts normalised by target genome length (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, family level, read-count cut-off 0 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 0.958 recall fraction · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-family-cutoff-0 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Family', block 'excl. human reads and normalized', cell E29, row 'Centrifuge', column 'SN (ROC)' |
| Configuration: Centrifuge, human reads removed, and assigned read counts normalised by target genome length (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, family level, read-count cut-off 0 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 0.945 specificity fraction · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-family-cutoff-0 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Family', block 'excl. human reads and normalized', cell F29, row 'Centrifuge', column 'SL (ROC)' |
| Configuration: Centrifuge, human reads removed, and assigned read counts normalised by target genome length (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, family level, read-count cut-off 0 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 5 count count · unknown Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-family-cutoff-0 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Family', block 'excl. human reads and normalized', cell L29, row 'Centrifuge', column 'Taxa' |
| Configuration: Centrifuge, human reads removed, and assigned read counts normalised by target genome length (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, family level, read-count cut-off 0 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 5 count count · unknown Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-family-cutoff-0 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Family', block 'excl. human reads and normalized', cell M29, row 'Centrifuge', column 'Taxa with reads >0' |
| Configuration: Centrifuge, human reads removed (Bowtie2 to GRCh38) before classification (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, family level, read-count cut-off 0 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 0.999 negative-predictive-value fraction · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-family-cutoff-0 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Family', block 'excl. human reads', cell H19, row 'Centrifuge', column 'NPV (ROC)' |
| Configuration: Centrifuge, human reads removed (Bowtie2 to GRCh38) before classification (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, family level, read-count cut-off 0 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 0.354 precision fraction · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-family-cutoff-0 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Family', block 'excl. human reads', cell G19, row 'Centrifuge', column 'PPV (ROC)' |
| Configuration: Centrifuge, human reads removed (Bowtie2 to GRCh38) before classification (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, family level, read-count cut-off 0 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 0.0688 roc-distance unitless · lower Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-family-cutoff-0 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Family', block 'excl. human reads', cell C19, row 'Centrifuge', column 'Informedness' |
| Configuration: Centrifuge, human reads removed (Bowtie2 to GRCh38) before classification (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, family level, read-count cut-off 0 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 0.958 recall fraction · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-family-cutoff-0 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Family', block 'excl. human reads', cell E19, row 'Centrifuge', column 'SN (ROC)' |
| Configuration: Centrifuge, human reads removed (Bowtie2 to GRCh38) before classification (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, family level, read-count cut-off 0 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 0.945 specificity fraction · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-family-cutoff-0 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Family', block 'excl. human reads', cell F19, row 'Centrifuge', column 'SL (ROC)' |
| Configuration: Centrifuge, human reads removed (Bowtie2 to GRCh38) before classification (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, family level, read-count cut-off 0 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 5 count count · unknown Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-family-cutoff-0 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Family', block 'excl. human reads', cell L19, row 'Centrifuge', column 'Taxa' |
| Configuration: Centrifuge, human reads removed (Bowtie2 to GRCh38) before classification (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, family level, read-count cut-off 0 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 5 count count · unknown Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-family-cutoff-0 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Family', block 'excl. human reads', cell M19, row 'Centrifuge', column 'Taxa with reads >0' |
| Configuration: Centrifuge, all trimmed reads (human reads included) (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, family level, read-count cut-off 0 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 0.969 auroc unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-family-cutoff-0 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Family', block 'incl. human reads', cell D8, row 'Centrifuge', column 'AUC' |
| Configuration: Centrifuge, all trimmed reads (human reads included) (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, family level, read-count cut-off 0 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 38.8 regression-intercept unitless · unknown Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-family-cutoff-0 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Family', block 'incl. human reads', cell J8, row 'Centrifuge', column 'LR intercept' |
| Configuration: Centrifuge, all trimmed reads (human reads included) (Carbo et al. 2022) | Protocol: Respiratory virus detection against PCR, family level, read-count cut-off 0 (Carbo et al. 2022 Supplementary Table 1) Dataset: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022) | 50.5% pearson-r-squared percent · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourcerna-pathogen-20261009-protocol-carbo2022-family-cutoff-0 Aggregation: Not reported Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Supplementary Table 1 sheet 'Suppl table 1-Family', block 'incl. human reads', cell K8, row 'Centrifuge', column 'LR r2, %' |
Source checking is not independent reproduction. Release 2026-10-09-8cc1db47c7f9.
Methods and evaluation design
Procedure, tasks and evaluated configurations
Recorded evaluations
Each evaluation records what was tested and under which conditions.
- Centrifuge, human reads removed (Bowtie2 to GRCh38) before classification: family level, read-count cut-off 0 (Carbo et al. 2022)
- Centrifuge, human reads removed, and assigned read counts normalised by target genome length: family level, read-count cut-off 0 (Carbo et al. 2022)
- Centrifuge, all trimmed reads (human reads included): family level, read-count cut-off 0 (Carbo et al. 2022)
- CLARK, human reads removed (Bowtie2 to GRCh38) before classification: family level, read-count cut-off 0 (Carbo et al. 2022)
- CLARK, human reads removed, and assigned read counts normalised by target genome length: family level, read-count cut-off 0 (Carbo et al. 2022)
- CLARK, all trimmed reads (human reads included): family level, read-count cut-off 0 (Carbo et al. 2022)
- Genome Detective, human reads removed (Bowtie2 to GRCh38) before classification: family level, read-count cut-off 0 (Carbo et al. 2022)
- Genome Detective, human reads removed, and assigned read counts normalised by target genome length: family level, read-count cut-off 0 (Carbo et al. 2022)
- Genome Detective, all trimmed reads (human reads included): family level, read-count cut-off 0 (Carbo et al. 2022)
- Kaiju, human reads removed (Bowtie2 to GRCh38) before classification: family level, read-count cut-off 0 (Carbo et al. 2022)
- Kaiju, human reads removed, and assigned read counts normalised by target genome length: family level, read-count cut-off 0 (Carbo et al. 2022)
- Kaiju, all trimmed reads (human reads included): family level, read-count cut-off 0 (Carbo et al. 2022)
Baseline coverage
Reference methods help show what a model adds beyond simple controls. We track a null control and a conventional method for each protocol.
0 of 2 active baseline roles have published Rewire measurements in this release. Measurements on a selected protocol do not establish coverage of an entire suite.
No execution recipe linked to this protocol. Recipe availability does not establish a completed evaluation.
- External evaluations
- 15
Literature evidence is not a Rewire measurement. Executed but unpublished runs and private review status are not included.
Null control
Proposed control: requires review
Training-set class prior where supervised fitting is permitted
Protocol-specific applicability, permitted inputs, access, split, evaluator and execution requirements need review before implementation or execution.
This is a suggested selection rule, not a validated method or a measured score.
Conventional reference
Proposed control: requires review
Regularised classifier on simple permitted features, or protocol's conventional reference
Protocol-specific applicability, permitted inputs, access, split, evaluator and execution requirements need review before implementation or execution.
This is a suggested selection rule, not a validated method or a measured score.
Protocol coverage CSV (gzip) · Model evaluation matrix (gzip) · Source table (gzip) · Release and checksums (gzip)
Coverage is derived from release 2026-10-09-8cc1db47c7f9. Source citations describe the original records; they do not validate an unreviewed baseline proposal. No results have been generated by this audit.
Run instructions
No runnable recipe has been reviewed for this protocol. Dataset access, model requirements, licences and compute requirements must be checked against its sources before execution.
Strengths, limitations and unresolved questions
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
0 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|
No evidence rows match these filters. Choose another scope or clear the search.
Sources and history
Release 2026-10-09-8cc1db47c7f9 · Record review: source checked
2 source records and release history
- Performance of Five Metagenomic Classifiers for Virus Pathogen Detection Using Respiratory Samples from a Clinical Cohort · Original source · Pathogens 11(3):340, published 2022-03-11; PMC8953373 full-text XML
- Carbo et al. medRxiv preprint v1, Supplementary Tables 1 and 2 · Original source · medRxiv 2022.01.21.22269647 version 1 (2022-01-21), supplementary file media-1.xlsx
Technical metadata and extraction receipts
Stable ID: rna-pathogen-20261009-protocol-carbo2022-family-cutoff-0
- areas
- microbes-communities
- contexts
- clinical_research
- protocol
- ROC curves over the read count used as the cut-off for a positive result (1000 steps from one read to the maximum per PCR target and sample); sensitivity (SN), selectivity (SL, specificity), PPV and NPV at the ROC-selected point, AUC, and the ROC distance to the error-free point, against 24 positive and 1120 negative PCR results; linear regression of assigned read counts against PCR Ct values. Assignment at family level; the supplement labels this block 'read-count cut-off 0' without further definition.
- version
- Supplementary Table 1, Family level, read-count cut-off 0
- denominator
- 1144
- source locator
- Section 2.7; Supplementary Table 1 sheet notes (rows 1-3)
- limitations
- Single cohort; 24 PCR-positive results.; The meaning of the 0 and 10 read cut-offs alongside the ROC-selected threshold is not defined beyond the sheet note.; Out-of-panel viruses are not scored.
- missing metadata
- uncertainty: reason: unreported
Related records
- uses data: Nasal washings from COPD patients with respiratory complaints, metagenomic sequencing and 13-target respiratory PCR panel (Carbo et al. 2022)
- assessment: Centrifuge, human reads removed (Bowtie2 to GRCh38) before classification: family level, read-count cut-off 0 (Carbo et al. 2022)
- assessment: Centrifuge, human reads removed, and assigned read counts normalised by target genome length: family level, read-count cut-off 0 (Carbo et al. 2022)
- assessment: Centrifuge, all trimmed reads (human reads included): family level, read-count cut-off 0 (Carbo et al. 2022)
- assessment: CLARK, human reads removed (Bowtie2 to GRCh38) before classification: family level, read-count cut-off 0 (Carbo et al. 2022)
- assessment: CLARK, human reads removed, and assigned read counts normalised by target genome length: family level, read-count cut-off 0 (Carbo et al. 2022)
- assessment: CLARK, all trimmed reads (human reads included): family level, read-count cut-off 0 (Carbo et al. 2022)
- assessment: Genome Detective, human reads removed (Bowtie2 to GRCh38) before classification: family level, read-count cut-off 0 (Carbo et al. 2022)
- assessment: Genome Detective, human reads removed, and assigned read counts normalised by target genome length: family level, read-count cut-off 0 (Carbo et al. 2022)
- assessment: Genome Detective, all trimmed reads (human reads included): family level, read-count cut-off 0 (Carbo et al. 2022)
- assessment: Kaiju, human reads removed (Bowtie2 to GRCh38) before classification: family level, read-count cut-off 0 (Carbo et al. 2022)
- assessment: Kaiju, human reads removed, and assigned read counts normalised by target genome length: family level, read-count cut-off 0 (Carbo et al. 2022)
- assessment: Kaiju, all trimmed reads (human reads included): family level, read-count cut-off 0 (Carbo et al. 2022)
- assessment: Kraken2, human reads removed (Bowtie2 to GRCh38) before classification: family level, read-count cut-off 0 (Carbo et al. 2022)
- assessment: Kraken2, human reads removed, and assigned read counts normalised by target genome length: family level, read-count cut-off 0 (Carbo et al. 2022)
- assessment: Kraken2, all trimmed reads (human reads included): family level, read-count cut-off 0 (Carbo et al. 2022)
- assessed by: Select an RNA pathogen-detection workflow for diagnostic testing