Virus hits against RT-PCR: true and false positives, PPV and hit-level sensitivity (de Vries et al. 2021 Supplementary Table 4)
Each pipeline's reported viral hits scored against available RT-PCR results, including additional viruses with negative PCR.
Overview
Each pipeline's reported viral hits scored against available RT-PCR results, including additional viruses with negative PCR.
Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.
13 recorded evaluations, 78 metric rows. A comparison chart has not yet been validated for these results. The table retains the individual findings and their sources.
Results
Results are available, but no reviewed comparison panel is linked in this release.
All evaluations
13 evaluations · 78 results. Different protocols are not a single leaderboard.
Filter evaluations
Applied filters: All linked evaluations
| Tested configuration | Protocol and dataset | Finding | Evidence and details |
|---|---|---|---|
| Configuration: Centrifuge as run by an ENNGS laboratory (de Vries et al. 2021) | Protocol: Virus hits against RT-PCR: true and false positives, PPV and hit-level sensitivity (de Vries et al. 2021 Supplementary Table 4) Dataset: ENNGS benchmark: 13 clinical metagenomic datasets with RT-PCR results (de Vries et al. 2021) | 1 false-negative-count count · lower Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCentrifuge: virus hits against RT-PCR (ENNGS) rna-pathogen-20261009-protocol-devries2021-hit-level Aggregation: Not reported de Vries et al. medRxiv preprint v1, Supplementary Tables 2-4 · Supplementary Table 4, cell Q10, row 'Centrifuge', column 'FN (number of PCR-positive hits not reported by mNGS)' |
| Configuration: Centrifuge as run by an ENNGS laboratory (de Vries et al. 2021) | Protocol: Virus hits against RT-PCR: true and false positives, PPV and hit-level sensitivity (de Vries et al. 2021 Supplementary Table 4) Dataset: ENNGS benchmark: 13 clinical metagenomic datasets with RT-PCR results (de Vries et al. 2021) | 0 false-positive-count count · lower Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCentrifuge: virus hits against RT-PCR (ENNGS) rna-pathogen-20261009-protocol-devries2021-hit-level Aggregation: Not reported de Vries et al. medRxiv preprint v1, Supplementary Tables 2-4 · Supplementary Table 4, cell O10, row 'Centrifuge', column 'Number of additional viral mNGS hits with negative PCR reprsult (FP* see manuscript text for comments e.g. on index hopping)' |
| Configuration: Centrifuge as run by an ENNGS laboratory (de Vries et al. 2021) | Protocol: Virus hits against RT-PCR: true and false positives, PPV and hit-level sensitivity (de Vries et al. 2021 Supplementary Table 4) Dataset: ENNGS benchmark: 13 clinical metagenomic datasets with RT-PCR results (de Vries et al. 2021) | 14 count count · unknown Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCentrifuge: virus hits against RT-PCR (ENNGS) rna-pathogen-20261009-protocol-devries2021-hit-level Aggregation: Not reported de Vries et al. medRxiv preprint v1, Supplementary Tables 2-4 · Supplementary Table 4, cell R10, row 'Centrifuge', column 'Total mNGS hits with PCR data available (TP+FP)' |
| Configuration: Centrifuge as run by an ENNGS laboratory (de Vries et al. 2021) | Protocol: Virus hits against RT-PCR: true and false positives, PPV and hit-level sensitivity (de Vries et al. 2021 Supplementary Table 4) Dataset: ENNGS benchmark: 13 clinical metagenomic datasets with RT-PCR results (de Vries et al. 2021) | 100% precision percent · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCentrifuge: virus hits against RT-PCR (ENNGS) rna-pathogen-20261009-protocol-devries2021-hit-level Aggregation: Not reported de Vries et al. medRxiv preprint v1, Supplementary Tables 2-4 · Supplementary Table 4, cell S10, row 'Centrifuge', column 'Positive predictive value (PPV) [%]' |
| Configuration: Centrifuge as run by an ENNGS laboratory (de Vries et al. 2021) | Protocol: Virus hits against RT-PCR: true and false positives, PPV and hit-level sensitivity (de Vries et al. 2021 Supplementary Table 4) Dataset: ENNGS benchmark: 13 clinical metagenomic datasets with RT-PCR results (de Vries et al. 2021) | 93.3% recall percent · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCentrifuge: virus hits against RT-PCR (ENNGS) rna-pathogen-20261009-protocol-devries2021-hit-level Aggregation: Not reported de Vries et al. medRxiv preprint v1, Supplementary Tables 2-4 · Supplementary Table 4, cell T10, row 'Centrifuge', column 'Sensitivity [%], hit level' |
| Configuration: Centrifuge as run by an ENNGS laboratory (de Vries et al. 2021) | Protocol: Virus hits against RT-PCR: true and false positives, PPV and hit-level sensitivity (de Vries et al. 2021 Supplementary Table 4) Dataset: ENNGS benchmark: 13 clinical metagenomic datasets with RT-PCR results (de Vries et al. 2021) | 14 true-positive-count count · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCentrifuge: virus hits against RT-PCR (ENNGS) rna-pathogen-20261009-protocol-devries2021-hit-level Aggregation: Not reported de Vries et al. medRxiv preprint v1, Supplementary Tables 2-4 · Supplementary Table 4, cell P10, row 'Centrifuge', column 'TP (viral mNGS hits with positive PCR result, mixed infections counted as double, out of 15 positive PCRs)' |
| Configuration: DAMIAN as run by an ENNGS laboratory (de Vries et al. 2021) | Protocol: Virus hits against RT-PCR: true and false positives, PPV and hit-level sensitivity (de Vries et al. 2021 Supplementary Table 4) Dataset: ENNGS benchmark: 13 clinical metagenomic datasets with RT-PCR results (de Vries et al. 2021) | 3 false-negative-count count · lower Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Evaluation origin not reported · Source checkedMethods, coverage and sourceDAMIAN: virus hits against RT-PCR (ENNGS) rna-pathogen-20261009-protocol-devries2021-hit-level Aggregation: Not reported de Vries et al. medRxiv preprint v1, Supplementary Tables 2-4 · Supplementary Table 4, cell Q15, row 'DAMIAN', column 'FN (number of PCR-positive hits not reported by mNGS)' |
| Configuration: DAMIAN as run by an ENNGS laboratory (de Vries et al. 2021) | Protocol: Virus hits against RT-PCR: true and false positives, PPV and hit-level sensitivity (de Vries et al. 2021 Supplementary Table 4) Dataset: ENNGS benchmark: 13 clinical metagenomic datasets with RT-PCR results (de Vries et al. 2021) | 0 false-positive-count count · lower Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Evaluation origin not reported · Source checkedMethods, coverage and sourceDAMIAN: virus hits against RT-PCR (ENNGS) rna-pathogen-20261009-protocol-devries2021-hit-level Aggregation: Not reported de Vries et al. medRxiv preprint v1, Supplementary Tables 2-4 · Supplementary Table 4, cell O15, row 'DAMIAN', column 'Number of additional viral mNGS hits with negative PCR reprsult (FP* see manuscript text for comments e.g. on index hopping)' |
| Configuration: DAMIAN as run by an ENNGS laboratory (de Vries et al. 2021) | Protocol: Virus hits against RT-PCR: true and false positives, PPV and hit-level sensitivity (de Vries et al. 2021 Supplementary Table 4) Dataset: ENNGS benchmark: 13 clinical metagenomic datasets with RT-PCR results (de Vries et al. 2021) | 12 count count · unknown Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Evaluation origin not reported · Source checkedMethods, coverage and sourceDAMIAN: virus hits against RT-PCR (ENNGS) rna-pathogen-20261009-protocol-devries2021-hit-level Aggregation: Not reported de Vries et al. medRxiv preprint v1, Supplementary Tables 2-4 · Supplementary Table 4, cell R15, row 'DAMIAN', column 'Total mNGS hits with PCR data available (TP+FP)' |
| Configuration: DAMIAN as run by an ENNGS laboratory (de Vries et al. 2021) | Protocol: Virus hits against RT-PCR: true and false positives, PPV and hit-level sensitivity (de Vries et al. 2021 Supplementary Table 4) Dataset: ENNGS benchmark: 13 clinical metagenomic datasets with RT-PCR results (de Vries et al. 2021) | 100% precision percent · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Evaluation origin not reported · Source checkedMethods, coverage and sourceDAMIAN: virus hits against RT-PCR (ENNGS) rna-pathogen-20261009-protocol-devries2021-hit-level Aggregation: Not reported de Vries et al. medRxiv preprint v1, Supplementary Tables 2-4 · Supplementary Table 4, cell S15, row 'DAMIAN', column 'Positive predictive value (PPV) [%]' |
| Configuration: DAMIAN as run by an ENNGS laboratory (de Vries et al. 2021) | Protocol: Virus hits against RT-PCR: true and false positives, PPV and hit-level sensitivity (de Vries et al. 2021 Supplementary Table 4) Dataset: ENNGS benchmark: 13 clinical metagenomic datasets with RT-PCR results (de Vries et al. 2021) | 80% recall percent · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Evaluation origin not reported · Source checkedMethods, coverage and sourceDAMIAN: virus hits against RT-PCR (ENNGS) rna-pathogen-20261009-protocol-devries2021-hit-level Aggregation: Not reported de Vries et al. medRxiv preprint v1, Supplementary Tables 2-4 · Supplementary Table 4, cell T15, row 'DAMIAN', column 'Sensitivity [%], hit level' |
| Configuration: DAMIAN as run by an ENNGS laboratory (de Vries et al. 2021) | Protocol: Virus hits against RT-PCR: true and false positives, PPV and hit-level sensitivity (de Vries et al. 2021 Supplementary Table 4) Dataset: ENNGS benchmark: 13 clinical metagenomic datasets with RT-PCR results (de Vries et al. 2021) | 12 true-positive-count count · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Evaluation origin not reported · Source checkedMethods, coverage and sourceDAMIAN: virus hits against RT-PCR (ENNGS) rna-pathogen-20261009-protocol-devries2021-hit-level Aggregation: Not reported de Vries et al. medRxiv preprint v1, Supplementary Tables 2-4 · Supplementary Table 4, cell P15, row 'DAMIAN', column 'TP (viral mNGS hits with positive PCR result, mixed infections counted as double, out of 15 positive PCRs)' |
| Configuration: DIAMOND as run by an ENNGS laboratory (de Vries et al. 2021) | Protocol: Virus hits against RT-PCR: true and false positives, PPV and hit-level sensitivity (de Vries et al. 2021 Supplementary Table 4) Dataset: ENNGS benchmark: 13 clinical metagenomic datasets with RT-PCR results (de Vries et al. 2021) | 2 false-negative-count count · lower Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceDIAMOND: virus hits against RT-PCR (ENNGS) rna-pathogen-20261009-protocol-devries2021-hit-level Aggregation: Not reported de Vries et al. medRxiv preprint v1, Supplementary Tables 2-4 · Supplementary Table 4, cell Q17, row 'DIAMOND', column 'FN (number of PCR-positive hits not reported by mNGS)' |
| Configuration: DIAMOND as run by an ENNGS laboratory (de Vries et al. 2021) | Protocol: Virus hits against RT-PCR: true and false positives, PPV and hit-level sensitivity (de Vries et al. 2021 Supplementary Table 4) Dataset: ENNGS benchmark: 13 clinical metagenomic datasets with RT-PCR results (de Vries et al. 2021) | 1 false-positive-count count · lower Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceDIAMOND: virus hits against RT-PCR (ENNGS) rna-pathogen-20261009-protocol-devries2021-hit-level Aggregation: Not reported de Vries et al. medRxiv preprint v1, Supplementary Tables 2-4 · Supplementary Table 4, cell O17, row 'DIAMOND', column 'Number of additional viral mNGS hits with negative PCR reprsult (FP* see manuscript text for comments e.g. on index hopping)' |
| Configuration: DIAMOND as run by an ENNGS laboratory (de Vries et al. 2021) | Protocol: Virus hits against RT-PCR: true and false positives, PPV and hit-level sensitivity (de Vries et al. 2021 Supplementary Table 4) Dataset: ENNGS benchmark: 13 clinical metagenomic datasets with RT-PCR results (de Vries et al. 2021) | 14 count count · unknown Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceDIAMOND: virus hits against RT-PCR (ENNGS) rna-pathogen-20261009-protocol-devries2021-hit-level Aggregation: Not reported de Vries et al. medRxiv preprint v1, Supplementary Tables 2-4 · Supplementary Table 4, cell R17, row 'DIAMOND', column 'Total mNGS hits with PCR data available (TP+FP)' |
| Configuration: DIAMOND as run by an ENNGS laboratory (de Vries et al. 2021) | Protocol: Virus hits against RT-PCR: true and false positives, PPV and hit-level sensitivity (de Vries et al. 2021 Supplementary Table 4) Dataset: ENNGS benchmark: 13 clinical metagenomic datasets with RT-PCR results (de Vries et al. 2021) | 92.9% precision percent · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceDIAMOND: virus hits against RT-PCR (ENNGS) rna-pathogen-20261009-protocol-devries2021-hit-level Aggregation: Not reported de Vries et al. medRxiv preprint v1, Supplementary Tables 2-4 · Supplementary Table 4, cell S17, row 'DIAMOND', column 'Positive predictive value (PPV) [%]' |
| Configuration: DIAMOND as run by an ENNGS laboratory (de Vries et al. 2021) | Protocol: Virus hits against RT-PCR: true and false positives, PPV and hit-level sensitivity (de Vries et al. 2021 Supplementary Table 4) Dataset: ENNGS benchmark: 13 clinical metagenomic datasets with RT-PCR results (de Vries et al. 2021) | 86.7% recall percent · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceDIAMOND: virus hits against RT-PCR (ENNGS) rna-pathogen-20261009-protocol-devries2021-hit-level Aggregation: Not reported de Vries et al. medRxiv preprint v1, Supplementary Tables 2-4 · Supplementary Table 4, cell T17, row 'DIAMOND', column 'Sensitivity [%], hit level' |
| Configuration: DIAMOND as run by an ENNGS laboratory (de Vries et al. 2021) | Protocol: Virus hits against RT-PCR: true and false positives, PPV and hit-level sensitivity (de Vries et al. 2021 Supplementary Table 4) Dataset: ENNGS benchmark: 13 clinical metagenomic datasets with RT-PCR results (de Vries et al. 2021) | 13 true-positive-count count · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceDIAMOND: virus hits against RT-PCR (ENNGS) rna-pathogen-20261009-protocol-devries2021-hit-level Aggregation: Not reported de Vries et al. medRxiv preprint v1, Supplementary Tables 2-4 · Supplementary Table 4, cell P17, row 'DIAMOND', column 'TP (viral mNGS hits with positive PCR result, mixed infections counted as double, out of 15 positive PCRs)' |
| Configuration: DNAstar as run by an ENNGS laboratory (de Vries et al. 2021) | Protocol: Virus hits against RT-PCR: true and false positives, PPV and hit-level sensitivity (de Vries et al. 2021 Supplementary Table 4) Dataset: ENNGS benchmark: 13 clinical metagenomic datasets with RT-PCR results (de Vries et al. 2021) | 0 false-negative-count count · lower Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNAstar: virus hits against RT-PCR (ENNGS) rna-pathogen-20261009-protocol-devries2021-hit-level Aggregation: Not reported de Vries et al. medRxiv preprint v1, Supplementary Tables 2-4 · Supplementary Table 4, cell Q20, row 'DNAstar', column 'FN (number of PCR-positive hits not reported by mNGS)' |
| Configuration: DNAstar as run by an ENNGS laboratory (de Vries et al. 2021) | Protocol: Virus hits against RT-PCR: true and false positives, PPV and hit-level sensitivity (de Vries et al. 2021 Supplementary Table 4) Dataset: ENNGS benchmark: 13 clinical metagenomic datasets with RT-PCR results (de Vries et al. 2021) | 6 false-positive-count count · lower Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNAstar: virus hits against RT-PCR (ENNGS) rna-pathogen-20261009-protocol-devries2021-hit-level Aggregation: Not reported de Vries et al. medRxiv preprint v1, Supplementary Tables 2-4 · Supplementary Table 4, cell O20, row 'DNAstar', column 'Number of additional viral mNGS hits with negative PCR reprsult (FP* see manuscript text for comments e.g. on index hopping)' |
| Configuration: DNAstar as run by an ENNGS laboratory (de Vries et al. 2021) | Protocol: Virus hits against RT-PCR: true and false positives, PPV and hit-level sensitivity (de Vries et al. 2021 Supplementary Table 4) Dataset: ENNGS benchmark: 13 clinical metagenomic datasets with RT-PCR results (de Vries et al. 2021) | 21 count count · unknown Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNAstar: virus hits against RT-PCR (ENNGS) rna-pathogen-20261009-protocol-devries2021-hit-level Aggregation: Not reported de Vries et al. medRxiv preprint v1, Supplementary Tables 2-4 · Supplementary Table 4, cell R20, row 'DNAstar', column 'Total mNGS hits with PCR data available (TP+FP)' |
| Configuration: DNAstar as run by an ENNGS laboratory (de Vries et al. 2021) | Protocol: Virus hits against RT-PCR: true and false positives, PPV and hit-level sensitivity (de Vries et al. 2021 Supplementary Table 4) Dataset: ENNGS benchmark: 13 clinical metagenomic datasets with RT-PCR results (de Vries et al. 2021) | 71.4% precision percent · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNAstar: virus hits against RT-PCR (ENNGS) rna-pathogen-20261009-protocol-devries2021-hit-level Aggregation: Not reported de Vries et al. medRxiv preprint v1, Supplementary Tables 2-4 · Supplementary Table 4, cell S20, row 'DNAstar', column 'Positive predictive value (PPV) [%]' |
| Configuration: DNAstar as run by an ENNGS laboratory (de Vries et al. 2021) | Protocol: Virus hits against RT-PCR: true and false positives, PPV and hit-level sensitivity (de Vries et al. 2021 Supplementary Table 4) Dataset: ENNGS benchmark: 13 clinical metagenomic datasets with RT-PCR results (de Vries et al. 2021) | 100% recall percent · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNAstar: virus hits against RT-PCR (ENNGS) rna-pathogen-20261009-protocol-devries2021-hit-level Aggregation: Not reported de Vries et al. medRxiv preprint v1, Supplementary Tables 2-4 · Supplementary Table 4, cell T20, row 'DNAstar', column 'Sensitivity [%], hit level' |
| Configuration: DNAstar as run by an ENNGS laboratory (de Vries et al. 2021) | Protocol: Virus hits against RT-PCR: true and false positives, PPV and hit-level sensitivity (de Vries et al. 2021 Supplementary Table 4) Dataset: ENNGS benchmark: 13 clinical metagenomic datasets with RT-PCR results (de Vries et al. 2021) | 15 true-positive-count count · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDNAstar: virus hits against RT-PCR (ENNGS) rna-pathogen-20261009-protocol-devries2021-hit-level Aggregation: Not reported de Vries et al. medRxiv preprint v1, Supplementary Tables 2-4 · Supplementary Table 4, cell P20, row 'DNAstar', column 'TP (viral mNGS hits with positive PCR result, mixed infections counted as double, out of 15 positive PCRs)' |
| Configuration: FEVIR as run by an ENNGS laboratory (de Vries et al. 2021) | Protocol: Virus hits against RT-PCR: true and false positives, PPV and hit-level sensitivity (de Vries et al. 2021 Supplementary Table 4) Dataset: ENNGS benchmark: 13 clinical metagenomic datasets with RT-PCR results (de Vries et al. 2021) | 0 false-negative-count count · lower Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceFEVIR: virus hits against RT-PCR (ENNGS) rna-pathogen-20261009-protocol-devries2021-hit-level Aggregation: Not reported de Vries et al. medRxiv preprint v1, Supplementary Tables 2-4 · Supplementary Table 4, cell Q23, row 'FEVIR', column 'FN (number of PCR-positive hits not reported by mNGS)' |
Source checking is not independent reproduction. Release 2026-10-09-8cc1db47c7f9.
Methods and evaluation design
Procedure, tasks and evaluated configurations
Recorded evaluations
Each evaluation records what was tested and under which conditions.
- Centrifuge: virus hits against RT-PCR (ENNGS)
- DAMIAN: virus hits against RT-PCR (ENNGS)
- DIAMOND: virus hits against RT-PCR (ENNGS)
- DNAstar: virus hits against RT-PCR (ENNGS)
- FEVIR: virus hits against RT-PCR (ENNGS)
- Genome Detective: virus hits against RT-PCR (ENNGS)
- Jovian: virus hits against RT-PCR (ENNGS)
- MetaMIC: virus hits against RT-PCR (ENNGS)
- MetaMix: virus hits against RT-PCR (ENNGS)
- One Codex: virus hits against RT-PCR (ENNGS)
- RIEMS: virus hits against RT-PCR (ENNGS)
- Taxonomer: virus hits against RT-PCR (ENNGS)
Baseline coverage
Reference methods help show what a model adds beyond simple controls. We track a null control and a conventional method for each protocol.
0 of 2 active baseline roles have published Rewire measurements in this release. Measurements on a selected protocol do not establish coverage of an entire suite.
No execution recipe linked to this protocol. Recipe availability does not establish a completed evaluation.
- Author-reported evaluations
- 7
- External evaluations
- 5
- unreported
- 1
Literature evidence is not a Rewire measurement. Executed but unpublished runs and private review status are not included.
Null control
Proposed control: requires review
Select a task-valid null control after reviewing inputs and metric
Protocol-specific applicability, permitted inputs, access, split, evaluator and execution requirements need review before implementation or execution.
This is a suggested selection rule, not a validated method or a measured score.
Conventional reference
Proposed control: requires review
Select an upstream conventional reference after reviewing the full protocol
Protocol-specific applicability, permitted inputs, access, split, evaluator and execution requirements need review before implementation or execution.
This is a suggested selection rule, not a validated method or a measured score.
Protocol coverage CSV (gzip) · Model evaluation matrix (gzip) · Source table (gzip) · Release and checksums (gzip)
Coverage is derived from release 2026-10-09-8cc1db47c7f9. Source citations describe the original records; they do not validate an unreviewed baseline proposal. No results have been generated by this audit.
Run instructions
No runnable recipe has been reviewed for this protocol. Dataset access, model requirements, licences and compute requirements must be checked against its sources before execution.
Strengths, limitations and unresolved questions
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
0 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|
No evidence rows match these filters. Choose another scope or clear the search.
Sources and history
Release 2026-10-09-8cc1db47c7f9 · Record review: source checked
2 source records and release history
- Benchmark of thirteen bioinformatic pipelines for metagenomic virus diagnostics using datasets from clinical samples · Original source · medRxiv 2021.05.04.21256618 version 1 (2021-05-08), JATS XML; published as J Clin Virol 141:104908 (doi:10.1016/j.jcv.2021.104908)
- de Vries et al. medRxiv preprint v1, Supplementary Tables 2-4 · Original source · medRxiv 2021.05.04.21256618 version 1, supplementary file media-1.xlsx (sheets SuppS2, SuppS3, SuppS4)
Technical metadata and extraction receipts
Stable ID: rna-pathogen-20261009-protocol-devries2021-hit-level
- areas
- microbes-communities
- contexts
- clinical_research
- protocol
- TP: reported hit with a positive PCR (mixed infections counted as two; 15 positive PCRs). FP: additional reported viral hit with a negative PCR result. FN: PCR-positive hit not reported. PPV = TP / (TP + FP); sensitivity = TP / 15. Hits without PCR data are not scored.
- version
- Supplementary Table 4, columns O-T
- denominator
- 15
- source locator
- Results 'Additional virus hits and positive predictive value'; Supplementary Table 4 header row 5
- limitations
- False positives are counted only where a negative PCR exists; most additional hits have no PCR result.; The authors note that FP hits may be real (PCR primer mismatch) or index hopping or reagent contaminants.; Rotavirus was detected in the negative run control (Supplementary Table 4 footnote).
- missing metadata
- uncertainty: reason: unreported
Related records
- uses data: ENNGS benchmark: 13 clinical metagenomic datasets with RT-PCR results (de Vries et al. 2021)
- subject: contamination_signal: rna-pathogen-20261009-protocol-devries2021-hit-level
- assessment: Centrifuge: virus hits against RT-PCR (ENNGS)
- assessment: DAMIAN: virus hits against RT-PCR (ENNGS)
- assessment: DIAMOND: virus hits against RT-PCR (ENNGS)
- assessment: DNAstar: virus hits against RT-PCR (ENNGS)
- assessment: FEVIR: virus hits against RT-PCR (ENNGS)
- assessment: Genome Detective: virus hits against RT-PCR (ENNGS)
- assessment: Jovian: virus hits against RT-PCR (ENNGS)
- assessment: MetaMIC: virus hits against RT-PCR (ENNGS)
- assessment: MetaMix: virus hits against RT-PCR (ENNGS)
- assessment: One Codex: virus hits against RT-PCR (ENNGS)
- assessment: RIEMS: virus hits against RT-PCR (ENNGS)
- assessment: Taxonomer: virus hits against RT-PCR (ENNGS)
- assessment: VirMet: virus hits against RT-PCR (ENNGS)
- assessed by: Select an RNA pathogen-detection workflow for diagnostic testing