One short-read metagenome provided with a modified case report; causal pathogen Crimean-Congo haemorrhagic fever orthonairovirus (CCHFV).
These checks assess whether the evidence supports a reproducible investigation. A source-checked score alone does not meet these requirements.
Release 2026-10-09-8cc1db47c7f9 · Evidence verified: Not verified
Exact outcomes, predictions, identifiers and evaluator are connected.
Missing or unresolved evidence
Verified: Not verified
Replay evidence includes annotations and an assessment of dependence. Unknown independence permits descriptive analysis only.
Missing or unresolved evidence
Verified: Not verified
A pinned recipe describes the inputs, environment and resource requirements.
Missing or unresolved evidence
Verified: Not verified
Separate data and exposure records support an independent test.
Missing or unresolved evidence
Verified: Not verified
Readiness describes the evidence in this release. Availability on your computer is checked separately when an investigation runs. Existing data exposure can prevent independent validation even when files are available.
No verified artifact manifest is connected to this record yet. The gaps above identify what is needed before analysis can begin.
8 evaluations · 16 results. Different protocols are not a single leaderboard.
Applied filters: All linked evaluations
| Tested configuration | Protocol and dataset | Finding | Evidence and details |
|---|---|---|---|
| Configuration: CCMetagen v1.1.3 (CAMI II pathogen challenge submission) | Protocol: Identify all pathogens and the causal pathogen in one clinical blood metagenome (CAMI II clinical pathogen challenge) Dataset: CAMI II clinical pathogen challenge: blood metagenome from a patient with haemorrhagic fever | yes success-rate unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Evaluation origin not reported · Source checkedMethods, coverage and sourceCCMetagen v1.1.3: CAMI II clinical pathogen challenge rna-pathogen-20261009-protocol-meyer2022-causal-pathogen Aggregation: Not reported Meyer et al. 2022, Supplementary Tables 1-40 · Supplementary Table 39 cell B12, row 'CCMetagen v1.1.3', column 'Causal pathogen in submitted list of taxa' |
| Configuration: CCMetagen v1.1.3 (CAMI II pathogen challenge submission) | Protocol: Identify all pathogens and the causal pathogen in one clinical blood metagenome (CAMI II clinical pathogen challenge) Dataset: CAMI II clinical pathogen challenge: blood metagenome from a patient with haemorrhagic fever | yes success-rate unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Evaluation origin not reported · Source checkedMethods, coverage and sourceCCMetagen v1.1.3: CAMI II clinical pathogen challenge rna-pathogen-20261009-protocol-meyer2022-causal-pathogen Aggregation: Not reported Meyer et al. 2022, Supplementary Tables 1-40 · Supplementary Table 39 cell C12, row 'CCMetagen v1.1.3', column 'Predicted causal pathogen' |
| Configuration: LSHVec (CAMI II pathogen challenge submission) | Protocol: Identify all pathogens and the causal pathogen in one clinical blood metagenome (CAMI II clinical pathogen challenge) Dataset: CAMI II clinical pathogen challenge: blood metagenome from a patient with haemorrhagic fever | no success-rate unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Evaluation origin not reported · Source checkedMethods, coverage and sourceLSHVec: CAMI II clinical pathogen challenge rna-pathogen-20261009-protocol-meyer2022-causal-pathogen Aggregation: Not reported Meyer et al. 2022, Supplementary Tables 1-40 · Supplementary Table 39 cell B5, row 'LSHVec', column 'Causal pathogen in submitted list of taxa' |
| Configuration: LSHVec (CAMI II pathogen challenge submission) | Protocol: Identify all pathogens and the causal pathogen in one clinical blood metagenome (CAMI II clinical pathogen challenge) Dataset: CAMI II clinical pathogen challenge: blood metagenome from a patient with haemorrhagic fever | no success-rate unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Evaluation origin not reported · Source checkedMethods, coverage and sourceLSHVec: CAMI II clinical pathogen challenge rna-pathogen-20261009-protocol-meyer2022-causal-pathogen Aggregation: Not reported Meyer et al. 2022, Supplementary Tables 1-40 · Supplementary Table 39 cell C5, row 'LSHVec', column 'Predicted causal pathogen' |
| Configuration: MetaPhlAn v2.2.0 (CAMI II pathogen challenge submission) | Protocol: Identify all pathogens and the causal pathogen in one clinical blood metagenome (CAMI II clinical pathogen challenge) Dataset: CAMI II clinical pathogen challenge: blood metagenome from a patient with haemorrhagic fever | yes success-rate unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Evaluation origin not reported · Source checkedMethods, coverage and sourceMetaPhlAn v2.2.0: CAMI II clinical pathogen challenge rna-pathogen-20261009-protocol-meyer2022-causal-pathogen Aggregation: Not reported Meyer et al. 2022, Supplementary Tables 1-40 · Supplementary Table 39 cell B6, row 'MetaPhlAn v2.2.0', column 'Causal pathogen in submitted list of taxa' |
| Configuration: MetaPhlAn v2.2.0 (CAMI II pathogen challenge submission) | Protocol: Identify all pathogens and the causal pathogen in one clinical blood metagenome (CAMI II clinical pathogen challenge) Dataset: CAMI II clinical pathogen challenge: blood metagenome from a patient with haemorrhagic fever | yes success-rate unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Evaluation origin not reported · Source checkedMethods, coverage and sourceMetaPhlAn v2.2.0: CAMI II clinical pathogen challenge rna-pathogen-20261009-protocol-meyer2022-causal-pathogen Aggregation: Not reported Meyer et al. 2022, Supplementary Tables 1-40 · Supplementary Table 39 cell C6, row 'MetaPhlAn v2.2.0', column 'Predicted causal pathogen' |
| Configuration: MetaPhlAn v2.9.14 (CAMI II pathogen challenge submission) | Protocol: Identify all pathogens and the causal pathogen in one clinical blood metagenome (CAMI II clinical pathogen challenge) Dataset: CAMI II clinical pathogen challenge: blood metagenome from a patient with haemorrhagic fever | no success-rate unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Evaluation origin not reported · Source checkedMethods, coverage and sourceMetaPhlAn v2.9.14: CAMI II clinical pathogen challenge rna-pathogen-20261009-protocol-meyer2022-causal-pathogen Aggregation: Not reported Meyer et al. 2022, Supplementary Tables 1-40 · Supplementary Table 39 cell B7, row 'MetaPhlAn v2.9.14', column 'Causal pathogen in submitted list of taxa' |
| Configuration: MetaPhlAn v2.9.14 (CAMI II pathogen challenge submission) | Protocol: Identify all pathogens and the causal pathogen in one clinical blood metagenome (CAMI II clinical pathogen challenge) Dataset: CAMI II clinical pathogen challenge: blood metagenome from a patient with haemorrhagic fever | no success-rate unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Evaluation origin not reported · Source checkedMethods, coverage and sourceMetaPhlAn v2.9.14: CAMI II clinical pathogen challenge rna-pathogen-20261009-protocol-meyer2022-causal-pathogen Aggregation: Not reported Meyer et al. 2022, Supplementary Tables 1-40 · Supplementary Table 39 cell C7, row 'MetaPhlAn v2.9.14', column 'Predicted causal pathogen' |
| Configuration: MetaPhyler v1.25 (CAMI II pathogen challenge submission) | Protocol: Identify all pathogens and the causal pathogen in one clinical blood metagenome (CAMI II clinical pathogen challenge) Dataset: CAMI II clinical pathogen challenge: blood metagenome from a patient with haemorrhagic fever | no success-rate unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Evaluation origin not reported · Source checkedMethods, coverage and sourceMetaPhyler v1.25: CAMI II clinical pathogen challenge rna-pathogen-20261009-protocol-meyer2022-causal-pathogen Aggregation: Not reported Meyer et al. 2022, Supplementary Tables 1-40 · Supplementary Table 39 cell B8, row 'MetaPhyler v1.25', column 'Causal pathogen in submitted list of taxa' |
| Configuration: MetaPhyler v1.25 (CAMI II pathogen challenge submission) | Protocol: Identify all pathogens and the causal pathogen in one clinical blood metagenome (CAMI II clinical pathogen challenge) Dataset: CAMI II clinical pathogen challenge: blood metagenome from a patient with haemorrhagic fever | no success-rate unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Evaluation origin not reported · Source checkedMethods, coverage and sourceMetaPhyler v1.25: CAMI II clinical pathogen challenge rna-pathogen-20261009-protocol-meyer2022-causal-pathogen Aggregation: Not reported Meyer et al. 2022, Supplementary Tables 1-40 · Supplementary Table 39 cell C8, row 'MetaPhyler v1.25', column 'Predicted causal pathogen' |
| Configuration: NSSAC (assembly) (CAMI II pathogen challenge submission) | Protocol: Identify all pathogens and the causal pathogen in one clinical blood metagenome (CAMI II clinical pathogen challenge) Dataset: CAMI II clinical pathogen challenge: blood metagenome from a patient with haemorrhagic fever | no success-rate unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Evaluation origin not reported · Source checkedMethods, coverage and sourceNSSAC (assembly): CAMI II clinical pathogen challenge rna-pathogen-20261009-protocol-meyer2022-causal-pathogen Aggregation: Not reported Meyer et al. 2022, Supplementary Tables 1-40 · Supplementary Table 39 cell B10, row 'NSSAC (assembly)', column 'Causal pathogen in submitted list of taxa' |
| Configuration: NSSAC (assembly) (CAMI II pathogen challenge submission) | Protocol: Identify all pathogens and the causal pathogen in one clinical blood metagenome (CAMI II clinical pathogen challenge) Dataset: CAMI II clinical pathogen challenge: blood metagenome from a patient with haemorrhagic fever | no success-rate unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Evaluation origin not reported · Source checkedMethods, coverage and sourceNSSAC (assembly): CAMI II clinical pathogen challenge rna-pathogen-20261009-protocol-meyer2022-causal-pathogen Aggregation: Not reported Meyer et al. 2022, Supplementary Tables 1-40 · Supplementary Table 39 cell C10, row 'NSSAC (assembly)', column 'Predicted causal pathogen' |
| Configuration: NSSAC (full genome) (CAMI II pathogen challenge submission) | Protocol: Identify all pathogens and the causal pathogen in one clinical blood metagenome (CAMI II clinical pathogen challenge) Dataset: CAMI II clinical pathogen challenge: blood metagenome from a patient with haemorrhagic fever | no success-rate unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Evaluation origin not reported · Source checkedMethods, coverage and sourceNSSAC (full genome): CAMI II clinical pathogen challenge rna-pathogen-20261009-protocol-meyer2022-causal-pathogen Aggregation: Not reported Meyer et al. 2022, Supplementary Tables 1-40 · Supplementary Table 39 cell B9, row 'NSSAC (full genome)', column 'Causal pathogen in submitted list of taxa' |
| Configuration: NSSAC (full genome) (CAMI II pathogen challenge submission) | Protocol: Identify all pathogens and the causal pathogen in one clinical blood metagenome (CAMI II clinical pathogen challenge) Dataset: CAMI II clinical pathogen challenge: blood metagenome from a patient with haemorrhagic fever | no success-rate unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Evaluation origin not reported · Source checkedMethods, coverage and sourceNSSAC (full genome): CAMI II clinical pathogen challenge rna-pathogen-20261009-protocol-meyer2022-causal-pathogen Aggregation: Not reported Meyer et al. 2022, Supplementary Tables 1-40 · Supplementary Table 39 cell C9, row 'NSSAC (full genome)', column 'Predicted causal pathogen' |
| Configuration: Pathoscope v2.0.7 (CAMI II pathogen challenge submission) | Protocol: Identify all pathogens and the causal pathogen in one clinical blood metagenome (CAMI II clinical pathogen challenge) Dataset: CAMI II clinical pathogen challenge: blood metagenome from a patient with haemorrhagic fever | no success-rate unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Evaluation origin not reported · Source checkedMethods, coverage and sourcePathoscope v2.0.7: CAMI II clinical pathogen challenge rna-pathogen-20261009-protocol-meyer2022-causal-pathogen Aggregation: Not reported Meyer et al. 2022, Supplementary Tables 1-40 · Supplementary Table 39 cell B11, row 'Pathoscope v2.0.7', column 'Causal pathogen in submitted list of taxa' |
| Configuration: Pathoscope v2.0.7 (CAMI II pathogen challenge submission) | Protocol: Identify all pathogens and the causal pathogen in one clinical blood metagenome (CAMI II clinical pathogen challenge) Dataset: CAMI II clinical pathogen challenge: blood metagenome from a patient with haemorrhagic fever | no success-rate unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Evaluation origin not reported · Source checkedMethods, coverage and sourcePathoscope v2.0.7: CAMI II clinical pathogen challenge rna-pathogen-20261009-protocol-meyer2022-causal-pathogen Aggregation: Not reported Meyer et al. 2022, Supplementary Tables 1-40 · Supplementary Table 39 cell C11, row 'Pathoscope v2.0.7', column 'Predicted causal pathogen' |
Source checking is not independent reproduction. Release 2026-10-09-8cc1db47c7f9.
A dataset supplies biological observations. The evaluation protocol defines how those observations are split, used and scored.
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
7 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| attributes.denominator 1 Context-only references | Critical Assessment of Metagenome Interpretation: the second round of challenges Methods 'Challenge datasets' paragraph 5 Version: Nature Methods 19(4):429, published 2022-04-08; PMC9007738 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| attributes.population One blood sample; CCHFV sequences previously found and confirmed by PCR (Ct 27.4); human reads replaced by reads from the same regions of the 1000 Genomes data. Context-only references | Critical Assessment of Metagenome Interpretation: the second round of challenges Methods 'Challenge datasets' paragraph 5 Version: Nature Methods 19(4):429, published 2022-04-08; PMC9007738 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| attributes.source_locator Methods 'Challenge datasets' paragraph 5 Context-only references | Critical Assessment of Metagenome Interpretation: the second round of challenges Methods 'Challenge datasets' paragraph 5 Version: Nature Methods 19(4):429, published 2022-04-08; PMC9007738 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| attributes.split Single sample Context-only references | Critical Assessment of Metagenome Interpretation: the second round of challenges Methods 'Challenge datasets' paragraph 5 Version: Nature Methods 19(4):429, published 2022-04-08; PMC9007738 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| attributes.version CAMI II pathogen challenge dataset (688 MB paired-end MiSeq) Context-only references | Critical Assessment of Metagenome Interpretation: the second round of challenges Methods 'Challenge datasets' paragraph 5 Version: Nature Methods 19(4):429, published 2022-04-08; PMC9007738 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| description One short-read metagenome provided with a modified case report; causal pathogen Crimean-Congo haemorrhagic fever orthonairovirus (CCHFV). Context-only references | Critical Assessment of Metagenome Interpretation: the second round of challenges Methods 'Challenge datasets' paragraph 5 Version: Nature Methods 19(4):429, published 2022-04-08; PMC9007738 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| name CAMI II clinical pathogen challenge: blood metagenome from a patient with haemorrhagic fever Context-only references | Critical Assessment of Metagenome Interpretation: the second round of challenges Methods 'Challenge datasets' paragraph 5 Version: Nature Methods 19(4):429, published 2022-04-08; PMC9007738 full-text XML | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Release 2026-10-09-8cc1db47c7f9 · Record review: source checked
Stable ID: rna-pathogen-20261009-data-meyer2022-cami2-clinical-pathogen