The CAMI assembly task concerns reconstructing metagenomic sequence assemblies; the homepage links MetaQUAST evaluation resources.
No reviewed evaluations are linked here in this release. See the sources and separately identified configurations below.
CAMI II marine, strain-madness and plant-associated simulated metagenomes provide short-read, long-read and hybrid conditions. Genome truth and gold-standard assemblies are available after the blinded challenge; preserve dataset and sequencing condition.
MetaQUAST evaluates genome fraction, mismatches per 100 kb, duplication ratio, NGA50 and misassemblies; strain precision and recall additionally measure high-quality strain reconstruction. Undefined per-genome NGA50 is set to zero before the reported genome average.
Released sequence data and track-specific reference resources.
Conceptual procedure. Task variants and protocol versions retain their separate scoring conditions.
limited source coverage · Automated source review, 2026-09-16. All specifications and missing details
0 evaluations · 0 results. Different protocols are not a single leaderboard.
Applied filters: All linked evaluations
No evaluations linked in this release.
Source checking is not independent reproduction. Release 2026-09-29-06401fd5b220.
CAMI is a series of blinded metagenomic software challenges. In CAMI II, participants received simulated short and long reads from defined communities and submitted assemblies, genome bins, taxonomic assignments or abundance profiles. Reference truth was used only for scoring, and software versions, input read types and community conditions were kept distinct.
Benchmarks bring together tasks and protocols. A task describes the biological question; a protocol defines a particular test.
These source-backed links do not make different protocols or scores interchangeable.
No runnable recipe has been reviewed for this task. Dataset access, model requirements, licences and compute requirements must be checked against its sources before execution.
A task describes a biological question. Choose a linked protocol to obtain concrete split and scoring instructions.
Primary paper and/or task implementation reviewed for the explicitly cited methodology claims. Scope-limited absence is recorded only after the documented source search; no model runs or independent reproduction.
Stable record: discovery-benchmark-cami-metagenome-assemblyExplanatory profile: limited source coverage · Automated source review, 2026-09-16. Review applies to the cited claims; unresolved fields are listed below. Numerical results retain their own review status.
| Property | Description and evidence |
|---|---|
| Datasets | CAMI II marine, strain-madness and plant-associated simulated metagenomes provide short-read, long-read and hybrid conditions. Genome truth and gold-standard assemblies are available after the blinded challenge; preserve dataset and sequencing condition.Sourcescami2 primary benchmark evidence · Methods: Challenge datasets and Challenge organization |
| Splits | CAMI II supplied public-genome practice datasets with ground truth before its blinded challenge. Challenge datasets were marine, strain-madness and plant-associated communities; these are challenge conditions, not a standard supervised train/validation/test partition.Sourcescami2 primary benchmark evidence · Methods: Challenge datasets, Challenge organization, Evaluation metrics; Figures 2–4; Table 1 |
| Metrics | MetaQUAST evaluates genome fraction, mismatches per 100 kb, duplication ratio, NGA50 and misassemblies; strain precision and recall additionally measure high-quality strain reconstruction. Undefined per-genome NGA50 is set to zero before the reported genome average.Sourcescami2 primary benchmark evidence · Methods: Assembly metrics; Figure 1 |
| Baselines | Submitted programs are compared under the same data condition. Gold-standard assemblies and MEGAHIT assemblies separate binning performance from upstream assembly error; published method identities and versions are listed in Table 1.Sourcescami2 primary benchmark evidence · Methods: Challenge datasets, Challenge organization, Evaluation metrics; Figures 2–4; Table 1 |
| Leakage controls | Challenge genome data and metadata were kept confidential until the challenge ended. Public reference collections dated 8 January 2019 were supplied for reference-based methods. CAMI II also includes public genomes, so novelty is stratified rather than assumed for every organism.Sourcescami2 primary benchmark evidence · Methods: Challenge datasets, Challenge organization, Evaluation metrics; Figures 2–4; Table 1 |
| Uncertainty | Figure 1 and the assembly-metrics Methods define descriptive per-genome and dataset summaries, but no universal bootstrap or repeated-seed interval for all assembly scores. · Not reported in inspected sourcesSourcescami2 primary benchmark evidence · Methods: Assembly metrics; Figure 1 |
| Entity type | Constituent benchmark task: CAMI metagenome assemblySourcescami official source · Official CAMI homepage: initiative description; challenges; dataset correction notices; toolkit citations |
| Organisms | Microbial communities; CAMI III includes longitudinal human-gut samples.Sourcescami official source · Official CAMI homepage: initiative description; challenges; dataset correction notices; toolkit citations |
| Assays | Challenge-specific metagenomic sequence data and reference composition.Sourcescami official source · Official CAMI homepage: initiative description; challenges; dataset correction notices; toolkit citations |
| Allowed inputs | Released sequence data and track-specific reference resources.Sourcescami official source · Official CAMI homepage: initiative description; challenges; dataset correction notices; toolkit citations |
| Adaptation | Methods process challenge inputs; a challenge edition and track determine resource rules.Sourcescami official source · Official CAMI homepage: initiative description; challenges; dataset correction notices; toolkit citations |
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Last literature check: 2026-09-17. Primary-source discovery and table/protocol screening; source checked is not independently reproduced. Raw acquisitions not automatically numerical publication approval.
| Paper or primary resource | Version | Reference |
|---|---|---|
| Critical Assessment of Metagenome Interpretation: the second round of challenges | PMC9007738 | Read source DOI: 10.1038/s41592-022-01431-4 |
source found structured extraction pending
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
22 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| Diagram caption Conceptual procedure. Task variants and protocol versions retain their separate scoring conditions. Individual claims | cami official source Official CAMI homepage: initiative description; challenges; dataset correction notices; toolkit citations; Methods: Challenge datasets, Challenge organization, Evaluation metrics; Figures 2–4; Table 1; Methods: Assembly metrics; Figure 1 Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: Retrieved website snapshot sha256:17825bf33280f40b596a104c547b57fae5ee5c07f8d60b396d0f4780d47ef9a5 | source checked automated source review · 2026-09-16 Audit detailsPrimary paper and/or task implementation reviewed for the explicitly cited methodology claims. Scope-limited absence is recorded only after the documented source search; no model runs or independent reproduction. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Diagram caption Conceptual procedure. Task variants and protocol versions retain their separate scoring conditions. Individual claims | cami2 primary benchmark evidence Official CAMI homepage: initiative description; challenges; dataset correction notices; toolkit citations; Methods: Challenge datasets, Challenge organization, Evaluation metrics; Figures 2–4; Table 1; Methods: Assembly metrics; Figure 1 Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: PMC9007738 | source checked automated source review · 2026-09-16 Audit detailsPrimary paper and/or task implementation reviewed for the explicitly cited methodology claims. Scope-limited absence is recorded only after the documented source search; no model runs or independent reproduction. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Diagram steps
| cami official source Official CAMI homepage: initiative description; challenges; dataset correction notices; toolkit citations; Methods: Challenge datasets, Challenge organization, Evaluation metrics; Figures 2–4; Table 1; Methods: Assembly metrics; Figure 1 Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: Retrieved website snapshot sha256:17825bf33280f40b596a104c547b57fae5ee5c07f8d60b396d0f4780d47ef9a5 | source checked automated source review · 2026-09-16 Audit detailsPrimary paper and/or task implementation reviewed for the explicitly cited methodology claims. Scope-limited absence is recorded only after the documented source search; no model runs or independent reproduction. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Diagram steps
| cami2 primary benchmark evidence Official CAMI homepage: initiative description; challenges; dataset correction notices; toolkit citations; Methods: Challenge datasets, Challenge organization, Evaluation metrics; Figures 2–4; Table 1; Methods: Assembly metrics; Figure 1 Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: PMC9007738 | source checked automated source review · 2026-09-16 Audit detailsPrimary paper and/or task implementation reviewed for the explicitly cited methodology claims. Scope-limited absence is recorded only after the documented source search; no model runs or independent reproduction. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Diagram title Evaluation procedure Individual claims | cami official source Official CAMI homepage: initiative description; challenges; dataset correction notices; toolkit citations; Methods: Challenge datasets, Challenge organization, Evaluation metrics; Figures 2–4; Table 1; Methods: Assembly metrics; Figure 1 Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: Retrieved website snapshot sha256:17825bf33280f40b596a104c547b57fae5ee5c07f8d60b396d0f4780d47ef9a5 | source checked automated source review · 2026-09-16 Audit detailsPrimary paper and/or task implementation reviewed for the explicitly cited methodology claims. Scope-limited absence is recorded only after the documented source search; no model runs or independent reproduction. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Diagram title Evaluation procedure Individual claims | cami2 primary benchmark evidence Official CAMI homepage: initiative description; challenges; dataset correction notices; toolkit citations; Methods: Challenge datasets, Challenge organization, Evaluation metrics; Figures 2–4; Table 1; Methods: Assembly metrics; Figure 1 Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: PMC9007738 | source checked automated source review · 2026-09-16 Audit detailsPrimary paper and/or task implementation reviewed for the explicitly cited methodology claims. Scope-limited absence is recorded only after the documented source search; no model runs or independent reproduction. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Datasets CAMI II marine, strain-madness and plant-associated simulated metagenomes provide short-read, long-read and hybrid conditions. Genome truth and gold-standard assemblies are available after the blinded challenge; preserve dataset and sequencing condition. Individual claims | cami2 primary benchmark evidence Methods: Challenge datasets and Challenge organization Version: PMC9007738 | source checked automated source review · 2026-09-16 Audit detailsPrimary paper and/or task implementation reviewed for the explicitly cited methodology claims. Scope-limited absence is recorded only after the documented source search; no model runs or independent reproduction. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Splits CAMI II supplied public-genome practice datasets with ground truth before its blinded challenge. Challenge datasets were marine, strain-madness and plant-associated communities; these are challenge conditions, not a standard supervised train/validation/test partition. Individual claims | cami2 primary benchmark evidence Methods: Challenge datasets, Challenge organization, Evaluation metrics; Figures 2–4; Table 1 Version: PMC9007738 | source checked automated source review · 2026-09-16 Audit detailsPrimary paper and/or task implementation reviewed for the explicitly cited methodology claims. Scope-limited absence is recorded only after the documented source search; no model runs or independent reproduction. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Adaptation Methods process challenge inputs; a challenge edition and track determine resource rules. Individual claims | cami official source Official CAMI homepage: initiative description; challenges; dataset correction notices; toolkit citations Version: Retrieved website snapshot sha256:17825bf33280f40b596a104c547b57fae5ee5c07f8d60b396d0f4780d47ef9a5 | source checked automated source review · 2026-09-16 Audit detailsPrimary paper and/or task implementation reviewed for the explicitly cited methodology claims. Scope-limited absence is recorded only after the documented source search; no model runs or independent reproduction. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Metrics MetaQUAST evaluates genome fraction, mismatches per 100 kb, duplication ratio, NGA50 and misassemblies; strain precision and recall additionally measure high-quality strain reconstruction. Undefined per-genome NGA50 is set to zero before the reported genome average. Individual claims | cami2 primary benchmark evidence Methods: Assembly metrics; Figure 1 Version: PMC9007738 | source checked automated source review · 2026-09-16 Audit detailsPrimary paper and/or task implementation reviewed for the explicitly cited methodology claims. Scope-limited absence is recorded only after the documented source search; no model runs or independent reproduction. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
View linked audit checks and correction history
Release 2026-09-29-06401fd5b220 · Record review: discovered
Stable ID: discovery-benchmark-cami-metagenome-assembly