rewirebio.iobenchmarks
Task

microbiome disease-state classification

Microbiome disease-state classification evaluates independent disease/control cohorts through leave-one-out prediction.

SourcesMultimodal deep learning applied to classify healthy and disease states of human microbiome · Methods: Data preparation and preprocessing; Performance evaluation; cached text lines 10–12, 28–30

1 evaluation · 1 result

Overview

Datasets

Four gut-microbiome datasets with IBD, type-2 diabetes, liver-cirrhosis or colorectal-cancer labels and controls.

Metrics

Accuracy, precision and recall.

Allowed inputs

Microbiome composition/features.

SourcesMultimodal deep learning applied to classify healthy and disease states of human microbiome · Methods: Data preparation and preprocessing; Performance evaluation; cached text lines 10–12, 28–30
Evaluation procedure diagram
How it worksComputational evaluation flow
Computational evaluation flow1. Input: Microbiome composition/features.. Then: 2. Evaluation: Embedding and classifier training are repeated inside leave-one-out folds, excluding the held-out subject sample.. Then: 3. Readout: Accuracy, precision and recall.Computational evaluation flow1. Input: Microbiome composition/features.. Then: 2. Evaluation: Embedding and classifier training are repeated inside leave-one-out folds, excluding the held-out subject sample.. Then: 3. Readout: Accuracy, precision and recall.Computational evaluation flow1. Input: Microbiome composition/features.. Then: 2. Evaluation: Embedding and classifier training are repeated inside leave-one-out folds, excluding the held-out subject sample.. Then: 3. Readout: Accuracy, precision and recall.

Conceptual summary of the cited evaluation; exact task configuration and source version remain part of the protocol.

SourcesMultimodal deep learning applied to classify healthy and disease states of human microbiome · Methods: Data preparation and preprocessing; Performance evaluation; cached text lines 10–12, 28–30

limited source coverage · Automated source review, 2026-09-16. All specifications and missing details

1 recorded evaluation, 1 metric rows. A comparison chart has not yet been validated for these results. The table retains the individual findings and their sources.

View coverage and remaining gaps across all benchmarks

Results

Results are available, but no reviewed comparison panel is linked in this release.

All evaluations

1 evaluation · 1 result. Different protocols are not a single leaderboard.

Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: MDL4MicrobiomeTask: microbiome disease-state classification
Dataset: CRC microbiome cohort
0.97 Accuracy
fraction · unknown

Uncertainty: Not yet extracted

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

MDL4Microbiome: microbiome disease-state classification

Multimodal deep learning model on colorectal-cancer versus healthy microbiome samples

Aggregation: Not reported

Multimodal deep learning applied to classify healthy and disease states of human microbiome · Table 3, CRC row, MDL4Microbiome column

Source checking is not independent reproduction. Release 2026-11-21-adc15377fab2.

Methods and evaluation design

Procedure, tasks and evaluated configurations

How it works

Evaluation methodology

Four gut-microbiome datasets with IBD, type-2 diabetes, liver-cirrhosis or colorectal-cancer labels and controls. Leave-one-out cross-validation excludes the held-out sample from both embedding training and final classifier training. Accuracy, precision and recall. Random forest, XGBoost, principal-component regression, lasso and SVM. The source explicitly removes the held-out sample from both learning stages. The cited text-accessible evaluation sections give no confidence-interval, resampling or repeat-run error-bar specification. Image-only tables and uninspected supplements are outside this absence claim.

SourcesMultimodal deep learning applied to classify healthy and disease states of human microbiome · Methods: Data preparation and preprocessing; Performance evaluation; cached text lines 10–12, 28–30

Recorded evaluations

Each evaluation records what was tested and under which conditions.

Run instructions

No runnable recipe has been reviewed for this task. Dataset access, model requirements, licences and compute requirements must be checked against its sources before execution.

A task describes a biological question. Choose a linked protocol to obtain concrete split and scoring instructions.

Strengths, limitations and unresolved questions

Strengths and limitations

Profile review details

Task-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced.

Stable record: reported-task-e2009c35eabd69

Specifications

Inputs, training, access and other details

Explanatory profile: limited source coverage · Automated source review, 2026-09-16. Review applies to the cited claims; unresolved fields are listed below. Numerical results retain their own review status.

Data, procedure and scoring
PropertyDescription and evidence
DatasetsFour gut-microbiome datasets with IBD, type-2 diabetes, liver-cirrhosis or colorectal-cancer labels and controls.
SourcesMultimodal deep learning applied to classify healthy and disease states of human microbiome · Methods: Data preparation and preprocessing; Performance evaluation; cached text lines 10–12, 28–30
SplitsLeave-one-out cross-validation excludes the held-out sample from both embedding training and final classifier training.
SourcesMultimodal deep learning applied to classify healthy and disease states of human microbiome · Methods: Data preparation and preprocessing; Performance evaluation; cached text lines 10–12, 28–30
MetricsAccuracy, precision and recall.
SourcesMultimodal deep learning applied to classify healthy and disease states of human microbiome · Methods: Data preparation and preprocessing; Performance evaluation; cached text lines 10–12, 28–30
BaselinesRandom forest, XGBoost, principal-component regression, lasso and SVM.
SourcesMultimodal deep learning applied to classify healthy and disease states of human microbiome · Methods: Data preparation and preprocessing; Performance evaluation; cached text lines 10–12, 28–30
Leakage controlsThe source explicitly removes the held-out sample from both learning stages.
SourcesMultimodal deep learning applied to classify healthy and disease states of human microbiome · Methods: Data preparation and preprocessing; Performance evaluation; cached text lines 10–12, 28–30
UncertaintyThe cited text-accessible evaluation sections give no confidence-interval, resampling or repeat-run error-bar specification. Image-only tables and uninspected supplements are outside this absence claim. · Not reported in inspected sources
SourcesMultimodal deep learning applied to classify healthy and disease states of human microbiome · Methods: Data preparation and preprocessing; Performance evaluation; cached text lines 10–12, 28–30
Entity typePaper-specific computational evaluation protocol.
SourcesMultimodal deep learning applied to classify healthy and disease states of human microbiome · Methods: Data preparation and preprocessing; Performance evaluation; cached text lines 10–12, 28–30
OrganismsHuman gut microbial communities.
SourcesMultimodal deep learning applied to classify healthy and disease states of human microbiome · Methods: Data preparation and preprocessing; Performance evaluation; cached text lines 10–12, 28–30
AssaysMicrobiome profiles with disease/control labels.
SourcesMultimodal deep learning applied to classify healthy and disease states of human microbiome · Methods: Data preparation and preprocessing; Performance evaluation; cached text lines 10–12, 28–30
Allowed inputsMicrobiome composition/features.
SourcesMultimodal deep learning applied to classify healthy and disease states of human microbiome · Methods: Data preparation and preprocessing; Performance evaluation; cached text lines 10–12, 28–30
AdaptationEmbedding and classifier training are repeated inside leave-one-out folds, excluding the held-out subject sample.
SourcesMultimodal deep learning applied to classify healthy and disease states of human microbiome · Methods: Data preparation and preprocessing; Performance evaluation; cached text lines 10–12, 28–30

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Papers and result coverage

Last literature check: 2026-09-17. Primary-paper discovery and source inspection. Source-checked results are not independently reproduced experiments.

Paper or primary resourceVersionReference
Multimodal deep learning applied to classify healthy and disease states of human microbiomePMC archival version PMC8763943.1Read source
DOI: 10.1038/s41598-022-04773-3
Historical gaps recorded on 2026-09-17

The catalogue now holds 1 result rows for this benchmark. A note below about pending extraction describes the state on 2026-09-17 and may since have been answered by a later batch. The result rows and their sources are the current record.

  • Disease datasets and cohort prevalences differ; do not pool accuracy.
  • No uncertainty in Table 3. Visualization using a 7:3 split is not the evaluation split.
Search and extraction details

primary comparison table screened

Searches

  • "PMC8763943"

Evidence locations

  • Table 3
  • Methods: Performance evaluation

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

18 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-adc15377fab2
Property and statementOriginal source and locationReview and provenance
Diagram caption
Conceptual summary of the cited evaluation; exact task configuration and source version remain part of the protocol.
Individual claims
Multimodal deep learning applied to classify healthy and disease states of human microbiome

Original source ↗

Methods: Data preparation and preprocessing; Performance evaluation; cached text lines 10–12, 28–30

Version: PMC archival version PMC8763943.1
Retrieved: 2026-09-16T10:33:58.492Z

source checked

automated source review · 2026-09-16

Audit details

Task-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced.

Field: attributes.profile.diagram.caption

Source artifact SHA-256: 72330eda245ac97c5de5d47a491bb86d9b8f527a03ae25fa41cae5bfb637143b

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Diagram steps
  • Input: Microbiome composition/features.
  • Evaluation: Embedding and classifier training are repeated inside leave-one-out folds, excluding the held-out subject sample.
  • Readout: Accuracy, precision and recall.
Individual claims
Multimodal deep learning applied to classify healthy and disease states of human microbiome

Original source ↗

Methods: Data preparation and preprocessing; Performance evaluation; cached text lines 10–12, 28–30

Version: PMC archival version PMC8763943.1
Retrieved: 2026-09-16T10:33:58.492Z

source checked

automated source review · 2026-09-16

Audit details

Task-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced.

Field: attributes.profile.diagram.steps

Source artifact SHA-256: 72330eda245ac97c5de5d47a491bb86d9b8f527a03ae25fa41cae5bfb637143b

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Diagram title
Computational evaluation flow
Individual claims
Multimodal deep learning applied to classify healthy and disease states of human microbiome

Original source ↗

Methods: Data preparation and preprocessing; Performance evaluation; cached text lines 10–12, 28–30

Version: PMC archival version PMC8763943.1
Retrieved: 2026-09-16T10:33:58.492Z

source checked

automated source review · 2026-09-16

Audit details

Task-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced.

Field: attributes.profile.diagram.title

Source artifact SHA-256: 72330eda245ac97c5de5d47a491bb86d9b8f527a03ae25fa41cae5bfb637143b

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Datasets
Four gut-microbiome datasets with IBD, type-2 diabetes, liver-cirrhosis or colorectal-cancer labels and controls.
Individual claims
Multimodal deep learning applied to classify healthy and disease states of human microbiome

Original source ↗

Methods: Data preparation and preprocessing; Performance evaluation; cached text lines 10–12, 28–30

Version: PMC archival version PMC8763943.1
Retrieved: 2026-09-16T10:33:58.492Z

source checked

automated source review · 2026-09-16

Audit details

Task-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced.

Field: attributes.profile.facts.0.value

Source artifact SHA-256: 72330eda245ac97c5de5d47a491bb86d9b8f527a03ae25fa41cae5bfb637143b

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Splits
Leave-one-out cross-validation excludes the held-out sample from both embedding training and final classifier training.
Individual claims
Multimodal deep learning applied to classify healthy and disease states of human microbiome

Original source ↗

Methods: Data preparation and preprocessing; Performance evaluation; cached text lines 10–12, 28–30

Version: PMC archival version PMC8763943.1
Retrieved: 2026-09-16T10:33:58.492Z

source checked

automated source review · 2026-09-16

Audit details

Task-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced.

Field: attributes.profile.facts.1.value

Source artifact SHA-256: 72330eda245ac97c5de5d47a491bb86d9b8f527a03ae25fa41cae5bfb637143b

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Adaptation
Embedding and classifier training are repeated inside leave-one-out folds, excluding the held-out subject sample.
Individual claims
Multimodal deep learning applied to classify healthy and disease states of human microbiome

Original source ↗

Methods: Data preparation and preprocessing; Performance evaluation; cached text lines 10–12, 28–30

Version: PMC archival version PMC8763943.1
Retrieved: 2026-09-16T10:33:58.492Z

source checked

automated source review · 2026-09-16

Audit details

Task-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced.

Field: attributes.profile.facts.10.value

Source artifact SHA-256: 72330eda245ac97c5de5d47a491bb86d9b8f527a03ae25fa41cae5bfb637143b

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Metrics
Accuracy, precision and recall.
Individual claims
Multimodal deep learning applied to classify healthy and disease states of human microbiome

Original source ↗

Methods: Data preparation and preprocessing; Performance evaluation; cached text lines 10–12, 28–30

Version: PMC archival version PMC8763943.1
Retrieved: 2026-09-16T10:33:58.492Z

source checked

automated source review · 2026-09-16

Audit details

Task-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced.

Field: attributes.profile.facts.2.value

Source artifact SHA-256: 72330eda245ac97c5de5d47a491bb86d9b8f527a03ae25fa41cae5bfb637143b

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Baselines
Random forest, XGBoost, principal-component regression, lasso and SVM.
Individual claims
Multimodal deep learning applied to classify healthy and disease states of human microbiome

Original source ↗

Methods: Data preparation and preprocessing; Performance evaluation; cached text lines 10–12, 28–30

Version: PMC archival version PMC8763943.1
Retrieved: 2026-09-16T10:33:58.492Z

source checked

automated source review · 2026-09-16

Audit details

Task-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced.

Field: attributes.profile.facts.3.value

Source artifact SHA-256: 72330eda245ac97c5de5d47a491bb86d9b8f527a03ae25fa41cae5bfb637143b

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Leakage controls
The source explicitly removes the held-out sample from both learning stages.
Individual claims
Multimodal deep learning applied to classify healthy and disease states of human microbiome

Original source ↗

Methods: Data preparation and preprocessing; Performance evaluation; cached text lines 10–12, 28–30

Version: PMC archival version PMC8763943.1
Retrieved: 2026-09-16T10:33:58.492Z

source checked

automated source review · 2026-09-16

Audit details

Task-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced.

Field: attributes.profile.facts.4.value

Source artifact SHA-256: 72330eda245ac97c5de5d47a491bb86d9b8f527a03ae25fa41cae5bfb637143b

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Uncertainty
The cited text-accessible evaluation sections give no confidence-interval, resampling or repeat-run error-bar specification. Image-only tables and uninspected supplements are outside this absence claim.
Individual claims
Multimodal deep learning applied to classify healthy and disease states of human microbiome

Original source ↗

Methods: Data preparation and preprocessing; Performance evaluation; cached text lines 10–12, 28–30

Version: PMC archival version PMC8763943.1
Retrieved: 2026-09-16T10:33:58.492Z

unreported

automated source review · 2026-09-16

Audit details

Task-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced.

Field: attributes.profile.facts.5.value

Source artifact SHA-256: 72330eda245ac97c5de5d47a491bb86d9b8f527a03ae25fa41cae5bfb637143b

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-21-adc15377fab2 · Record review: needs review

2 source records and release historyDownload this release (gzip)
Technical metadata and record identifiers

Technical metadata for this record is tracked under stable ID reported-task-e2009c35eabd69.

Related records

Suggest a correction