rewirebio.iobenchmarks
Configuration

MetageNN (main database, Peres da Silva et al. 2024)

Configuration of MetageNN: Main-database model (capacity about doubled from the small-database model), trained 3 days on four GPUs with early stopping; reads segmented into non-overlapping 1 kbp chunks, majority vote, classified if probability >= 0.5.

3 evaluations · 5 results

Overview

An explanatory profile has not yet been reviewed for this record.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Evaluations and results

3 evaluations · 5 results. Different protocols are not a single leaderboard.

Sorted by F1 (genus level; mean across the out-of-database isolates whose genus has more than three species) (higher is better). The best value in each column is highlighted. Decimals are rounded for display; each value links to the printed value and its source.

Tested configurationProtocol and datasetF1 (genus level; mean across the out-of-database isolates whose genus has more than three species)Inference throughput (reads classified per second with four CPUs)Recall (genus level; mean across the out-of-database isolates whose genus has more than three species)Reference storage size (database or index (model weights for MetageNN and GeNet) built from the 516-genome main database)Proportion (share of reads assigned at genus level (correct or not); mean across 30 pseudo-mock communities of out-of-database species)
MetageNN (main database, Peres da Silva et al. 2024)EvaluationGenus-level read classification of ONT bacterial isolates, main database (Peres da Silva et al. 2024), ONT reads from 81 bacterial isolates (Peres da Silva et al. 2024)0.88Not reported0.87Not reportedNot reported
MetageNN (main database, Peres da Silva et al. 2024)EvaluationRead classification on 30 ONT pseudo-mock communities of out-of-database species (Peres da Silva et al. 2024), 30 ONT pseudo-mock communities of out-of-database species (Peres da Silva et al. 2024)Not reportedNot reportedNot reportedNot reported93.3%
MetageNN (main database, Peres da Silva et al. 2024)EvaluationDatabase storage and classification speed on ONT data, main database (Peres da Silva et al. 2024), ONT reads from 81 bacterial isolates (Peres da Silva et al. 2024)Not reported1424Not reported0.839Not reported
All 5 result rows with coverage, uncertainty and sources
Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: MetageNN (main database, Peres da Silva et al. 2024)Protocol: Genus-level read classification of ONT bacterial isolates, main database (Peres da Silva et al. 2024)
Dataset: ONT reads from 81 bacterial isolates (Peres da Silva et al. 2024)
0.88 F1 (genus level; mean across the out-of-database isolates whose genus has more than three species)
fraction · higher

Uncertainty: Not reported by the source: Figure 3 shows standard-deviation error bars; no value is printed in the text

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

MetageNN on genus-level read classification of ONT bacterial isolates, main database (Peres da Silva et al. 2024)

dna-pathogen-20261012-metagenn-protocol-isolates

Aggregation: Not reported

MetageNN: a memory-efficient neural network taxonomic classifier robust to sequencing errors and missing genomes · Results 'Results for “Species out of the database” settings' paragraph 3, last sentences (values shown in Fig. 3f)
Configuration: MetageNN (main database, Peres da Silva et al. 2024)Protocol: Genus-level read classification of ONT bacterial isolates, main database (Peres da Silva et al. 2024)
Dataset: ONT reads from 81 bacterial isolates (Peres da Silva et al. 2024)
0.87 Recall (genus level; mean across the out-of-database isolates whose genus has more than three species)
fraction · higher

Uncertainty: Not reported by the source: Figure 3 shows standard-deviation error bars; no value is printed in the text

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

MetageNN on genus-level read classification of ONT bacterial isolates, main database (Peres da Silva et al. 2024)

dna-pathogen-20261012-metagenn-protocol-isolates

Aggregation: Not reported

MetageNN: a memory-efficient neural network taxonomic classifier robust to sequencing errors and missing genomes · Results 'Results for “Species out of the database” settings' paragraph 3, last sentences (values shown in Fig. 3f)
Configuration: MetageNN (main database, Peres da Silva et al. 2024)Protocol: Read classification on 30 ONT pseudo-mock communities of out-of-database species (Peres da Silva et al. 2024)
Dataset: 30 ONT pseudo-mock communities of out-of-database species (Peres da Silva et al. 2024)
93.3% Proportion (share of reads assigned at genus level (correct or not); mean across 30 pseudo-mock communities of out-of-database species)
percent · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

MetageNN on read classification on 30 ONT pseudo-mock communities of out-of-database species (Peres da Silva et al. 2024)

dna-pathogen-20261012-metagenn-protocol-mocks

Aggregation: Not reported

MetageNN: a memory-efficient neural network taxonomic classifier robust to sequencing errors and missing genomes · Results 'Read classification results' paragraph 1 (values shown in Fig. 4a)
Configuration: MetageNN (main database, Peres da Silva et al. 2024)Protocol: Database storage and classification speed on ONT data, main database (Peres da Silva et al. 2024)
Dataset: ONT reads from 81 bacterial isolates (Peres da Silva et al. 2024)
1420 Inference throughput (reads classified per second with four CPUs)
sample-per-second · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

MetageNN on database storage and classification speed on ONT data, main database (Peres da Silva et al. 2024)

dna-pathogen-20261012-metagenn-protocol-resources

Aggregation: Not reported

MetageNN: a memory-efficient neural network taxonomic classifier robust to sequencing errors and missing genomes · Table 1, row "MetageNN", column "Speed (reads/sec)"
Configuration: MetageNN (main database, Peres da Silva et al. 2024)Protocol: Database storage and classification speed on ONT data, main database (Peres da Silva et al. 2024)
Dataset: ONT reads from 81 bacterial isolates (Peres da Silva et al. 2024)
0.839 Reference storage size (database or index (model weights for MetageNN and GeNet) built from the 516-genome main database)
gigabyte · lower

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

MetageNN on database storage and classification speed on ONT data, main database (Peres da Silva et al. 2024)

dna-pathogen-20261012-metagenn-protocol-resources

Aggregation: Not reported

MetageNN: a memory-efficient neural network taxonomic classifier robust to sequencing errors and missing genomes · Table 1, row "MetageNN", column "Memory (GB)"

Source checking is not independent reproduction. Release 2026-10-22-1b7cf027e4f6.

Use this configuration

How it works, versions and access
Strengths, limitations and unresolved questions

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-10-22-1b7cf027e4f6
Property and statementOriginal source and locationReview and provenance

No evidence rows match these filters. Choose another scope or clear the search.

Sources and history

Release 2026-10-22-1b7cf027e4f6 · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: dna-pathogen-20261012-metagenn-config-metagenn

areas
microbes-communities
contexts
research
method types
supervised_machine_learning
reported name
MetageNN
foundation model eligible
false
parameters
Main-database model (capacity about doubled from the small-database model), trained 3 days on four GPUs with early stopping; reads segmented into non-overlapping 1 kbp chunks, majority vote, classified if probability >= 0.5
source locator
Results 'MetageNN presents a higher F1 score than GeNet...' Baselines and Experimental setup; Methods 'Databases'
access reuse
Tool run by the article's authors; the trained MetageNN model is not linked from the article
missing metadata
version: reason: unreported; note: No tool versions are given
review
method: source-hash-verification; scope-review; reviewer: claude; reviewer note: Separate Claude review agent (rev-mlvb), independent of the extracting agent; no human review claimed; date: 2026-10-12; artifact sha256: ac4b137508d295d5e04e9be263bef40bdcf2c494e096407e5896611194f14e12; retrieval url: https://www.ebi.ac.uk/europepmc/webservices/rest/PMC11022314/fullTextXML; note: Checked against the re-downloaded article XML (SHA-256 matches).
provenance note
MetageNN as run by the MetageNN authors with the 516-genome main database.
Related records

Suggest a correction