rewire.itbenchmarks
Result

83.1 F1

Nucleotide Transformers V2: F1 on Natural versus GenomeOcean-generated DNA classification

Tested configuration
Nucleotide Transformers V2
Protocol
Natural versus GenomeOcean-generated DNA classification (Natural vs artificial microbial genome sequence)
Dataset
GenomeOcean natural/artificial sequence test
Related family profiles
Nucleotide Transformer
Procedure
DNABERT 2 and NTv 2 standard fine-tuning; GenomeOcean LoRA. Negatives generated by GenomeOcean itself. CAMI 2 train 18,000/validation 2,000; GTDB test 20,000; balanced natural/artificial 2 kb sequences.
Evaluation
Nucleotide Transformers V2: Natural versus GenomeOcean-generated DNA classification
Coverage
scored: unreported; eligible: unreported
Uncertainty
Not reported
Evidence
Author-reported evaluation · source checkedGenomeOcean: An Efficient Genome Foundation Model Trained on Large-Scale Metagenomic Assemblies · Table 2:, row Nucleotide Transformers V2, column F1; XML row3 column4

A source-checked result verifies the numerical transcription, not every model or protocol detail. Evaluation metadata: needs review. Source checked does not mean independently reproduced.

Reproduction

Split
CAMI 2 train 18,000/validation 2,000; GTDB test 20,000; balanced natural/artificial 2 kb sequences.
Adaptation
Paper-specific evaluated pipeline; exact checkpoint not inferred from label
Scoring implementation
Not reported

No execution recipe has been verified for this exact configuration and evaluation. A benchmark's general instructions may use different inputs, splits or model settings.

Reproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

1 evidence row matching the loaded filters

Claims, original sources and review scope · Release 2026-09-29-06401fd5b220
Property and statementOriginal source and locationReview and provenance
Reported result
83.14
Individual claims
GenomeOcean: An Efficient Genome Foundation Model Trained on Large-Scale Metagenomic Assemblies

Original source ↗

Table 2:, row Nucleotide Transformers V2, column F1; XML row3 column4

Version: preprint archived 2025-02-05
Retrieved: 2026-09-17T07:56:18.823068+00:00

source checked

Primary-table transcription and separate automated source review · 2026-09-17

author reported

Audit details

Source checked does not mean experimentally reproduced.

Field: attributes.printed_value

Source artifact SHA-256: 3cc0df52522fccda23e3958f069c916b87ee50bb5c9a992fa37e25256546e145

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Sources and history

View linked audit checks and correction history

Release 2026-09-29-06401fd5b220 · Record review: source checked

1 source records and release historyDownload this release
Technical metadata and extraction receipts

Stable ID: paper-result-0209741f5d0e66b495

areas
microbes-communities
tasks
Natural vs artificial microbial genome sequence
printed value
83.14
numeric value
83.14
metric
F1
metric direction
higher
unit
%
uncertainty
Not reported
eligible count
Not reported
scored count
Not reported
reported population
Not reported
source locator
Table 2:, row Nucleotide Transformers V2, column F1; XML row3 column4
source occurrences
source id: part2-genomeocean-2025; locator: Table 2:, row Nucleotide Transformers V2, column F1; XML row3 column4
review
method: Primary-table transcription and separate automated source review; date: 2026-09-17; note: Source checked does not mean experimentally reproduced.
missing metadata
scored count: unreported; eligible count: unextracted; checkpoint revision: unextracted; uncertainty: unreported
Related records

Suggest a correction