rewirebio.iobenchmarks
Pipeline

NT-2.5b-1000g

Frozen NT-2.5b-1000g mean-pooled last-hidden-state embeddings with task-specific logistic-regression or mini-batch k-means probe. Exact source checkpoint/evaluator revision is unreported.

16 evaluations · 16 results

Overview

An explanatory profile has not yet been reviewed for this record.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Model Capabilities & Hardware Requirements

Deployment facts recorded for NT-2.5b-1000g. Fields the record does not carry are marked not recorded.

ParametersNot recorded
Minimum VRAMNot recorded
Inference LatencyNot recorded
Context WindowNot recorded
AccessNot recorded
LicenseNot recorded

Evaluations and results

16 evaluations · 16 results. Different protocols are not a single leaderboard.

Sorted by Accuracy (higher is better). The best value in each column is highlighted. Decimals are rounded for display; each value links to the printed value and its source.

Tested configurationProtocol and datasetAccuracyV measure
NT-2.5b-1000gEvaluationGene-MTEB genomic embedding benchmark Human-Virus-4: Human-Virus-4 genomic embedding evaluation, Human-Virus-4 Gene-MTEB data used in METAGENE-1 Table 3 (Gene-MTEB genomic embedding benchmark split)0.755 (best in column)Not reported
NT-2.5b-1000gEvaluationGene-MTEB genomic embedding benchmark Human-Virus-3: Human-Virus-3 genomic embedding evaluation, Human-Virus-3 Gene-MTEB data used in METAGENE-1 Table 3 (Gene-MTEB genomic embedding benchmark split)0.74Not reported
NT-2.5b-1000gEvaluationGene-MTEB genomic embedding benchmark Human-Virus-1: Human-Virus-1 genomic embedding evaluation, Human-Virus-1 Gene-MTEB data used in METAGENE-1 Table 3 (Gene-MTEB genomic embedding benchmark split)0.721Not reported
NT-2.5b-1000gEvaluationGene-MTEB genomic embedding benchmark Human-Virus-2: Human-Virus-2 genomic embedding evaluation, Human-Virus-2 Gene-MTEB data used in METAGENE-1 Table 3 (Gene-MTEB genomic embedding benchmark split)0.624Not reported
NT-2.5b-1000gEvaluationGene-MTEB genomic embedding benchmark HMPD-source: HMPD-source genomic embedding evaluation, HMPD-source Gene-MTEB data used in METAGENE-1 Table 3 (Gene-MTEB genomic embedding benchmark split)0.545Not reported
NT-2.5b-1000gEvaluationGene-MTEB genomic embedding benchmark HMPD-disease: HMPD-disease genomic embedding evaluation, HMPD-disease Gene-MTEB data used in METAGENE-1 Table 3 (Gene-MTEB genomic embedding benchmark split)0.489Not reported
NT-2.5b-1000gEvaluationGene-MTEB genomic embedding benchmark HMPD-sex: HMPD-sex genomic embedding evaluation, HMPD-sex Gene-MTEB data used in METAGENE-1 Table 3 (Gene-MTEB genomic embedding benchmark split)0.476Not reported
NT-2.5b-1000gEvaluationGene-MTEB genomic embedding benchmark HMPD-single: HMPD-single genomic embedding evaluation, HMPD-single Gene-MTEB data used in METAGENE-1 Table 3 (Gene-MTEB genomic embedding benchmark split)0.292Not reported
NT-2.5b-1000gEvaluationGene-MTEB genomic embedding benchmark HMPR-p2p: HMPR-p2p genomic embedding evaluation, HMPR-p2p Gene-MTEB data used in METAGENE-1 Table 3 (Gene-MTEB genomic embedding benchmark split)Not reported0.543
NT-2.5b-1000gEvaluationGene-MTEB genomic embedding benchmark HMPR-s2s-align: HMPR-s2s-align genomic embedding evaluation, HMPR-s2s-align Gene-MTEB data used in METAGENE-1 Table 3 (Gene-MTEB genomic embedding benchmark split)Not reported0.219
NT-2.5b-1000gEvaluationGene-MTEB genomic embedding benchmark HMPR-s2s-small: HMPR-s2s-small genomic embedding evaluation, HMPR-s2s-small Gene-MTEB data used in METAGENE-1 Table 3 (Gene-MTEB genomic embedding benchmark split)Not reported0.459
NT-2.5b-1000gEvaluationGene-MTEB genomic embedding benchmark HMPR-s2s-tiny: HMPR-s2s-tiny genomic embedding evaluation, HMPR-s2s-tiny Gene-MTEB data used in METAGENE-1 Table 3 (Gene-MTEB genomic embedding benchmark split)Not reported0.391
NT-2.5b-1000gEvaluationGene-MTEB genomic embedding benchmark HVR-p2p: HVR-p2p genomic embedding evaluation, HVR-p2p Gene-MTEB data used in METAGENE-1 Table 3 (Gene-MTEB genomic embedding benchmark split)Not reported0.65
NT-2.5b-1000gEvaluationGene-MTEB genomic embedding benchmark HVR-s2s-align: HVR-s2s-align genomic embedding evaluation, HVR-s2s-align Gene-MTEB data used in METAGENE-1 Table 3 (Gene-MTEB genomic embedding benchmark split)Not reported0.293
NT-2.5b-1000gEvaluationGene-MTEB genomic embedding benchmark HVR-s2s-small: HVR-s2s-small genomic embedding evaluation, HVR-s2s-small Gene-MTEB data used in METAGENE-1 Table 3 (Gene-MTEB genomic embedding benchmark split)Not reported0.371
NT-2.5b-1000gEvaluationGene-MTEB genomic embedding benchmark HVR-s2s-tiny: HVR-s2s-tiny genomic embedding evaluation, HVR-s2s-tiny Gene-MTEB data used in METAGENE-1 Table 3 (Gene-MTEB genomic embedding benchmark split)Not reported0.782 (best in column)
All 16 result rows with coverage, uncertainty and sources
Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Pipeline: NT-2.5b-1000gProtocol: Gene-MTEB genomic embedding benchmark HMPD-disease: HMPD-disease genomic embedding evaluation
Dataset subset: HMPD-disease Gene-MTEB data used in METAGENE-1 Table 3 (Gene-MTEB genomic embedding benchmark split)
0.489 Accuracy
fraction · higher

Uncertainty: Not yet extracted

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT-2.5b-1000g on Gene-MTEB genomic embedding benchmark HMPD-disease: HMPD-disease genomic embedding evaluation

Frozen model last-hidden-state embeddings, mean pooled. Logistic regression for eight classification tasks and mini-batch k-means for eight clustering tasks. Source paper Section 5.3. Current official gene-mteb implementation corroborates task identities but its commit is not proven identical to the paper evaluator. Exact dataset release, split hash, scored counts and evaluator commit are unreported in the paper. Do not substitute current mutable HF main for the original split.

Aggregation: Not reported

METAGENE-1 v1: Gene-MTEB complete component tasks · Table 3 (S5.T3), row HMPD-disease, column NT-2.5b-1000g; Section 5.3 paragraphs S5.SS3.p2.1 and S5.SS3.p3.1
Pipeline: NT-2.5b-1000gProtocol: Gene-MTEB genomic embedding benchmark HMPD-sex: HMPD-sex genomic embedding evaluation
Dataset subset: HMPD-sex Gene-MTEB data used in METAGENE-1 Table 3 (Gene-MTEB genomic embedding benchmark split)
0.476 Accuracy
fraction · higher

Uncertainty: Not yet extracted

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT-2.5b-1000g on Gene-MTEB genomic embedding benchmark HMPD-sex: HMPD-sex genomic embedding evaluation

Frozen model last-hidden-state embeddings, mean pooled. Logistic regression for eight classification tasks and mini-batch k-means for eight clustering tasks. Source paper Section 5.3. Current official gene-mteb implementation corroborates task identities but its commit is not proven identical to the paper evaluator. Exact dataset release, split hash, scored counts and evaluator commit are unreported in the paper. Do not substitute current mutable HF main for the original split.

Aggregation: Not reported

METAGENE-1 v1: Gene-MTEB complete component tasks · Table 3 (S5.T3), row HMPD-sex, column NT-2.5b-1000g; Section 5.3 paragraphs S5.SS3.p2.1 and S5.SS3.p3.1
Pipeline: NT-2.5b-1000gProtocol: Gene-MTEB genomic embedding benchmark HMPD-single: HMPD-single genomic embedding evaluation
Dataset subset: HMPD-single Gene-MTEB data used in METAGENE-1 Table 3 (Gene-MTEB genomic embedding benchmark split)
0.292 Accuracy
fraction · higher

Uncertainty: Not yet extracted

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT-2.5b-1000g on Gene-MTEB genomic embedding benchmark HMPD-single: HMPD-single genomic embedding evaluation

Frozen model last-hidden-state embeddings, mean pooled. Logistic regression for eight classification tasks and mini-batch k-means for eight clustering tasks. Source paper Section 5.3. Current official gene-mteb implementation corroborates task identities but its commit is not proven identical to the paper evaluator. Exact dataset release, split hash, scored counts and evaluator commit are unreported in the paper. Do not substitute current mutable HF main for the original split.

Aggregation: Not reported

METAGENE-1 v1: Gene-MTEB complete component tasks · Table 3 (S5.T3), row HMPD-single, column NT-2.5b-1000g; Section 5.3 paragraphs S5.SS3.p2.1 and S5.SS3.p3.1
Pipeline: NT-2.5b-1000gProtocol: Gene-MTEB genomic embedding benchmark HMPD-source: HMPD-source genomic embedding evaluation
Dataset subset: HMPD-source Gene-MTEB data used in METAGENE-1 Table 3 (Gene-MTEB genomic embedding benchmark split)
0.545 Accuracy
fraction · higher

Uncertainty: Not yet extracted

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT-2.5b-1000g on Gene-MTEB genomic embedding benchmark HMPD-source: HMPD-source genomic embedding evaluation

Frozen model last-hidden-state embeddings, mean pooled. Logistic regression for eight classification tasks and mini-batch k-means for eight clustering tasks. Source paper Section 5.3. Current official gene-mteb implementation corroborates task identities but its commit is not proven identical to the paper evaluator. Exact dataset release, split hash, scored counts and evaluator commit are unreported in the paper. Do not substitute current mutable HF main for the original split.

Aggregation: Not reported

METAGENE-1 v1: Gene-MTEB complete component tasks · Table 3 (S5.T3), row HMPD-source, column NT-2.5b-1000g; Section 5.3 paragraphs S5.SS3.p2.1 and S5.SS3.p3.1
Pipeline: NT-2.5b-1000gProtocol: Gene-MTEB genomic embedding benchmark HMPR-p2p: HMPR-p2p genomic embedding evaluation
Dataset subset: HMPR-p2p Gene-MTEB data used in METAGENE-1 Table 3 (Gene-MTEB genomic embedding benchmark split)
0.543 V measure
unitless · higher

Uncertainty: Not yet extracted

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT-2.5b-1000g on Gene-MTEB genomic embedding benchmark HMPR-p2p: HMPR-p2p genomic embedding evaluation

Frozen model last-hidden-state embeddings, mean pooled. Logistic regression for eight classification tasks and mini-batch k-means for eight clustering tasks. Source paper Section 5.3. Current official gene-mteb implementation corroborates task identities but its commit is not proven identical to the paper evaluator. Exact dataset release, split hash, scored counts and evaluator commit are unreported in the paper. Do not substitute current mutable HF main for the original split.

Aggregation: Not reported

METAGENE-1 v1: Gene-MTEB complete component tasks · Table 3 (S5.T3), row HMPR-p2p, column NT-2.5b-1000g; Section 5.3 paragraphs S5.SS3.p2.1 and S5.SS3.p3.1
Pipeline: NT-2.5b-1000gProtocol: Gene-MTEB genomic embedding benchmark HMPR-s2s-align: HMPR-s2s-align genomic embedding evaluation
Dataset subset: HMPR-s2s-align Gene-MTEB data used in METAGENE-1 Table 3 (Gene-MTEB genomic embedding benchmark split)
0.219 V measure
unitless · higher

Uncertainty: Not yet extracted

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT-2.5b-1000g on Gene-MTEB genomic embedding benchmark HMPR-s2s-align: HMPR-s2s-align genomic embedding evaluation

Frozen model last-hidden-state embeddings, mean pooled. Logistic regression for eight classification tasks and mini-batch k-means for eight clustering tasks. Source paper Section 5.3. Current official gene-mteb implementation corroborates task identities but its commit is not proven identical to the paper evaluator. Exact dataset release, split hash, scored counts and evaluator commit are unreported in the paper. Do not substitute current mutable HF main for the original split.

Aggregation: Not reported

METAGENE-1 v1: Gene-MTEB complete component tasks · Table 3 (S5.T3), row HMPR-s2s-align, column NT-2.5b-1000g; Section 5.3 paragraphs S5.SS3.p2.1 and S5.SS3.p3.1
Pipeline: NT-2.5b-1000gProtocol: Gene-MTEB genomic embedding benchmark HMPR-s2s-small: HMPR-s2s-small genomic embedding evaluation
Dataset subset: HMPR-s2s-small Gene-MTEB data used in METAGENE-1 Table 3 (Gene-MTEB genomic embedding benchmark split)
0.459 V measure
unitless · higher

Uncertainty: Not yet extracted

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT-2.5b-1000g on Gene-MTEB genomic embedding benchmark HMPR-s2s-small: HMPR-s2s-small genomic embedding evaluation

Frozen model last-hidden-state embeddings, mean pooled. Logistic regression for eight classification tasks and mini-batch k-means for eight clustering tasks. Source paper Section 5.3. Current official gene-mteb implementation corroborates task identities but its commit is not proven identical to the paper evaluator. Exact dataset release, split hash, scored counts and evaluator commit are unreported in the paper. Do not substitute current mutable HF main for the original split.

Aggregation: Not reported

METAGENE-1 v1: Gene-MTEB complete component tasks · Table 3 (S5.T3), row HMPR-s2s-small, column NT-2.5b-1000g; Section 5.3 paragraphs S5.SS3.p2.1 and S5.SS3.p3.1
Pipeline: NT-2.5b-1000gProtocol: Gene-MTEB genomic embedding benchmark HMPR-s2s-tiny: HMPR-s2s-tiny genomic embedding evaluation
Dataset subset: HMPR-s2s-tiny Gene-MTEB data used in METAGENE-1 Table 3 (Gene-MTEB genomic embedding benchmark split)
0.391 V measure
unitless · higher

Uncertainty: Not yet extracted

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT-2.5b-1000g on Gene-MTEB genomic embedding benchmark HMPR-s2s-tiny: HMPR-s2s-tiny genomic embedding evaluation

Frozen model last-hidden-state embeddings, mean pooled. Logistic regression for eight classification tasks and mini-batch k-means for eight clustering tasks. Source paper Section 5.3. Current official gene-mteb implementation corroborates task identities but its commit is not proven identical to the paper evaluator. Exact dataset release, split hash, scored counts and evaluator commit are unreported in the paper. Do not substitute current mutable HF main for the original split.

Aggregation: Not reported

METAGENE-1 v1: Gene-MTEB complete component tasks · Table 3 (S5.T3), row HMPR-s2s-tiny, column NT-2.5b-1000g; Section 5.3 paragraphs S5.SS3.p2.1 and S5.SS3.p3.1
Pipeline: NT-2.5b-1000gProtocol: Gene-MTEB genomic embedding benchmark Human-Virus-1: Human-Virus-1 genomic embedding evaluation
Dataset subset: Human-Virus-1 Gene-MTEB data used in METAGENE-1 Table 3 (Gene-MTEB genomic embedding benchmark split)
0.721 Accuracy
fraction · higher

Uncertainty: Not yet extracted

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT-2.5b-1000g on Gene-MTEB genomic embedding benchmark Human-Virus-1: Human-Virus-1 genomic embedding evaluation

Frozen model last-hidden-state embeddings, mean pooled. Logistic regression for eight classification tasks and mini-batch k-means for eight clustering tasks. Source paper Section 5.3. Current official gene-mteb implementation corroborates task identities but its commit is not proven identical to the paper evaluator. Exact dataset release, split hash, scored counts and evaluator commit are unreported in the paper. Do not substitute current mutable HF main for the original split.

Aggregation: Not reported

METAGENE-1 v1: Gene-MTEB complete component tasks · Table 3 (S5.T3), row Human-Virus-1, column NT-2.5b-1000g; Section 5.3 paragraphs S5.SS3.p2.1 and S5.SS3.p3.1
Pipeline: NT-2.5b-1000gProtocol: Gene-MTEB genomic embedding benchmark Human-Virus-2: Human-Virus-2 genomic embedding evaluation
Dataset subset: Human-Virus-2 Gene-MTEB data used in METAGENE-1 Table 3 (Gene-MTEB genomic embedding benchmark split)
0.624 Accuracy
fraction · higher

Uncertainty: Not yet extracted

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT-2.5b-1000g on Gene-MTEB genomic embedding benchmark Human-Virus-2: Human-Virus-2 genomic embedding evaluation

Frozen model last-hidden-state embeddings, mean pooled. Logistic regression for eight classification tasks and mini-batch k-means for eight clustering tasks. Source paper Section 5.3. Current official gene-mteb implementation corroborates task identities but its commit is not proven identical to the paper evaluator. Exact dataset release, split hash, scored counts and evaluator commit are unreported in the paper. Do not substitute current mutable HF main for the original split.

Aggregation: Not reported

METAGENE-1 v1: Gene-MTEB complete component tasks · Table 3 (S5.T3), row Human-Virus-2, column NT-2.5b-1000g; Section 5.3 paragraphs S5.SS3.p2.1 and S5.SS3.p3.1
Pipeline: NT-2.5b-1000gProtocol: Gene-MTEB genomic embedding benchmark Human-Virus-3: Human-Virus-3 genomic embedding evaluation
Dataset subset: Human-Virus-3 Gene-MTEB data used in METAGENE-1 Table 3 (Gene-MTEB genomic embedding benchmark split)
0.74 Accuracy
fraction · higher

Uncertainty: Not yet extracted

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT-2.5b-1000g on Gene-MTEB genomic embedding benchmark Human-Virus-3: Human-Virus-3 genomic embedding evaluation

Frozen model last-hidden-state embeddings, mean pooled. Logistic regression for eight classification tasks and mini-batch k-means for eight clustering tasks. Source paper Section 5.3. Current official gene-mteb implementation corroborates task identities but its commit is not proven identical to the paper evaluator. Exact dataset release, split hash, scored counts and evaluator commit are unreported in the paper. Do not substitute current mutable HF main for the original split.

Aggregation: Not reported

METAGENE-1 v1: Gene-MTEB complete component tasks · Table 3 (S5.T3), row Human-Virus-3, column NT-2.5b-1000g; Section 5.3 paragraphs S5.SS3.p2.1 and S5.SS3.p3.1
Pipeline: NT-2.5b-1000gProtocol: Gene-MTEB genomic embedding benchmark Human-Virus-4: Human-Virus-4 genomic embedding evaluation
Dataset subset: Human-Virus-4 Gene-MTEB data used in METAGENE-1 Table 3 (Gene-MTEB genomic embedding benchmark split)
0.755 Accuracy
fraction · higher

Uncertainty: Not yet extracted

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT-2.5b-1000g on Gene-MTEB genomic embedding benchmark Human-Virus-4: Human-Virus-4 genomic embedding evaluation

Frozen model last-hidden-state embeddings, mean pooled. Logistic regression for eight classification tasks and mini-batch k-means for eight clustering tasks. Source paper Section 5.3. Current official gene-mteb implementation corroborates task identities but its commit is not proven identical to the paper evaluator. Exact dataset release, split hash, scored counts and evaluator commit are unreported in the paper. Do not substitute current mutable HF main for the original split.

Aggregation: Not reported

METAGENE-1 v1: Gene-MTEB complete component tasks · Table 3 (S5.T3), row Human-Virus-4, column NT-2.5b-1000g; Section 5.3 paragraphs S5.SS3.p2.1 and S5.SS3.p3.1
Pipeline: NT-2.5b-1000gProtocol: Gene-MTEB genomic embedding benchmark HVR-p2p: HVR-p2p genomic embedding evaluation
Dataset subset: HVR-p2p Gene-MTEB data used in METAGENE-1 Table 3 (Gene-MTEB genomic embedding benchmark split)
0.65 V measure
unitless · higher

Uncertainty: Not yet extracted

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT-2.5b-1000g on Gene-MTEB genomic embedding benchmark HVR-p2p: HVR-p2p genomic embedding evaluation

Frozen model last-hidden-state embeddings, mean pooled. Logistic regression for eight classification tasks and mini-batch k-means for eight clustering tasks. Source paper Section 5.3. Current official gene-mteb implementation corroborates task identities but its commit is not proven identical to the paper evaluator. Exact dataset release, split hash, scored counts and evaluator commit are unreported in the paper. Do not substitute current mutable HF main for the original split.

Aggregation: Not reported

METAGENE-1 v1: Gene-MTEB complete component tasks · Table 3 (S5.T3), row HVR-p2p, column NT-2.5b-1000g; Section 5.3 paragraphs S5.SS3.p2.1 and S5.SS3.p3.1
Pipeline: NT-2.5b-1000gProtocol: Gene-MTEB genomic embedding benchmark HVR-s2s-align: HVR-s2s-align genomic embedding evaluation
Dataset subset: HVR-s2s-align Gene-MTEB data used in METAGENE-1 Table 3 (Gene-MTEB genomic embedding benchmark split)
0.293 V measure
unitless · higher

Uncertainty: Not yet extracted

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT-2.5b-1000g on Gene-MTEB genomic embedding benchmark HVR-s2s-align: HVR-s2s-align genomic embedding evaluation

Frozen model last-hidden-state embeddings, mean pooled. Logistic regression for eight classification tasks and mini-batch k-means for eight clustering tasks. Source paper Section 5.3. Current official gene-mteb implementation corroborates task identities but its commit is not proven identical to the paper evaluator. Exact dataset release, split hash, scored counts and evaluator commit are unreported in the paper. Do not substitute current mutable HF main for the original split.

Aggregation: Not reported

METAGENE-1 v1: Gene-MTEB complete component tasks · Table 3 (S5.T3), row HVR-s2s-align, column NT-2.5b-1000g; Section 5.3 paragraphs S5.SS3.p2.1 and S5.SS3.p3.1
Pipeline: NT-2.5b-1000gProtocol: Gene-MTEB genomic embedding benchmark HVR-s2s-small: HVR-s2s-small genomic embedding evaluation
Dataset subset: HVR-s2s-small Gene-MTEB data used in METAGENE-1 Table 3 (Gene-MTEB genomic embedding benchmark split)
0.371 V measure
unitless · higher

Uncertainty: Not yet extracted

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT-2.5b-1000g on Gene-MTEB genomic embedding benchmark HVR-s2s-small: HVR-s2s-small genomic embedding evaluation

Frozen model last-hidden-state embeddings, mean pooled. Logistic regression for eight classification tasks and mini-batch k-means for eight clustering tasks. Source paper Section 5.3. Current official gene-mteb implementation corroborates task identities but its commit is not proven identical to the paper evaluator. Exact dataset release, split hash, scored counts and evaluator commit are unreported in the paper. Do not substitute current mutable HF main for the original split.

Aggregation: Not reported

METAGENE-1 v1: Gene-MTEB complete component tasks · Table 3 (S5.T3), row HVR-s2s-small, column NT-2.5b-1000g; Section 5.3 paragraphs S5.SS3.p2.1 and S5.SS3.p3.1
Pipeline: NT-2.5b-1000gProtocol: Gene-MTEB genomic embedding benchmark HVR-s2s-tiny: HVR-s2s-tiny genomic embedding evaluation
Dataset subset: HVR-s2s-tiny Gene-MTEB data used in METAGENE-1 Table 3 (Gene-MTEB genomic embedding benchmark split)
0.782 V measure
unitless · higher

Uncertainty: Not yet extracted

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT-2.5b-1000g on Gene-MTEB genomic embedding benchmark HVR-s2s-tiny: HVR-s2s-tiny genomic embedding evaluation

Frozen model last-hidden-state embeddings, mean pooled. Logistic regression for eight classification tasks and mini-batch k-means for eight clustering tasks. Source paper Section 5.3. Current official gene-mteb implementation corroborates task identities but its commit is not proven identical to the paper evaluator. Exact dataset release, split hash, scored counts and evaluator commit are unreported in the paper. Do not substitute current mutable HF main for the original split.

Aggregation: Not reported

METAGENE-1 v1: Gene-MTEB complete component tasks · Table 3 (S5.T3), row HVR-s2s-tiny, column NT-2.5b-1000g; Section 5.3 paragraphs S5.SS3.p2.1 and S5.SS3.p3.1

Source checking is not independent reproduction. Release 2026-11-21-c8bea25e5abb.

Use this pipeline

How it works, versions and access

Underlying model: Nucleotide Transformer. Results on this page belong to this pipeline and its evaluated settings.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

1 evidence row matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Relationship: uses model
discovery-model-nucleotide-transformer
Individual claims
METAGENE-1 v1: Gene-MTEB complete component tasks

Original source ↗

Section 5.3; Table 3 NT-2.5b-1000g column

Version: arXiv:2501.02045v1
Retrieved: 2026-09-23T11:22:00.101850+00:00

source checked

["automated-source-review"] · 2026-09-23

Audit details

Source-backed evaluated identity only; no independent reproduction.

Field: links:uses_model:discovery-model-nucleotide-transformer

Claim: metagene-gene-mteb-method-nt-2-5b-1000g-discovery-model-nucleotide-transformer-identity-claim

Source artifact SHA-256: a426c77d137138cfc33410a1e54a1cce521007bdc9e3176f4774d0105424a7fe

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and record identifiers

Technical metadata for this record is tracked under stable ID metagene-gene-mteb-method-nt-2-5b-1000g.

Source locator: Section 5.3; Table 3 NT-2.5b-1000g column

Related records

How to cite

NT-2.5b-1000g. Rewire biological model benchmark database, release 2026-11-21-c8bea25e5abb. https://benchmarks.rewirebio.io/database/pipeline/metagene-gene-mteb-method-nt-2-5b-1000g/

Release 2026-11-21-c8bea25e5abb. Rankings and values change between releases, so keep the release id in the citation. Cite the original publication as well for any value you reuse: each result links its source.

The compilation and annotations made by Rewire in this release are offered under CC BY 4.0; values and text taken from cited sources stay under the terms of those sources and are not covered by this licence. Data licence

Suggest a correction