rewirebio.iobenchmarks
Configuration

NT

Nucleotide Transformer is a family of DNA encoders pretrained on human or multispecies sequence corpora.

Sources (5)instadeepai/nucleotide-transformer: README.md; instadeepai/nucleotide-transformer: docs/nucleotide_transformer.md; instadeepai/nucleotide-transformer: docs/agro_nucleotide_transformer.md; instadeepai/nucleotide-transformer: docs/segment_nt.md; nt: Journal full-text XML · docs/nucleotide_transformer.md: Model Variants and Sizes, Tokenization and How to use; Nucleotide Transformer paper Methods: Architecture, Pre-training datasets and Training

10 evaluations · 10 results

How it worksNucleotide Transformer workflow
Nucleotide Transformer workflow1. DNA sequence. Then: 2. 6-mer tokenization. Then: 3. Selected NT encoder. Then: 4. Representation or adapted predictorNucleotide Transformer workflow1. DNA sequence. Then: 2. 6-mer tokenization. Then: 3. Selected NT encoder. Then: 4. Representation or adapted predictorNucleotide Transformer workflow1. DNA sequence. Then: 2. 6-mer tokenization. Then: 3. Selected NT encoder. Then: 4. Representation or adapted predictor

Conceptual summary of the documented data flow; optional inputs and configured downstream stages must be reported for a reproducible evaluation.

Sources (5)instadeepai/nucleotide-transformer: README.md; instadeepai/nucleotide-transformer: docs/nucleotide_transformer.md; instadeepai/nucleotide-transformer: docs/agro_nucleotide_transformer.md; instadeepai/nucleotide-transformer: docs/segment_nt.md; nt: Journal full-text XML · docs/nucleotide_transformer.md: Model Variants and Sizes, Tokenization and How to use; Nucleotide Transformer paper Methods: Architecture, Pre-training datasets and Training

Overview

Model type

DNA transformer encoder family

Inputs

DNA sequences tokenized into 6-mers, with single-base handling of N and remainder bases.

Outputs

Contextual representations used in specified downstream prediction workflows.

Sources (5)instadeepai/nucleotide-transformer: README.md; instadeepai/nucleotide-transformer: docs/nucleotide_transformer.md; instadeepai/nucleotide-transformer: docs/agro_nucleotide_transformer.md; instadeepai/nucleotide-transformer: docs/segment_nt.md; nt: Journal full-text XML · docs/nucleotide_transformer.md: Model Variants and Sizes, Tokenization and How to use; Nucleotide Transformer paper Methods: Architecture, Pre-training datasets and Training

limited source coverage · Automated source review, 2026-09-16. All specifications and missing details

Model Capabilities & Hardware Requirements

Deployment facts recorded for NT. Fields the record does not carry are marked not recorded.

ParametersNot recorded
Minimum VRAMNot recorded
Inference LatencyNot recorded
Context WindowNot recorded
AccessNot recorded
LicenseNot recorded

Evaluations and results

10 evaluations · 10 results. Different protocols are not a single leaderboard.

Sorted by AUPRC (higher is better). The best value in each column is highlighted. Decimals are rounded for display; each value links to the printed value and its source.

All 10 result rows with coverage, uncertainty and sources
Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: NTTask: mRNABench ECLIP: eCLIP binding site prediction
Dataset subset: mRNABench eCLIP (mRNABench split)
40.5% AUPRC
percent · higher

Uncertainty: Not yet extracted

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT on mRNABench ECLIP: eCLIP binding site prediction

A linear probe over frozen embeddings, scored as the mean over ten random seeds.

Aggregation: Not reported

mRNABench: A curated benchmark for mature mRNA property and function prediction · Table 2, row(NT), column(eCLIP)
Configuration: NTTask: mRNABench GO: Gene Ontology term prediction
Dataset subset: mRNABench GO (mRNABench split)
36% AUPRC
percent · higher

Uncertainty: Not yet extracted

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT on mRNABench GO: Gene Ontology term prediction

A linear probe over frozen embeddings, scored as the mean over ten random seeds.

Aggregation: Not reported

mRNABench: A curated benchmark for mature mRNA property and function prediction · Table 2, row(NT), column(GO)
Configuration: NTTask: mRNABench HL: mRNA half life
Dataset subset: mRNABench HL (mRNABench split)
0.57 Pearson
unitless · higher

Uncertainty: Not yet extracted

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT on mRNABench HL: mRNA half life

A linear probe over frozen embeddings, scored as the mean over ten random seeds.

Aggregation: Not reported

mRNABench: A curated benchmark for mature mRNA property and function prediction · Table 2, row(NT), column(HL)
Configuration: NTTask: mRNABench MRL-HL-PAIR: Paired mean ribosome load and half life
Dataset subset: mRNABench MRL-HL-Pair (mRNABench split)
0.57 Pearson
unitless · higher

Uncertainty: Not yet extracted

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT on mRNABench MRL-HL-PAIR: Paired mean ribosome load and half life

A linear probe over frozen embeddings, scored as the mean over ten random seeds.

Aggregation: Not reported

mRNABench: A curated benchmark for mature mRNA property and function prediction · Table 2, row(NT), column(MRL-HL-Pair)
Configuration: NTTask: mRNABench MRL-MPRA: Mean ribosome load on an MPRA library
Dataset subset: mRNABench MRL MPRA (mRNABench split)
0.6 Pearson
unitless · higher

Uncertainty: Not yet extracted

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT on mRNABench MRL-MPRA: Mean ribosome load on an MPRA library

A linear probe over frozen embeddings, scored as the mean over ten random seeds.

Aggregation: Not reported

mRNABench: A curated benchmark for mature mRNA property and function prediction · Table 2, row(NT), column(MRL MPRA)
Configuration: NTTask: mRNABench MRL: Mean ribosome load
Dataset subset: mRNABench MRL (mRNABench split)
0.34 Pearson
unitless · higher

Uncertainty: Not yet extracted

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT on mRNABench MRL: Mean ribosome load

A linear probe over frozen embeddings, scored as the mean over ten random seeds.

Aggregation: Not reported

mRNABench: A curated benchmark for mature mRNA property and function prediction · Table 2, row(NT), column(MRL)
Configuration: NTTask: mRNABench MRNA-LOC-LR: mRNA localisation, long range
Dataset subset: mRNABench mRNA Loc-LR (mRNABench split)
76.6% AUPRC
percent · higher

Uncertainty: Not yet extracted

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT on mRNABench MRNA-LOC-LR: mRNA localisation, long range

A linear probe over frozen embeddings, scored as the mean over ten random seeds.

Aggregation: Not reported

mRNABench: A curated benchmark for mature mRNA property and function prediction · Table 2, row(NT), column(mRNA Loc-LR)
Configuration: NTTask: mRNABench MRNA-LOC-SR: mRNA localisation, short range
Dataset subset: mRNABench mRNA Loc-SR (mRNABench split)
72.2% AUPRC
percent · higher

Uncertainty: Not yet extracted

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT on mRNABench MRNA-LOC-SR: mRNA localisation, short range

A linear probe over frozen embeddings, scored as the mean over ten random seeds.

Aggregation: Not reported

mRNABench: A curated benchmark for mature mRNA property and function prediction · Table 2, row(NT), column(mRNA Loc-SR)
Configuration: NTTask: mRNABench PROT-LOC: Protein localisation
Dataset subset: mRNABench Prot Loc (mRNABench split)
32% AUPRC
percent · higher

Uncertainty: Not yet extracted

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT on mRNABench PROT-LOC: Protein localisation

A linear probe over frozen embeddings, scored as the mean over ten random seeds.

Aggregation: Not reported

mRNABench: A curated benchmark for mature mRNA property and function prediction · Table 2, row(NT), column(Prot Loc)
Configuration: NTTask: mRNABench VEP: Variant effect prediction
Dataset subset: mRNABench VEP (mRNABench split)
31.8% AUPRC
percent · higher

Uncertainty: Not yet extracted

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT on mRNABench VEP: Variant effect prediction

A linear probe over frozen embeddings, scored as the mean over ten random seeds.

Aggregation: Not reported

mRNABench: A curated benchmark for mature mRNA property and function prediction · Table 2, row(NT), column(VEP)

Source checking is not independent reproduction. Release 2026-11-21-adc15377fab2.

Use this configuration

How it works, versions and access

Related profile: Nucleotide Transformer. This page retains the exact record and its evaluation context.

This configuration

NT, a configuration of Nucleotide Transformer: Best checkpoint of this model family.

record
NT
configuration
Not reported
entity type
Configuration

How it works

How it works

Encoder-only transformers with 6-mer tokens; v1 uses learned positional encodings and v2 uses rotary positions and SwiGLU. The documented inputs are DNA sequences tokenized into 6-mers, with single-base handling of N and remainder bases. The output consists of contextual representations used in specified downstream prediction workflows.

Sources (5)instadeepai/nucleotide-transformer: README.md; instadeepai/nucleotide-transformer: docs/nucleotide_transformer.md; instadeepai/nucleotide-transformer: docs/agro_nucleotide_transformer.md; instadeepai/nucleotide-transformer: docs/segment_nt.md; nt: Journal full-text XML · docs/nucleotide_transformer.md: Model Variants and Sizes, Tokenization and How to use; Nucleotide Transformer paper Methods: Architecture, Pre-training datasets and Training
Versions and reproducibility

NT-v1 human-reference/1000G/multispecies variants and NT-v2 50M/100M/250M/500M. NT-v3 is a separate architecture described elsewhere in the repository. v1: approximately 6kb; v2: 2,048 tokens, approximately 12kb. Exact base count depends on special and ambiguous tokens.

Sources (5)instadeepai/nucleotide-transformer: README.md; instadeepai/nucleotide-transformer: docs/nucleotide_transformer.md; instadeepai/nucleotide-transformer: docs/agro_nucleotide_transformer.md; instadeepai/nucleotide-transformer: docs/segment_nt.md; nt: Journal full-text XML · docs/nucleotide_transformer.md: Model Variants and Sizes, Tokenization and How to use; Nucleotide Transformer paper Methods: Architecture, Pre-training datasets and Training
Strengths, limitations and unresolved questions

Strengths and limitations

Strengths and considerations

Limitations and conditions

Profile review details

Inspected pinned official documentation, relevant implementation files and named primary-paper sections. Claims are limited to those artifacts. Remaining field extraction and identity conflicts are explicit; no new performance claims, model runs or human review are implied.

Stable record: discovery-model-nucleotide-transformer

Specifications

Inputs, training, access and other details

Explanatory profile: limited source coverage · Automated source review, 2026-09-16. Review applies to the cited claims; unresolved fields are listed below. Numerical results retain their own review status.

Inputs, outputs and configuration
PropertyDescription and evidence
Model typeDNA transformer encoder family
Sources (5)instadeepai/nucleotide-transformer: README.md; instadeepai/nucleotide-transformer: docs/nucleotide_transformer.md; instadeepai/nucleotide-transformer: docs/agro_nucleotide_transformer.md; instadeepai/nucleotide-transformer: docs/segment_nt.md; nt: Journal full-text XML · docs/nucleotide_transformer.md: Model Variants and Sizes, Tokenization and How to use; Nucleotide Transformer paper Methods: Architecture, Pre-training datasets and Training
ArchitectureEncoder-only transformers with 6-mer tokens; v1 uses learned positional encodings and v2 uses rotary positions and SwiGLU.
Sources (5)instadeepai/nucleotide-transformer: README.md; instadeepai/nucleotide-transformer: docs/nucleotide_transformer.md; instadeepai/nucleotide-transformer: docs/agro_nucleotide_transformer.md; instadeepai/nucleotide-transformer: docs/segment_nt.md; nt: Journal full-text XML · docs/nucleotide_transformer.md: Model Variants and Sizes, Tokenization and How to use; Nucleotide Transformer paper Methods: Architecture, Pre-training datasets and Training
InputsDNA sequences tokenized into 6-mers, with single-base handling of N and remainder bases.
Sources (5)instadeepai/nucleotide-transformer: README.md; instadeepai/nucleotide-transformer: docs/nucleotide_transformer.md; instadeepai/nucleotide-transformer: docs/agro_nucleotide_transformer.md; instadeepai/nucleotide-transformer: docs/segment_nt.md; nt: Journal full-text XML · docs/nucleotide_transformer.md: Model Variants and Sizes, Tokenization and How to use; Nucleotide Transformer paper Methods: Architecture, Pre-training datasets and Training
OutputsContextual representations used in specified downstream prediction workflows.
Sources (5)instadeepai/nucleotide-transformer: README.md; instadeepai/nucleotide-transformer: docs/nucleotide_transformer.md; instadeepai/nucleotide-transformer: docs/agro_nucleotide_transformer.md; instadeepai/nucleotide-transformer: docs/segment_nt.md; nt: Journal full-text XML · docs/nucleotide_transformer.md: Model Variants and Sizes, Tokenization and How to use; Nucleotide Transformer paper Methods: Architecture, Pre-training datasets and Training
Parameters50M to 2.5B across the documented v1/v2 family.
Sources (5)instadeepai/nucleotide-transformer: README.md; instadeepai/nucleotide-transformer: docs/nucleotide_transformer.md; instadeepai/nucleotide-transformer: docs/agro_nucleotide_transformer.md; instadeepai/nucleotide-transformer: docs/segment_nt.md; nt: Journal full-text XML · docs/nucleotide_transformer.md: Model Variants and Sizes, Tokenization and How to use; Nucleotide Transformer paper Methods: Architecture, Pre-training datasets and Training
Known versionsNT-v1 human-reference/1000G/multispecies variants and NT-v2 50M/100M/250M/500M. NT-v3 is a separate architecture described elsewhere in the repository.
Sources (5)instadeepai/nucleotide-transformer: README.md; instadeepai/nucleotide-transformer: docs/nucleotide_transformer.md; instadeepai/nucleotide-transformer: docs/agro_nucleotide_transformer.md; instadeepai/nucleotide-transformer: docs/segment_nt.md; nt: Journal full-text XML · docs/nucleotide_transformer.md: Model Variants and Sizes, Tokenization and How to use; Nucleotide Transformer paper Methods: Architecture, Pre-training datasets and Training
Training datav1 variants use GRCh38, 3,202 human genomes or 850 multispecies genomes; v2 uses the multispecies corpus.
Sources (5)instadeepai/nucleotide-transformer: README.md; instadeepai/nucleotide-transformer: docs/nucleotide_transformer.md; instadeepai/nucleotide-transformer: docs/agro_nucleotide_transformer.md; instadeepai/nucleotide-transformer: docs/segment_nt.md; nt: Journal full-text XML · docs/nucleotide_transformer.md: Model Variants and Sizes, Tokenization and How to use; Nucleotide Transformer paper Methods: Architecture, Pre-training datasets and Training
Training cutoffThe paper specifies human-reference, 1000 Genomes and multispecies training collections by variant. A single latest-deposition date for all sequences is not supplied in the inspected pretraining-data section. · Not reported in inspected sources
Sources (5)instadeepai/nucleotide-transformer: README.md; instadeepai/nucleotide-transformer: docs/nucleotide_transformer.md; instadeepai/nucleotide-transformer: docs/agro_nucleotide_transformer.md; instadeepai/nucleotide-transformer: docs/segment_nt.md; nt: Journal full-text XML · docs/nucleotide_transformer.md: Model Variants and Sizes, Tokenization and How to use; Nucleotide Transformer paper Methods: Architecture, Pre-training datasets and Training
Context limitsv1: approximately 6kb; v2: 2,048 tokens, approximately 12kb. Exact base count depends on special and ambiguous tokens.
Sources (5)instadeepai/nucleotide-transformer: README.md; instadeepai/nucleotide-transformer: docs/nucleotide_transformer.md; instadeepai/nucleotide-transformer: docs/agro_nucleotide_transformer.md; instadeepai/nucleotide-transformer: docs/segment_nt.md; nt: Journal full-text XML · docs/nucleotide_transformer.md: Model Variants and Sizes, Tokenization and How to use; Nucleotide Transformer paper Methods: Architecture, Pre-training datasets and Training
Weights licenceSeparate checkpoint-distribution terms are not stated in the inspected release documentation and licence material. The source-code licence alone is not recorded as an explicit weight grant. · Not reported in inspected sources
Sources (6)instadeepai/nucleotide-transformer: README.md; instadeepai/nucleotide-transformer: docs/nucleotide_transformer.md; instadeepai/nucleotide-transformer: docs/agro_nucleotide_transformer.md; instadeepai/nucleotide-transformer: docs/segment_nt.md; nt: Journal full-text XML; instadeepai/nucleotide-transformer: LICENSE.md · docs/nucleotide_transformer.md: Model Variants and Sizes, Tokenization and How to use; Nucleotide Transformer paper Methods: Architecture, Pre-training datasets and Training; LICENSE.md: licence text
AccessOfficial project documentation and implementation: https://github.com/instadeepai/nucleotide-transformer
Sources (5)instadeepai/nucleotide-transformer: README.md; instadeepai/nucleotide-transformer: docs/nucleotide_transformer.md; instadeepai/nucleotide-transformer: docs/agro_nucleotide_transformer.md; instadeepai/nucleotide-transformer: docs/segment_nt.md; nt: Journal full-text XML · docs/nucleotide_transformer.md: Model Variants and Sizes, Tokenization and How to use; Nucleotide Transformer paper Methods: Architecture, Pre-training datasets and Training
Code licenceCC-BY-NC-SA-4.0
Sourcesinstadeepai/nucleotide-transformer: LICENSE.md · LICENSE.md: licence text

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

2 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-adc15377fab2
Property and statementOriginal source and locationReview and provenance
Relationship: family
discovery-model-nucleotide-transformer
Individual claims
instadeepai/nucleotide-transformer: docs/nucleotide_transformer.md

Original source ↗

mRNABench Table 2/Appendix model inventory; GenomeOcean Table 2; respective model methods; NABench model inventory; GENEB Table 8; source-labelled configuration NT | Existing reviewed locator: Table 2, row(NT)

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: 2dc37b86e16a6970fbc731751f7719d9f676f7f9
Retrieved: 2026-09-16T19:46:19.364532+00:00

source checked

["automated-source-review"] · 2026-09-23

Audit details

Source review establishes this relationship only. Exact evaluated configurations and original numerical review status remain unchanged. Only family identity is shared. Preserve size, v1/v2, corpus and adaptation distinctions; generic NT summary selects a best-overall family variant, without supplying checkpoint identity.

Field: links:family:discovery-model-nucleotide-transformer

Claim: model-evaluation-identity-db1f6b42b1fe5165f3bf

Source artifact SHA-256: ab16d582de98652526b5cebb120eec969328f9db29dc741826bcd81c397e0672

Hash scope: SHA-256 of retrieved original artifact bytes

Format: original_artifact

Inspected artifact

Relationship: family
discovery-model-nucleotide-transformer
Individual claims
mRNABench: A curated benchmark for mature mRNA property and function prediction

Original source ↗

mRNABench Table 2/Appendix model inventory; GenomeOcean Table 2; respective model methods; NABench model inventory; GENEB Table 8; source-labelled configuration NT | Existing reviewed locator: Table 2, row(NT)

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: preprint archived 2025-07-08
Retrieved: 2026-09-16T10:41:16.497221+00:00

source checked

["automated-source-review"] · 2026-09-23

Audit details

Source review establishes this relationship only. Exact evaluated configurations and original numerical review status remain unchanged. Only family identity is shared. Preserve size, v1/v2, corpus and adaptation distinctions; generic NT summary selects a best-overall family variant, without supplying checkpoint identity.

Field: links:family:discovery-model-nucleotide-transformer

Claim: model-evaluation-identity-db1f6b42b1fe5165f3bf

Source artifact SHA-256: 79f6264ee883535203c63a313547e7c57baa85585f76b42f8d899eb17fb7e600

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Sources and history

Release 2026-11-21-adc15377fab2 · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and record identifiers

Technical metadata for this record is tracked under stable ID mrnabench-method-nt.

Source locator: Table 2, row(NT)

Related records

How to cite

NT. Rewire biological model benchmark database, release 2026-11-21-adc15377fab2. https://benchmarks.rewirebio.io/database/configuration/mrnabench-method-nt/

Release 2026-11-21-adc15377fab2. Rankings and values change between releases, so keep the release id in the citation. Cite the original publication as well for any value you reuse: each result links its source.

The compilation and annotations made by Rewire in this release are offered under CC BY 4.0; values and text taken from cited sources stay under the terms of those sources and are not covered by this licence. Data licence

Suggest a correction