rewirebio.iobenchmarks
Configuration

NT-500M, frozen embeddings with a lightweight probe (Datta et al. 2026)

NT-500M, frozen embeddings with a lightweight probe, a configuration of Nucleotide Transformer: 500M parameters; backbone frozen in inference mode, gradients disabled; embeddings standardised with training-set statistics; best readout and probe over the diagnostic test grid, chosen per task.

18 evaluations · 18 results

Overview

An explanatory profile has not yet been reviewed for this record.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Evaluations and results

18 evaluations · 18 results. Different protocols are not a single leaderboard.

Protocol: Nucleotide Transformer benchmark under frozen-embedding probing (Datta et al. 2026 Table 1) · Dataset: Nucleotide Transformer benchmark task data (Datta et al. 2026)

Sorted by F1 (NT benchmark Promoter All, frozen-embedding probe) (higher is better). The best value in each column is highlighted. Decimals are rounded for display; each value links to the printed value and its source.

Tested configurationF1 (NT benchmark Promoter All, frozen-embedding probe)F1 (NT benchmark Promoter Non-TATA, frozen-embedding probe)F1 (NT benchmark Promoter TATA, frozen-embedding probe)F1 (NT benchmark Splice Acceptor, frozen-embedding probe)F1 (NT benchmark Splice All, frozen-embedding probe)F1 (NT benchmark Splice Donor, frozen-embedding probe)MCC (NT benchmark Enhancer Types, frozen-embedding probe)MCC (NT benchmark Enhancer, frozen-embedding probe)MCC (NT benchmark H3, frozen-embedding probe)MCC (NT benchmark H3K14ac, frozen-embedding probe)MCC (NT benchmark H3K36me3, frozen-embedding probe)MCC (NT benchmark H3K4me1, frozen-embedding probe)MCC (NT benchmark H3K4me2, frozen-embedding probe)MCC (NT benchmark H3K4me3, frozen-embedding probe)MCC (NT benchmark H3K79me3, frozen-embedding probe)MCC (NT benchmark H3K9ac, frozen-embedding probe)MCC (NT benchmark H4, frozen-embedding probe)MCC (NT benchmark H4ac, frozen-embedding probe)
NT-500M, frozen embeddings with a lightweight probe (Datta et al. 2026)Evaluation0.928Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
NT-500M, frozen embeddings with a lightweight probe (Datta et al. 2026)EvaluationNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.525Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
NT-500M, frozen embeddings with a lightweight probe (Datta et al. 2026)EvaluationNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.525Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
NT-500M, frozen embeddings with a lightweight probe (Datta et al. 2026)EvaluationNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.695Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
NT-500M, frozen embeddings with a lightweight probe (Datta et al. 2026)EvaluationNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.332Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
NT-500M, frozen embeddings with a lightweight probe (Datta et al. 2026)EvaluationNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.4Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
NT-500M, frozen embeddings with a lightweight probe (Datta et al. 2026)EvaluationNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.328Not reportedNot reportedNot reportedNot reportedNot reportedNot reported
NT-500M, frozen embeddings with a lightweight probe (Datta et al. 2026)EvaluationNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.254Not reportedNot reportedNot reportedNot reportedNot reported
NT-500M, frozen embeddings with a lightweight probe (Datta et al. 2026)EvaluationNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.204Not reportedNot reportedNot reportedNot reported
NT-500M, frozen embeddings with a lightweight probe (Datta et al. 2026)EvaluationNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.566Not reportedNot reportedNot reported
NT-500M, frozen embeddings with a lightweight probe (Datta et al. 2026)EvaluationNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.399Not reportedNot reported
NT-500M, frozen embeddings with a lightweight probe (Datta et al. 2026)EvaluationNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.714Not reported
NT-500M, frozen embeddings with a lightweight probe (Datta et al. 2026)EvaluationNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.302
NT-500M, frozen embeddings with a lightweight probe (Datta et al. 2026)EvaluationNot reported0.937Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
NT-500M, frozen embeddings with a lightweight probe (Datta et al. 2026)EvaluationNot reportedNot reported0.918Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
NT-500M, frozen embeddings with a lightweight probe (Datta et al. 2026)EvaluationNot reportedNot reportedNot reported0.86Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
NT-500M, frozen embeddings with a lightweight probe (Datta et al. 2026)EvaluationNot reportedNot reportedNot reportedNot reported0.687Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
NT-500M, frozen embeddings with a lightweight probe (Datta et al. 2026)EvaluationNot reportedNot reportedNot reportedNot reportedNot reported0.81Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
All 18 result rows with coverage, uncertainty and sources
Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: NT-500M, frozen embeddings with a lightweight probe (Datta et al. 2026)Protocol: Nucleotide Transformer benchmark under frozen-embedding probing (Datta et al. 2026 Table 1)
Dataset: Nucleotide Transformer benchmark task data (Datta et al. 2026)
0.525 MCC (NT benchmark Enhancer, frozen-embedding probe)
unitless · higher

Uncertainty: SD 0.0262

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

NT-500M on NT benchmark Enhancer (frozen probe)

gfm2-20261011-datta2026-protocol-frozen-probe

Aggregation: Not reported

Frozen but Not Always Accessible: A Representation Analysis of Genomic Language Models · Table 1, row 'Enhancer', column 'NT', frozen value
Configuration: NT-500M, frozen embeddings with a lightweight probe (Datta et al. 2026)Protocol: Nucleotide Transformer benchmark under frozen-embedding probing (Datta et al. 2026 Table 1)
Dataset: Nucleotide Transformer benchmark task data (Datta et al. 2026)
0.525 MCC (NT benchmark Enhancer Types, frozen-embedding probe)
unitless · higher

Uncertainty: SD 0.0262

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

NT-500M on NT benchmark Enhancer Types (frozen probe)

gfm2-20261011-datta2026-protocol-frozen-probe

Aggregation: Not reported

Frozen but Not Always Accessible: A Representation Analysis of Genomic Language Models · Table 1, row 'Enhancer Types', column 'NT', frozen value
Configuration: NT-500M, frozen embeddings with a lightweight probe (Datta et al. 2026)Protocol: Nucleotide Transformer benchmark under frozen-embedding probing (Datta et al. 2026 Table 1)
Dataset: Nucleotide Transformer benchmark task data (Datta et al. 2026)
0.695 MCC (NT benchmark H3, frozen-embedding probe)
unitless · higher

Uncertainty: SD 0.0111

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

NT-500M on NT benchmark H3 (frozen probe)

gfm2-20261011-datta2026-protocol-frozen-probe

Aggregation: Not reported

Frozen but Not Always Accessible: A Representation Analysis of Genomic Language Models · Table 1, row 'H3', column 'NT', frozen value
Configuration: NT-500M, frozen embeddings with a lightweight probe (Datta et al. 2026)Protocol: Nucleotide Transformer benchmark under frozen-embedding probing (Datta et al. 2026 Table 1)
Dataset: Nucleotide Transformer benchmark task data (Datta et al. 2026)
0.332 MCC (NT benchmark H3K14ac, frozen-embedding probe)
unitless · higher

Uncertainty: SD 0.0068

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

NT-500M on NT benchmark H3K14ac (frozen probe)

gfm2-20261011-datta2026-protocol-frozen-probe

Aggregation: Not reported

Frozen but Not Always Accessible: A Representation Analysis of Genomic Language Models · Table 1, row 'H3K14ac', column 'NT', frozen value
Configuration: NT-500M, frozen embeddings with a lightweight probe (Datta et al. 2026)Protocol: Nucleotide Transformer benchmark under frozen-embedding probing (Datta et al. 2026 Table 1)
Dataset: Nucleotide Transformer benchmark task data (Datta et al. 2026)
0.4 MCC (NT benchmark H3K36me3, frozen-embedding probe)
unitless · higher

Uncertainty: SD 0.0160

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

NT-500M on NT benchmark H3K36me3 (frozen probe)

gfm2-20261011-datta2026-protocol-frozen-probe

Aggregation: Not reported

Frozen but Not Always Accessible: A Representation Analysis of Genomic Language Models · Table 1, row 'H3K36me3', column 'NT', frozen value
Configuration: NT-500M, frozen embeddings with a lightweight probe (Datta et al. 2026)Protocol: Nucleotide Transformer benchmark under frozen-embedding probing (Datta et al. 2026 Table 1)
Dataset: Nucleotide Transformer benchmark task data (Datta et al. 2026)
0.328 MCC (NT benchmark H3K4me1, frozen-embedding probe)
unitless · higher

Uncertainty: SD 0.0152

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

NT-500M on NT benchmark H3K4me1 (frozen probe)

gfm2-20261011-datta2026-protocol-frozen-probe

Aggregation: Not reported

Frozen but Not Always Accessible: A Representation Analysis of Genomic Language Models · Table 1, row 'H3K4me1', column 'NT', frozen value
Configuration: NT-500M, frozen embeddings with a lightweight probe (Datta et al. 2026)Protocol: Nucleotide Transformer benchmark under frozen-embedding probing (Datta et al. 2026 Table 1)
Dataset: Nucleotide Transformer benchmark task data (Datta et al. 2026)
0.254 MCC (NT benchmark H3K4me2, frozen-embedding probe)
unitless · higher

Uncertainty: SD 0.0128

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

NT-500M on NT benchmark H3K4me2 (frozen probe)

gfm2-20261011-datta2026-protocol-frozen-probe

Aggregation: Not reported

Frozen but Not Always Accessible: A Representation Analysis of Genomic Language Models · Table 1, row 'H3K4me2', column 'NT', frozen value
Configuration: NT-500M, frozen embeddings with a lightweight probe (Datta et al. 2026)Protocol: Nucleotide Transformer benchmark under frozen-embedding probing (Datta et al. 2026 Table 1)
Dataset: Nucleotide Transformer benchmark task data (Datta et al. 2026)
0.204 MCC (NT benchmark H3K4me3, frozen-embedding probe)
unitless · higher

Uncertainty: SD 0.0227

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

NT-500M on NT benchmark H3K4me3 (frozen probe)

gfm2-20261011-datta2026-protocol-frozen-probe

Aggregation: Not reported

Frozen but Not Always Accessible: A Representation Analysis of Genomic Language Models · Table 1, row 'H3K4me3', column 'NT', frozen value
Configuration: NT-500M, frozen embeddings with a lightweight probe (Datta et al. 2026)Protocol: Nucleotide Transformer benchmark under frozen-embedding probing (Datta et al. 2026 Table 1)
Dataset: Nucleotide Transformer benchmark task data (Datta et al. 2026)
0.566 MCC (NT benchmark H3K79me3, frozen-embedding probe)
unitless · higher

Uncertainty: SD 0.0085

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

NT-500M on NT benchmark H3K79me3 (frozen probe)

gfm2-20261011-datta2026-protocol-frozen-probe

Aggregation: Not reported

Frozen but Not Always Accessible: A Representation Analysis of Genomic Language Models · Table 1, row 'H3K79me3', column 'NT', frozen value
Configuration: NT-500M, frozen embeddings with a lightweight probe (Datta et al. 2026)Protocol: Nucleotide Transformer benchmark under frozen-embedding probing (Datta et al. 2026 Table 1)
Dataset: Nucleotide Transformer benchmark task data (Datta et al. 2026)
0.399 MCC (NT benchmark H3K9ac, frozen-embedding probe)
unitless · higher

Uncertainty: SD 0.0155

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

NT-500M on NT benchmark H3K9ac (frozen probe)

gfm2-20261011-datta2026-protocol-frozen-probe

Aggregation: Not reported

Frozen but Not Always Accessible: A Representation Analysis of Genomic Language Models · Table 1, row 'H3K9ac', column 'NT', frozen value
Configuration: NT-500M, frozen embeddings with a lightweight probe (Datta et al. 2026)Protocol: Nucleotide Transformer benchmark under frozen-embedding probing (Datta et al. 2026 Table 1)
Dataset: Nucleotide Transformer benchmark task data (Datta et al. 2026)
0.714 MCC (NT benchmark H4, frozen-embedding probe)
unitless · higher

Uncertainty: SD 0.0084

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

NT-500M on NT benchmark H4 (frozen probe)

gfm2-20261011-datta2026-protocol-frozen-probe

Aggregation: Not reported

Frozen but Not Always Accessible: A Representation Analysis of Genomic Language Models · Table 1, row 'H4', column 'NT', frozen value
Configuration: NT-500M, frozen embeddings with a lightweight probe (Datta et al. 2026)Protocol: Nucleotide Transformer benchmark under frozen-embedding probing (Datta et al. 2026 Table 1)
Dataset: Nucleotide Transformer benchmark task data (Datta et al. 2026)
0.302 MCC (NT benchmark H4ac, frozen-embedding probe)
unitless · higher

Uncertainty: SD 0.0000

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

NT-500M on NT benchmark H4ac (frozen probe)

gfm2-20261011-datta2026-protocol-frozen-probe

Aggregation: Not reported

Frozen but Not Always Accessible: A Representation Analysis of Genomic Language Models · Table 1, row 'H4ac', column 'NT', frozen value
Configuration: NT-500M, frozen embeddings with a lightweight probe (Datta et al. 2026)Protocol: Nucleotide Transformer benchmark under frozen-embedding probing (Datta et al. 2026 Table 1)
Dataset: Nucleotide Transformer benchmark task data (Datta et al. 2026)
0.928 F1 (NT benchmark Promoter All, frozen-embedding probe)
fraction · higher

Uncertainty: SD 0.0042

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

NT-500M on NT benchmark Promoter All (frozen probe)

gfm2-20261011-datta2026-protocol-frozen-probe

Aggregation: Not reported

Frozen but Not Always Accessible: A Representation Analysis of Genomic Language Models · Table 1, row 'Promoter All', column 'NT', frozen value
Configuration: NT-500M, frozen embeddings with a lightweight probe (Datta et al. 2026)Protocol: Nucleotide Transformer benchmark under frozen-embedding probing (Datta et al. 2026 Table 1)
Dataset: Nucleotide Transformer benchmark task data (Datta et al. 2026)
0.937 F1 (NT benchmark Promoter Non-TATA, frozen-embedding probe)
fraction · higher

Uncertainty: SD 0.0024

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

NT-500M on NT benchmark Promoter Non-TATA (frozen probe)

gfm2-20261011-datta2026-protocol-frozen-probe

Aggregation: Not reported

Frozen but Not Always Accessible: A Representation Analysis of Genomic Language Models · Table 1, row 'Promoter Non-TATA', column 'NT', frozen value
Configuration: NT-500M, frozen embeddings with a lightweight probe (Datta et al. 2026)Protocol: Nucleotide Transformer benchmark under frozen-embedding probing (Datta et al. 2026 Table 1)
Dataset: Nucleotide Transformer benchmark task data (Datta et al. 2026)
0.918 F1 (NT benchmark Promoter TATA, frozen-embedding probe)
fraction · higher

Uncertainty: SD 0.0056

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

NT-500M on NT benchmark Promoter TATA (frozen probe)

gfm2-20261011-datta2026-protocol-frozen-probe

Aggregation: Not reported

Frozen but Not Always Accessible: A Representation Analysis of Genomic Language Models · Table 1, row 'Promoter TATA', column 'NT', frozen value
Configuration: NT-500M, frozen embeddings with a lightweight probe (Datta et al. 2026)Protocol: Nucleotide Transformer benchmark under frozen-embedding probing (Datta et al. 2026 Table 1)
Dataset: Nucleotide Transformer benchmark task data (Datta et al. 2026)
0.86 F1 (NT benchmark Splice Acceptor, frozen-embedding probe)
fraction · higher

Uncertainty: SD 0.0012

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

NT-500M on NT benchmark Splice Acceptor (frozen probe)

gfm2-20261011-datta2026-protocol-frozen-probe

Aggregation: Not reported

Frozen but Not Always Accessible: A Representation Analysis of Genomic Language Models · Table 1, row 'Splice Acceptor', column 'NT', frozen value
Configuration: NT-500M, frozen embeddings with a lightweight probe (Datta et al. 2026)Protocol: Nucleotide Transformer benchmark under frozen-embedding probing (Datta et al. 2026 Table 1)
Dataset: Nucleotide Transformer benchmark task data (Datta et al. 2026)
0.687 F1 (NT benchmark Splice All, frozen-embedding probe)
fraction · higher

Uncertainty: SD 0.0083

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

NT-500M on NT benchmark Splice All (frozen probe)

gfm2-20261011-datta2026-protocol-frozen-probe

Aggregation: Not reported

Frozen but Not Always Accessible: A Representation Analysis of Genomic Language Models · Table 1, row 'Splice All', column 'NT', frozen value
Configuration: NT-500M, frozen embeddings with a lightweight probe (Datta et al. 2026)Protocol: Nucleotide Transformer benchmark under frozen-embedding probing (Datta et al. 2026 Table 1)
Dataset: Nucleotide Transformer benchmark task data (Datta et al. 2026)
0.81 F1 (NT benchmark Splice Donor, frozen-embedding probe)
fraction · higher

Uncertainty: SD 0.0054

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

NT-500M on NT benchmark Splice Donor (frozen probe)

gfm2-20261011-datta2026-protocol-frozen-probe

Aggregation: Not reported

Frozen but Not Always Accessible: A Representation Analysis of Genomic Language Models · Table 1, row 'Splice Donor', column 'NT', frozen value

Source checking is not independent reproduction. Release 2026-10-22-1b7cf027e4f6.

Use this configuration

How it works, versions and access
Strengths, limitations and unresolved questions

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-10-22-1b7cf027e4f6
Property and statementOriginal source and locationReview and provenance

No evidence rows match these filters. Choose another scope or clear the search.

Sources and history

Release 2026-10-22-1b7cf027e4f6 · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: gfm2-20261011-datta2026-config-nt-frozen

areas
dna-genomes
contexts
research
method types
foundation_model
reported name
NT-500M
foundation model eligible
true
source locator
Section 2.2 model list; Table 1 column 'NT'
parameters
500M parameters; backbone frozen in inference mode, gradients disabled; embeddings standardised with training-set statistics; best readout and probe over the diagnostic test grid, chosen per task (Table 3)
missing metadata
version: reason: unreported; note: Parameter count printed; no checkpoint revision or release version is given
training setting
Frozen backbone, probe only
provenance note
NT-500M, frozen embeddings with a lightweight probe (Datta et al. 2026), as evaluated in the cited comparison.
Related records

Suggest a correction