rewirebio.iobenchmarks
Configuration

NT-1000G (500M), probing (NT benchmark)

NT-1000G (500M), probing, a configuration of Nucleotide Transformer: probing.

19 evaluations · 19 results

Overview

An explanatory profile has not yet been reviewed for this record.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Evaluations and results

19 evaluations · 19 results. Different protocols are not a single leaderboard.

Sorted by MCC (median over 10 cross-validation folds) (higher is better). The best value in each column is highlighted. Decimals are rounded for display; each value links to the printed value and its source.

Tested configurationProtocol and datasetMCC (median over 10 cross-validation folds)MCC (mean over three task categories of median cross-validation MCC)
NT-1000G (500M), probing (NT benchmark)EvaluationNT benchmark Promoter non-TATA, probing, NT benchmark Promoter non-TATA0.732 (± 0.009) (best in column)Not reported
NT-1000G (500M), probing (NT benchmark)EvaluationNT benchmark Promoter all, probing, NT benchmark Promoter all0.715 (± 0.011)Not reported
NT-1000G (500M), probing (NT benchmark)EvaluationNT benchmark Promoter TATA, probing, NT benchmark Promoter TATA0.696 (± 0.018)Not reported
NT-1000G (500M), probing (NT benchmark)EvaluationNT benchmark H4K20me1, probing, NT benchmark H4K20me10.622 (± 0.008)Not reported
NT-1000G (500M), probing (NT benchmark)EvaluationNT benchmark H3K4me3, probing, NT benchmark H3K4me30.592 (± 0.011)Not reported
NT-1000G (500M), probing (NT benchmark)EvaluationNT benchmark Splice acceptor, probing, NT benchmark Splice acceptor0.552 (± 0.006)Not reported
NT-1000G (500M), probing (NT benchmark)EvaluationNT benchmark Splice donor, probing, NT benchmark Splice donor0.542 (± 0.01)Not reported
NT-1000G (500M), probing (NT benchmark)EvaluationNT benchmark H3K27me3, probing, NT benchmark H3K27me30.535 (± 0.006)Not reported
NT-1000G (500M), probing (NT benchmark)EvaluationNT benchmark H3K9ac, probing, NT benchmark H3K9ac0.523 (± 0.018)Not reported
NT-1000G (500M), probing (NT benchmark)EvaluationNT benchmark H3K4me2, probing, NT benchmark H3K4me20.515 (± 0.006)Not reported
NT-1000G (500M), probing (NT benchmark)EvaluationNT benchmark H3K36me3, probing, NT benchmark H3K36me30.509 (± 0.005)Not reported
NT-1000G (500M), probing (NT benchmark)EvaluationNT benchmark Enhancer, probing, NT benchmark Enhancer0.47 (± 0.008)Not reported
NT-1000G (500M), probing (NT benchmark)EvaluationNT benchmark H3K4me1, probing, NT benchmark H3K4me10.438 (± 0.012)Not reported
NT-1000G (500M), probing (NT benchmark)EvaluationNT benchmark H3K27ac, probing, NT benchmark H3K27ac0.437 (± 0.007)Not reported
NT-1000G (500M), probing (NT benchmark)EvaluationNT benchmark Enhancer types, probing, NT benchmark Enhancer types0.431 (± 0.005)Not reported
NT-1000G (500M), probing (NT benchmark)EvaluationNT benchmark H2AFZ, probing, NT benchmark H2AFZ0.404 (± 0.009)Not reported
NT-1000G (500M), probing (NT benchmark)EvaluationNT benchmark H3K9me3, probing, NT benchmark H3K9me30.381 (± 0.021)Not reported
NT-1000G (500M), probing (NT benchmark)EvaluationNT benchmark Splice site all, probing, NT benchmark Splice site all0.355 (± 0.01)Not reported
NT-1000G (500M), probing (NT benchmark)EvaluationNT benchmark normalised summed performance (Supplementary Table 9), NT benchmark, all 18 tasksNot reported0.583
All 19 result rows with coverage, uncertainty and sources
Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: NT-1000G (500M), probing (NT benchmark)Protocol: NT benchmark Enhancer, probing
Dataset: NT benchmark Enhancer
0.47 (± 0.008) MCC (median over 10 cross-validation folds)
unitless · higher

Uncertainty: SD 0.008

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT-1000G (500M) on NT benchmark Enhancer (probing)

lit-genomics-20261011-ntbench-protocol-enhancer-probing

Aggregation: Not reported

Nucleotide Transformer: Supplementary Information (Supplementary Tables 1-12) · Supplementary Table 6, row 'NT-1000G (500M)', column 'Enhancer'
Configuration: NT-1000G (500M), probing (NT benchmark)Protocol: NT benchmark Enhancer types, probing
Dataset: NT benchmark Enhancer types
0.431 (± 0.005) MCC (median over 10 cross-validation folds)
unitless · higher

Uncertainty: SD 0.005

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT-1000G (500M) on NT benchmark Enhancer types (probing)

lit-genomics-20261011-ntbench-protocol-enhancer-types-probing

Aggregation: Not reported

Nucleotide Transformer: Supplementary Information (Supplementary Tables 1-12) · Supplementary Table 6, row 'NT-1000G (500M)', column 'Enhancer types'
Configuration: NT-1000G (500M), probing (NT benchmark)Protocol: NT benchmark H2AFZ, probing
Dataset: NT benchmark H2AFZ
0.404 (± 0.009) MCC (median over 10 cross-validation folds)
unitless · higher

Uncertainty: SD 0.009

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT-1000G (500M) on NT benchmark H2AFZ (probing)

lit-genomics-20261011-ntbench-protocol-h2afz-probing

Aggregation: Not reported

Nucleotide Transformer: Supplementary Information (Supplementary Tables 1-12) · Supplementary Table 6, row 'NT-1000G (500M)', column 'H2AFZ'
Configuration: NT-1000G (500M), probing (NT benchmark)Protocol: NT benchmark H3K27ac, probing
Dataset: NT benchmark H3K27ac
0.437 (± 0.007) MCC (median over 10 cross-validation folds)
unitless · higher

Uncertainty: SD 0.007

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT-1000G (500M) on NT benchmark H3K27ac (probing)

lit-genomics-20261011-ntbench-protocol-h3k27ac-probing

Aggregation: Not reported

Nucleotide Transformer: Supplementary Information (Supplementary Tables 1-12) · Supplementary Table 6, row 'NT-1000G (500M)', column 'H3K27ac'
Configuration: NT-1000G (500M), probing (NT benchmark)Protocol: NT benchmark H3K27me3, probing
Dataset: NT benchmark H3K27me3
0.535 (± 0.006) MCC (median over 10 cross-validation folds)
unitless · higher

Uncertainty: SD 0.006

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT-1000G (500M) on NT benchmark H3K27me3 (probing)

lit-genomics-20261011-ntbench-protocol-h3k27me3-probing

Aggregation: Not reported

Nucleotide Transformer: Supplementary Information (Supplementary Tables 1-12) · Supplementary Table 6, row 'NT-1000G (500M)', column 'H3K27me3'
Configuration: NT-1000G (500M), probing (NT benchmark)Protocol: NT benchmark H3K36me3, probing
Dataset: NT benchmark H3K36me3
0.509 (± 0.005) MCC (median over 10 cross-validation folds)
unitless · higher

Uncertainty: SD 0.005

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT-1000G (500M) on NT benchmark H3K36me3 (probing)

lit-genomics-20261011-ntbench-protocol-h3k36me3-probing

Aggregation: Not reported

Nucleotide Transformer: Supplementary Information (Supplementary Tables 1-12) · Supplementary Table 6, row 'NT-1000G (500M)', column 'H3K36me3'
Configuration: NT-1000G (500M), probing (NT benchmark)Protocol: NT benchmark H3K4me1, probing
Dataset: NT benchmark H3K4me1
0.438 (± 0.012) MCC (median over 10 cross-validation folds)
unitless · higher

Uncertainty: SD 0.012

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT-1000G (500M) on NT benchmark H3K4me1 (probing)

lit-genomics-20261011-ntbench-protocol-h3k4me1-probing

Aggregation: Not reported

Nucleotide Transformer: Supplementary Information (Supplementary Tables 1-12) · Supplementary Table 6, row 'NT-1000G (500M)', column 'H3K4me1'
Configuration: NT-1000G (500M), probing (NT benchmark)Protocol: NT benchmark H3K4me2, probing
Dataset: NT benchmark H3K4me2
0.515 (± 0.006) MCC (median over 10 cross-validation folds)
unitless · higher

Uncertainty: SD 0.006

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT-1000G (500M) on NT benchmark H3K4me2 (probing)

lit-genomics-20261011-ntbench-protocol-h3k4me2-probing

Aggregation: Not reported

Nucleotide Transformer: Supplementary Information (Supplementary Tables 1-12) · Supplementary Table 6, row 'NT-1000G (500M)', column 'H3K4me2'
Configuration: NT-1000G (500M), probing (NT benchmark)Protocol: NT benchmark H3K4me3, probing
Dataset: NT benchmark H3K4me3
0.592 (± 0.011) MCC (median over 10 cross-validation folds)
unitless · higher

Uncertainty: SD 0.011

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT-1000G (500M) on NT benchmark H3K4me3 (probing)

lit-genomics-20261011-ntbench-protocol-h3k4me3-probing

Aggregation: Not reported

Nucleotide Transformer: Supplementary Information (Supplementary Tables 1-12) · Supplementary Table 6, row 'NT-1000G (500M)', column 'H3K4me3'
Configuration: NT-1000G (500M), probing (NT benchmark)Protocol: NT benchmark H3K9ac, probing
Dataset: NT benchmark H3K9ac
0.523 (± 0.018) MCC (median over 10 cross-validation folds)
unitless · higher

Uncertainty: SD 0.018

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT-1000G (500M) on NT benchmark H3K9ac (probing)

lit-genomics-20261011-ntbench-protocol-h3k9ac-probing

Aggregation: Not reported

Nucleotide Transformer: Supplementary Information (Supplementary Tables 1-12) · Supplementary Table 6, row 'NT-1000G (500M)', column 'H3K9ac'
Configuration: NT-1000G (500M), probing (NT benchmark)Protocol: NT benchmark H3K9me3, probing
Dataset: NT benchmark H3K9me3
0.381 (± 0.021) MCC (median over 10 cross-validation folds)
unitless · higher

Uncertainty: SD 0.021

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT-1000G (500M) on NT benchmark H3K9me3 (probing)

lit-genomics-20261011-ntbench-protocol-h3k9me3-probing

Aggregation: Not reported

Nucleotide Transformer: Supplementary Information (Supplementary Tables 1-12) · Supplementary Table 6, row 'NT-1000G (500M)', column 'H3K9me3'
Configuration: NT-1000G (500M), probing (NT benchmark)Protocol: NT benchmark H4K20me1, probing
Dataset: NT benchmark H4K20me1
0.622 (± 0.008) MCC (median over 10 cross-validation folds)
unitless · higher

Uncertainty: SD 0.008

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT-1000G (500M) on NT benchmark H4K20me1 (probing)

lit-genomics-20261011-ntbench-protocol-h4k20me1-probing

Aggregation: Not reported

Nucleotide Transformer: Supplementary Information (Supplementary Tables 1-12) · Supplementary Table 6, row 'NT-1000G (500M)', column 'H4K20me1'
Configuration: NT-1000G (500M), probing (NT benchmark)Protocol: NT benchmark Promoter all, probing
Dataset: NT benchmark Promoter all
0.715 (± 0.011) MCC (median over 10 cross-validation folds)
unitless · higher

Uncertainty: SD 0.011

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT-1000G (500M) on NT benchmark Promoter all (probing)

lit-genomics-20261011-ntbench-protocol-promoter-all-probing

Aggregation: Not reported

Nucleotide Transformer: Supplementary Information (Supplementary Tables 1-12) · Supplementary Table 6, row 'NT-1000G (500M)', column 'Promoter all'
Configuration: NT-1000G (500M), probing (NT benchmark)Protocol: NT benchmark Promoter non-TATA, probing
Dataset: NT benchmark Promoter non-TATA
0.732 (± 0.009) MCC (median over 10 cross-validation folds)
unitless · higher

Uncertainty: SD 0.009

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT-1000G (500M) on NT benchmark Promoter non-TATA (probing)

lit-genomics-20261011-ntbench-protocol-promoter-non-tata-probing

Aggregation: Not reported

Nucleotide Transformer: Supplementary Information (Supplementary Tables 1-12) · Supplementary Table 6, row 'NT-1000G (500M)', column 'Promoter non-TATA'
Configuration: NT-1000G (500M), probing (NT benchmark)Protocol: NT benchmark Promoter TATA, probing
Dataset: NT benchmark Promoter TATA
0.696 (± 0.018) MCC (median over 10 cross-validation folds)
unitless · higher

Uncertainty: SD 0.018

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT-1000G (500M) on NT benchmark Promoter TATA (probing)

lit-genomics-20261011-ntbench-protocol-promoter-tata-probing

Aggregation: Not reported

Nucleotide Transformer: Supplementary Information (Supplementary Tables 1-12) · Supplementary Table 6, row 'NT-1000G (500M)', column 'Promoter TATA'
Configuration: NT-1000G (500M), probing (NT benchmark)Protocol: NT benchmark Splice acceptor, probing
Dataset: NT benchmark Splice acceptor
0.552 (± 0.006) MCC (median over 10 cross-validation folds)
unitless · higher

Uncertainty: SD 0.006

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT-1000G (500M) on NT benchmark Splice acceptor (probing)

lit-genomics-20261011-ntbench-protocol-splice-acceptor-probing

Aggregation: Not reported

Nucleotide Transformer: Supplementary Information (Supplementary Tables 1-12) · Supplementary Table 6, row 'NT-1000G (500M)', column 'Splice acceptor'
Configuration: NT-1000G (500M), probing (NT benchmark)Protocol: NT benchmark Splice donor, probing
Dataset: NT benchmark Splice donor
0.542 (± 0.01) MCC (median over 10 cross-validation folds)
unitless · higher

Uncertainty: SD 0.01

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT-1000G (500M) on NT benchmark Splice donor (probing)

lit-genomics-20261011-ntbench-protocol-splice-donor-probing

Aggregation: Not reported

Nucleotide Transformer: Supplementary Information (Supplementary Tables 1-12) · Supplementary Table 6, row 'NT-1000G (500M)', column 'Splice donor'
Configuration: NT-1000G (500M), probing (NT benchmark)Protocol: NT benchmark Splice site all, probing
Dataset: NT benchmark Splice site all
0.355 (± 0.01) MCC (median over 10 cross-validation folds)
unitless · higher

Uncertainty: SD 0.01

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT-1000G (500M) on NT benchmark Splice site all (probing)

lit-genomics-20261011-ntbench-protocol-splice-site-all-probing

Aggregation: Not reported

Nucleotide Transformer: Supplementary Information (Supplementary Tables 1-12) · Supplementary Table 6, row 'NT-1000G (500M)', column 'Splice site all'
Configuration: NT-1000G (500M), probing (NT benchmark)Protocol: NT benchmark normalised summed performance (Supplementary Table 9)
Dataset: NT benchmark, all 18 tasks
0.583 MCC (mean over three task categories of median cross-validation MCC)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

NT-1000G (500M) (Probing) NT benchmark normalised summed performance

lit-genomics-20261011-ntbench-protocol-normalised-summed-performance

Aggregation: Not reported

Nucleotide Transformer: Supplementary Information (Supplementary Tables 1-12) · Supplementary Table 9, row 'NT-1000G (500M)', approach 'Probing', column 'Average performance'

Source checking is not independent reproduction. Release 2026-10-22-1b7cf027e4f6.

Use this configuration

How it works, versions and access
Strengths, limitations and unresolved questions

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-10-22-1b7cf027e4f6
Property and statementOriginal source and locationReview and provenance

No evidence rows match these filters. Choose another scope or clear the search.

Sources and history

Release 2026-10-22-1b7cf027e4f6 · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: lit-genomics-20261011-ntbench-config-nt-1000g-500m-probing

areas
dna-genomes
contexts
research
method types
foundation_model
reported name
NT-1000G (500M)
foundation model eligible
true
parameters
probing; hyperparameters in Supplementary Tables 1 and 8
access reuse
Public weights (Hugging Face InstaDeepAI collection)
source locator
Supplementary Tables 6, 7 and 9 row labels
missing metadata
version: reason: unreported; note: Row label gives training data and parameter count only
provenance note
NT-1000G (500M) as evaluated in the NT benchmark, probing.
Related records

Suggest a correction