rewirebio.iobenchmarks
Dataset

Feng Human TFBS 5 dataset

DNABERT-2 (GUE) human transcription factor binding site prediction set (Supplementary Note 1); as used in Feng et al. 2025 Table 1.

Evaluation results

5 evaluations · 5 results. Different protocols are not a single leaderboard.

Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: Caduceus-Ph (Human TFBS 5 classification)Protocol: Feng Human TFBS 5 sequence classification
Dataset: Feng Human TFBS 5 dataset
0.929 AUROC (task: human tfbs 5)
unitless · higher

Uncertainty: Not reported by the source: Table 1 prints point AUCs only.

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Caduceus-Ph Human TFBS 5 evaluation

Table 1, frozen embeddings + task-specific random forest classifier

Aggregation: Not reported

Benchmarking DNA foundation models for genomic and genetic tasks · Table 1, row 'Human TFBS 5', column 'Caduceus-Ph'. Printed in bold (caption: higher than at least two other AUCs, p < 0.01, one-sided DeLong).
Configuration: DNABERT-2 (Human TFBS 5 classification)Protocol: Feng Human TFBS 5 sequence classification
Dataset: Feng Human TFBS 5 dataset
0.92 AUROC (task: human tfbs 5)
unitless · higher

Uncertainty: Not reported by the source: Table 1 prints point AUCs only.

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

DNABERT-2 Human TFBS 5 evaluation

Table 1, frozen embeddings + task-specific random forest classifier

Aggregation: Not reported

Benchmarking DNA foundation models for genomic and genetic tasks · Table 1, row 'Human TFBS 5', column 'DNABERT-2'.
Configuration: GROVER (Human TFBS 5 classification)Protocol: Feng Human TFBS 5 sequence classification
Dataset: Feng Human TFBS 5 dataset
0.931 AUROC (task: human tfbs 5)
unitless · higher

Uncertainty: Not reported by the source: Table 1 prints point AUCs only.

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

GROVER Human TFBS 5 evaluation

Table 1, frozen embeddings + task-specific random forest classifier

Aggregation: Not reported

Benchmarking DNA foundation models for genomic and genetic tasks · Table 1, row 'Human TFBS 5', column 'GROVER'. Printed in bold (caption: higher than at least two other AUCs, p < 0.01, one-sided DeLong).
Configuration: HyenaDNA (Human TFBS 5 classification)Protocol: Feng Human TFBS 5 sequence classification
Dataset: Feng Human TFBS 5 dataset
0.916 AUROC (task: human tfbs 5)
unitless · higher

Uncertainty: Not reported by the source: Table 1 prints point AUCs only.

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

HyenaDNA Human TFBS 5 evaluation

Table 1, frozen embeddings + task-specific random forest classifier

Aggregation: Not reported

Benchmarking DNA foundation models for genomic and genetic tasks · Table 1, row 'Human TFBS 5', column 'HyenaDNA'.
Configuration: NT-v2 (Human TFBS 5 classification)Protocol: Feng Human TFBS 5 sequence classification
Dataset: Feng Human TFBS 5 dataset
0.915 AUROC (task: human tfbs 5)
unitless · higher

Uncertainty: Not reported by the source: Table 1 prints point AUCs only.

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

NT-v2 Human TFBS 5 evaluation

Table 1, frozen embeddings + task-specific random forest classifier

Aggregation: Not reported

Benchmarking DNA foundation models for genomic and genetic tasks · Table 1, row 'Human TFBS 5', column 'NT-v2'.

Source checking is not independent reproduction. Release 2026-11-02-a7f03c9e55a5.

Research readiness

0 of 4 readiness checks met. These checks assess whether the evidence supports a reproducible investigation; a source-checked score alone does not meet them.

Readiness checks, gaps and artifacts

Release 2026-11-02-a7f03c9e55a5 · Evidence verified: Not verified

Evidence incomplete

Replay metrics

Exact outcomes, predictions, identifiers and evaluator are connected.

Missing or unresolved evidence

  • No verified artifact manifest is linked to this exact record.
  • File checksums match the recorded files: not yet verified
  • Predictions are matched to the right samples: not yet verified
  • Score meaning and direction are confirmed: not yet verified
  • Metrics are recomputed from the saved predictions: not yet verified

Verified: Not verified

Evidence incomplete

Investigate discrepancies

Replay evidence includes annotations and an assessment of dependence. Unknown independence permits descriptive analysis only.

Missing or unresolved evidence

  • No verified artifact manifest is linked to this exact record.
  • File checksums match the recorded files: not yet verified
  • Predictions are matched to the right samples: not yet verified
  • Score meaning and direction are confirmed: not yet verified
  • Metrics are recomputed from the saved predictions: not yet verified
  • Sample annotations are recorded: not yet verified
  • Dependence between samples is assessed: not yet verified

Verified: Not verified

Evidence incomplete

Run locally

A pinned recipe describes the inputs, environment and resource requirements.

Missing or unresolved evidence

  • No verified artifact manifest is linked to this exact record.
  • File checksums match the recorded files: not yet verified
  • Predictions are matched to the right samples: not yet verified
  • Score meaning and direction are confirmed: not yet verified
  • A pinned run recipe exists: not yet verified
  • Compute requirements are estimated: not yet verified

Verified: Not verified

Evidence incomplete

Validate independently

Separate data and exposure records support an independent test.

Missing or unresolved evidence

  • No verified artifact manifest is linked to this exact record.
  • File checksums match the recorded files: not yet verified
  • Predictions are matched to the right samples: not yet verified
  • Score meaning and direction are confirmed: not yet verified
  • Independent validation data exist: not yet verified
  • Overlap with training data is checked: not yet verified

Verified: Not verified

Readiness describes the evidence in this release. Availability on your computer is checked separately when an investigation runs. Existing data exposure can prevent independent validation even when files are available.

Artifacts and reproduction

No verified artifact manifest is connected to this record yet. The gaps above identify what is needed before analysis can begin.

Dataset and evaluation context

A dataset supplies biological observations. The evaluation protocol defines how those observations are split, used and scored.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

30 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-02-a7f03c9e55a5
Property and statementOriginal source and locationReview and provenance
Negatives
10500
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

Supplementary Data 6, row 'Human TFBS 5'; Supplementary Note 1

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.negatives

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Negatives
10500
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Data 1-6

Original source ↗

Supplementary Data 6, row 'Human TFBS 5'; Supplementary Note 1

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Nature Communications 16, 10780 (2025); Supplementary Data 1-6 workbook (MOESM3, .xlsm)
Retrieved: 2026-10-13T14:08:10Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.negatives

Source artifact SHA-256: 4804c801e0e054eca5f776617c18a6a0cb31d6ce3d2a7a52f70e4dda5b3abd7a

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Negatives
10500
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Information

Original source ↗

Supplementary Data 6, row 'Human TFBS 5'; Supplementary Note 1

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Nature Communications 16, 10780 (2025); Supplementary Information PDF (MOESM1, 11 pages)
Retrieved: 2026-10-13T14:08:10Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.negatives

Source artifact SHA-256: 373f59b825c9e2bc51a0f122a9e2653f427c492727fbf73768cc9af02d094a15

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Population
DNABERT-2 (GUE) human transcription factor binding site prediction set (Supplementary Note 1); sequence length median 101 bp (range 101-101 bp) per Supplementary Data 6.
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

Supplementary Data 6, row 'Human TFBS 5'; Supplementary Note 1

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.population

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Population
DNABERT-2 (GUE) human transcription factor binding site prediction set (Supplementary Note 1); sequence length median 101 bp (range 101-101 bp) per Supplementary Data 6.
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Data 1-6

Original source ↗

Supplementary Data 6, row 'Human TFBS 5'; Supplementary Note 1

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Nature Communications 16, 10780 (2025); Supplementary Data 1-6 workbook (MOESM3, .xlsm)
Retrieved: 2026-10-13T14:08:10Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.population

Source artifact SHA-256: 4804c801e0e054eca5f776617c18a6a0cb31d6ce3d2a7a52f70e4dda5b3abd7a

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Population
DNABERT-2 (GUE) human transcription factor binding site prediction set (Supplementary Note 1); sequence length median 101 bp (range 101-101 bp) per Supplementary Data 6.
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Information

Original source ↗

Supplementary Data 6, row 'Human TFBS 5'; Supplementary Note 1

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Nature Communications 16, 10780 (2025); Supplementary Information PDF (MOESM1, 11 pages)
Retrieved: 2026-10-13T14:08:10Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.population

Source artifact SHA-256: 373f59b825c9e2bc51a0f122a9e2653f427c492727fbf73768cc9af02d094a15

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Positives
10500
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

Supplementary Data 6, row 'Human TFBS 5'; Supplementary Note 1

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.positives

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Positives
10500
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Data 1-6

Original source ↗

Supplementary Data 6, row 'Human TFBS 5'; Supplementary Note 1

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Nature Communications 16, 10780 (2025); Supplementary Data 1-6 workbook (MOESM3, .xlsm)
Retrieved: 2026-10-13T14:08:10Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.positives

Source artifact SHA-256: 4804c801e0e054eca5f776617c18a6a0cb31d6ce3d2a7a52f70e4dda5b3abd7a

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Positives
10500
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks: Supplementary Information

Original source ↗

Supplementary Data 6, row 'Human TFBS 5'; Supplementary Note 1

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Nature Communications 16, 10780 (2025); Supplementary Information PDF (MOESM1, 11 pages)
Retrieved: 2026-10-13T14:08:10Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.positives

Source artifact SHA-256: 373f59b825c9e2bc51a0f122a9e2653f427c492727fbf73768cc9af02d094a15

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Source location
Supplementary Data 6, row 'Human TFBS 5'; Supplementary Note 1
Context-only references
Benchmarking DNA foundation models for genomic and genetic tasks

Original source ↗

Supplementary Data 6, row 'Human TFBS 5'; Supplementary Note 1

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: PMC12663285.1
Retrieved: 2026-09-17T07:54:51.004119+00:00

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.source_locator

Source artifact SHA-256: 5d8ca9bcf88cc1b38ad667906a2e4699b1aefa6d31c6f49259784930353f3202

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-02-a7f03c9e55a5 · Record review: source checked

3 source records and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: feng-dna-fm-20261013-dataset-t1-human-tfbs-5

areas
dna-genomes
contexts
research
population
DNABERT-2 (GUE) human transcription factor binding site prediction set (Supplementary Note 1); sequence length median 101 bp (range 101-101 bp) per Supplementary Data 6.
split
Original predefined split retained where clearly defined; otherwise a random 70:30 train/test split. DNABERT-2/NT-v2 benchmark datasets are re-split 70:30 keeping class proportions unless the source states an exception. Random forest hyperparameters tuned by fivefold cross-validation. No whole-chromosome holdout (Methods). Supplementary Data 6: 14699 training and 6301 test sequences.
test denominator
6301 test sequences (Supplementary Data 6, row 'Human TFBS 5', column 'Testing Size')
species
Homo sapiens
source locator
Supplementary Data 6, row 'Human TFBS 5'; Supplementary Note 1
missing metadata
version: reason: unextracted; note: Upstream dataset release not stated in the article.
positives
10500
negatives
10500
total
21000
Related records

Suggest a correction