rewire.itbenchmarks
← Back to results
Task

DART-Eval CTS-IMR90: Cell-type-specific element classification, IMR90

Cell-type-specific element classification, IMR90. Scored with AUROC on ENCODE chromatin accessibility peaks in five cell lines. One-against-rest AUROC for IMR90 accessible elements.

14 evaluations · 14 results

Overview

Cell-type-specific element classification, IMR90. Scored with AUROC on ENCODE chromatin accessibility peaks in five cell lines. One-against-rest AUROC for IMR90 accessible elements.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Results

Each comparison retains its reviewed evaluation scope, dataset and metric. Results are shown without a pooled ranking.

DART-Eval CTS-IMR90: Cell-type-specific element classification, IMR90

auroc (fraction) · Higher values are better.

DART-Eval CTS-IMR90: Cell-type-specific element classification, IMR90 · ENCODE chromatin accessibility peaks in five cell lines (DART-Eval split)

Evidence origin: Author-reported evaluation.

DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA · Table 4, column(IMR90 AUROC)
  • The evaluation setting is part of the method name: a zero-shot, probed and fine-tuned run of the same model are different entries.
  • Metrics and datasets differ between tasks, so these figures cannot be averaged into one score.
Comparison details and limitations

Every method DART-Eval reports on Cell-type-specific element classification, IMR90, scored with AUROC on ENCODE chromatin accessibility peaks in five cell lines.

  • Author-reported numbers, source checked but not independently reproduced.

Automated source review: 2026-09-19. Numerical source review does not establish independent reproduction.

Dots show point estimates. Whiskers show only explicitly defined uncertainty (standard deviation, standard error or a labelled interval); their definitions remain in Table. Unresolved uncertainty is not plotted. Differences do not establish statistical significance.

Showing 12 of 14 matching rows.

Tested configuration
00.250.50.751
Reported score
  1. Caduceus (fine-tuned)0.929
  2. DNABERT-2 (fine-tuned)0.922
  3. ChromBPNet-like (ab initio)0.921
  4. Nucleotide Transformer (fine-tuned)0.92
  5. GENA-LM (fine-tuned)0.911
  6. HyenaDNA (fine-tuned)0.908
  7. HyenaDNA (probed)0.882
  8. Probing-head-like (ab initio)0.807
  9. Nucleotide Transformer (probed)0.779
  10. Mistral-DNA (fine-tuned)0.748
  11. GENA-LM (probed)0.714
  12. DNABERT-2 (probed)0.691

Methods and evaluation design

Procedure, tasks and evaluated configurations

Evaluation design

Benchmarks bring together tasks and protocols. A task describes the biological question; a protocol defines a particular test.

Benchmarks

These source-backed links do not make different protocols or scores interchangeable.

Recorded evaluations

Each evaluation records what was tested and under which conditions.

Explore all linked results

Run instructions

No runnable recipe has been reviewed for this task. Dataset access, model requirements, licences and compute requirements must be checked against its sources before execution.

A task describes a biological question. Choose a linked protocol to obtain concrete split and scoring instructions.

Strengths, limitations and unresolved questions

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

1 evidence row matching the loaded filters

Claims, original sources and review scope · Release 2026-09-29-06401fd5b220
Property and statementOriginal source and locationReview and provenance
Relationship: part of
discovery-benchmark-dart-eval
Individual claims		DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA

Original source ↗

Table 4, column(IMR90 AUROC)

Version: 2412.05430v1
Retrieved: 2026-09-17T07:56:09.182117+00:00

source checked

automated source review · 2026-09-19

Audit details

Primary-source transcription with no human sign-off and no independent reproduction.

Field: links:part_of:discovery-benchmark-dart-eval

Claim: dart-eval-association-cts-imr90

Source artifact SHA-256: 4194b137ba55c9a2c269d119a9afec6ae1bb0feaf17d91433ae483c41221a56b

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

All evidence (CSV)All evidence (JSONL)How to read the evidence

Sources and history

View linked audit checks and correction history

Release 2026-09-29-06401fd5b220 · Record review: source checked

1 source records and release historyDownload this release
Technical metadata and extraction receipts

Stable ID: dart-eval-task-cts-imr90

areas
dna-genomes
tasks
Cell-type-specific element classification, IMR90
metric
AUROC
metric direction
higher
dataset
ENCODE chromatin accessibility peaks in five cell lines
protocol
One-against-rest AUROC for IMR90 accessible elements.
source locator
Table 4, column(IMR90 AUROC)
comparison panels
id: dart-eval-panel-cts-imr90; title: DART-Eval CTS-IMR90: Cell-type-specific element classification, IMR90; protocol id: dart-eval-task-cts-imr90; dataset id: dart-eval-dataset-encode-chromatin-accessibility-peaks-in-five-cell-lines; metric: auroc; unit: fraction; direction: higher; result ids: dart-eval-result-caduceus-probed-cts-imr90-auroc; dart-eval-result-dnabert-2-probed-cts-imr90-auroc; dart-eval-result-gena-lm-probed-cts-imr90-auroc; dart-eval-result-hyenadna-probed-cts-imr90-auroc; dart-eval-result-mistral-dna-probed-cts-imr90-auroc; dart-eval-result-nucleotide-transformer-probed-cts-imr90-auroc; dart-eval-result-caduceus-fine-tuned-cts-imr90-auroc; dart-eval-result-dnabert-2-fine-tuned-cts-imr90-auroc; dart-eval-result-gena-lm-fine-tuned-cts-imr90-auroc; dart-eval-result-hyenadna-fine-tuned-cts-imr90-auroc; dart-eval-result-mistral-dna-fine-tuned-cts-imr90-auroc; dart-eval-result-nucleotide-transformer-fine-tuned-cts-imr90-auroc; dart-eval-result-probing-head-like-ab-initio-cts-imr90-auroc; dart-eval-result-chrombpnet-like-ab-initio-cts-imr90-auroc; source ids: evidence-expansion-p2-evidence-discovery-final-dart-4194b137ba55; source locator: Table 4, column(IMR90 AUROC); context: Every method DART-Eval reports on Cell-type-specific element classification, IMR90, scored with AUROC on ENCODE chromatin accessibility peaks in five cell lines.; caveats: Author-reported numbers, source checked but not independently reproduced.; The evaluation setting is part of the method name: a zero-shot, probed and fine-tuned run of the same model are different entries.; Metrics and datasets differ between tasks, so these figures cannot be averaged into one score.; review: method: automated_source_review; date: 2026-09-19
Related records

Suggest a correction