rewirebio.iobenchmarks
Source

DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA

2412.05430v1

Original source

What this source contributed

Records in this release that cite this source. A record can cite several sources.

Results

Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.

Model or configurationMetricValueDatasetEvaluation
Caduceus (fine-tuned)AUROC0.935 unitlessENCODE chromatin accessibility peaks in five cell lines (DART-Eval split)Caduceus (fine-tuned) on DART-Eval CA-AUROC-GM12878: Chromatin activity prediction, GM12878, positives against negatives
Caduceus (fine-tuned)AUROC0.954 unitlessENCODE chromatin accessibility peaks in five cell lines (DART-Eval split)Caduceus (fine-tuned) on DART-Eval CA-AUROC-H1ESC: Chromatin activity prediction, H1ESC, positives against negatives
Caduceus (fine-tuned)AUROC0.896 unitlessENCODE chromatin accessibility peaks in five cell lines (DART-Eval split)Caduceus (fine-tuned) on DART-Eval CA-AUROC-HEPG2: Chromatin activity prediction, HEPG2, positives against negatives
Caduceus (fine-tuned)AUROC0.976 unitlessENCODE chromatin accessibility peaks in five cell lines (DART-Eval split)Caduceus (fine-tuned) on DART-Eval CA-AUROC-IMR90: Chromatin activity prediction, IMR90, positives against negatives
Caduceus (fine-tuned)AUROC0.933 unitlessENCODE chromatin accessibility peaks in five cell lines (DART-Eval split)Caduceus (fine-tuned) on DART-Eval CA-AUROC-K562: Chromatin activity prediction, K562, positives against negatives
Caduceus (fine-tuned)Spearman0.503 unitlessENCODE chromatin accessibility peaks in five cell lines (DART-Eval split)Caduceus (fine-tuned) on DART-Eval CA-SPEARMAN-GM12878: Chromatin activity prediction, GM12878, positives only
Caduceus (fine-tuned)Spearman0.744 unitlessENCODE chromatin accessibility peaks in five cell lines (DART-Eval split)Caduceus (fine-tuned) on DART-Eval CA-SPEARMAN-H1ESC: Chromatin activity prediction, H1ESC, positives only
Caduceus (fine-tuned)Spearman0.454 unitlessENCODE chromatin accessibility peaks in five cell lines (DART-Eval split)Caduceus (fine-tuned) on DART-Eval CA-SPEARMAN-HEPG2: Chromatin activity prediction, HEPG2, positives only
Caduceus (fine-tuned)Spearman0.479 unitlessENCODE chromatin accessibility peaks in five cell lines (DART-Eval split)Caduceus (fine-tuned) on DART-Eval CA-SPEARMAN-IMR90: Chromatin activity prediction, IMR90, positives only
Caduceus (fine-tuned)Spearman0.570 unitlessENCODE chromatin accessibility peaks in five cell lines (DART-Eval split)Caduceus (fine-tuned) on DART-Eval CA-SPEARMAN-K562: Chromatin activity prediction, K562, positives only
Caduceus (fine-tuned)Accuracy0.671 fractionENCODE chromatin accessibility peaks in five cell lines (DART-Eval split)Caduceus (fine-tuned) on DART-Eval CTS-ACC: Cell-type-specific element classification, overall accuracy
Caduceus (fine-tuned)AUROC0.900 unitlessENCODE chromatin accessibility peaks in five cell lines (DART-Eval split)Caduceus (fine-tuned) on DART-Eval CTS-GM12878: Cell-type-specific element classification, GM12878
Caduceus (fine-tuned)AUROC0.937 unitlessENCODE chromatin accessibility peaks in five cell lines (DART-Eval split)Caduceus (fine-tuned) on DART-Eval CTS-H1ESC: Cell-type-specific element classification, H1ESC
Caduceus (fine-tuned)AUROC0.901 unitlessENCODE chromatin accessibility peaks in five cell lines (DART-Eval split)Caduceus (fine-tuned) on DART-Eval CTS-HEPG2: Cell-type-specific element classification, HEPG2
Caduceus (fine-tuned)AUROC0.929 unitlessENCODE chromatin accessibility peaks in five cell lines (DART-Eval split)Caduceus (fine-tuned) on DART-Eval CTS-IMR90: Cell-type-specific element classification, IMR90
Caduceus (fine-tuned)AUROC0.878 unitlessENCODE chromatin accessibility peaks in five cell lines (DART-Eval split)Caduceus (fine-tuned) on DART-Eval CTS-K562: Cell-type-specific element classification, K562
Caduceus (fine-tuned)Accuracy0.903 fractionENCODE cCREs against dinucleotide-shuffled backgrounds (DART-Eval split)Caduceus (fine-tuned) on DART-Eval REI-ABS: Regulatory element identification, absolute accuracy
Caduceus (fine-tuned)Paired accuracy0.971 fractionENCODE cCREs against dinucleotide-shuffled backgrounds (DART-Eval split)Caduceus (fine-tuned) on DART-Eval REI-PAIR: Regulatory element identification, paired accuracy
Caduceus (fine-tuned)AUROC0.650 unitlessChromatin QTLs in African LCLs (DART-Eval split)Caduceus (fine-tuned) on DART-Eval VS-AFRICAN-AUROC: Variant scoring on Chromatin QTLs in African LCLs, AUROC
Caduceus (fine-tuned)Pearson0.259 unitlessChromatin QTLs in African LCLs (DART-Eval split)Caduceus (fine-tuned) on DART-Eval VS-AFRICAN-PEARSON_R: Variant scoring on Chromatin QTLs in African LCLs, Pearson r
Caduceus (fine-tuned)AUROC0.666 unitlessDNase QTLs in Yoruban LCLs (DART-Eval split)Caduceus (fine-tuned) on DART-Eval VS-YORUBAN-AUROC: Variant scoring on DNase QTLs in Yoruban LCLs, AUROC
Caduceus (fine-tuned)Pearson0.513 unitlessDNase QTLs in Yoruban LCLs (DART-Eval split)Caduceus (fine-tuned) on DART-Eval VS-YORUBAN-PEARSON_R: Variant scoring on DNase QTLs in Yoruban LCLs, Pearson r
Caduceus (probed)AUROC0.605 unitlessENCODE chromatin accessibility peaks in five cell lines (DART-Eval split)Caduceus (probed) on DART-Eval CA-AUROC-GM12878: Chromatin activity prediction, GM12878, positives against negatives
Caduceus (probed)AUROC0.608 unitlessENCODE chromatin accessibility peaks in five cell lines (DART-Eval split)Caduceus (probed) on DART-Eval CA-AUROC-H1ESC: Chromatin activity prediction, H1ESC, positives against negatives
Caduceus (probed)AUROC0.611 unitlessENCODE chromatin accessibility peaks in five cell lines (DART-Eval split)Caduceus (probed) on DART-Eval CA-AUROC-HEPG2: Chromatin activity prediction, HEPG2, positives against negatives
Caduceus (probed)AUROC0.610 unitlessENCODE chromatin accessibility peaks in five cell lines (DART-Eval split)Caduceus (probed) on DART-Eval CA-AUROC-IMR90: Chromatin activity prediction, IMR90, positives against negatives
Caduceus (probed)AUROC0.616 unitlessENCODE chromatin accessibility peaks in five cell lines (DART-Eval split)Caduceus (probed) on DART-Eval CA-AUROC-K562: Chromatin activity prediction, K562, positives against negatives
Caduceus (probed)Spearman0.251 unitlessENCODE chromatin accessibility peaks in five cell lines (DART-Eval split)Caduceus (probed) on DART-Eval CA-SPEARMAN-GM12878: Chromatin activity prediction, GM12878, positives only
Caduceus (probed)Spearman0.371 unitlessENCODE chromatin accessibility peaks in five cell lines (DART-Eval split)Caduceus (probed) on DART-Eval CA-SPEARMAN-H1ESC: Chromatin activity prediction, H1ESC, positives only
Caduceus (probed)Spearman0.312 unitlessENCODE chromatin accessibility peaks in five cell lines (DART-Eval split)Caduceus (probed) on DART-Eval CA-SPEARMAN-HEPG2: Chromatin activity prediction, HEPG2, positives only
Caduceus (probed)Spearman0.149 unitlessENCODE chromatin accessibility peaks in five cell lines (DART-Eval split)Caduceus (probed) on DART-Eval CA-SPEARMAN-IMR90: Chromatin activity prediction, IMR90, positives only
Caduceus (probed)Spearman0.401 unitlessENCODE chromatin accessibility peaks in five cell lines (DART-Eval split)Caduceus (probed) on DART-Eval CA-SPEARMAN-K562: Chromatin activity prediction, K562, positives only
Caduceus (probed)Accuracy0.281 fractionENCODE chromatin accessibility peaks in five cell lines (DART-Eval split)Caduceus (probed) on DART-Eval CTS-ACC: Cell-type-specific element classification, overall accuracy
Caduceus (probed)AUROC0.535 unitlessENCODE chromatin accessibility peaks in five cell lines (DART-Eval split)Caduceus (probed) on DART-Eval CTS-GM12878: Cell-type-specific element classification, GM12878
Caduceus (probed)AUROC0.622 unitlessENCODE chromatin accessibility peaks in five cell lines (DART-Eval split)Caduceus (probed) on DART-Eval CTS-H1ESC: Cell-type-specific element classification, H1ESC
Caduceus (probed)AUROC0.680 unitlessENCODE chromatin accessibility peaks in five cell lines (DART-Eval split)Caduceus (probed) on DART-Eval CTS-HEPG2: Cell-type-specific element classification, HEPG2
Caduceus (probed)AUROC0.576 unitlessENCODE chromatin accessibility peaks in five cell lines (DART-Eval split)Caduceus (probed) on DART-Eval CTS-IMR90: Cell-type-specific element classification, IMR90
Caduceus (probed)AUROC0.587 unitlessENCODE chromatin accessibility peaks in five cell lines (DART-Eval split)Caduceus (probed) on DART-Eval CTS-K562: Cell-type-specific element classification, K562
Caduceus (probed)Accuracy0.726 fractionENCODE cCREs against dinucleotide-shuffled backgrounds (DART-Eval split)Caduceus (probed) on DART-Eval REI-ABS: Regulatory element identification, absolute accuracy
Caduceus (probed)Paired accuracy0.896 fractionENCODE cCREs against dinucleotide-shuffled backgrounds (DART-Eval split)Caduceus (probed) on DART-Eval REI-PAIR: Regulatory element identification, paired accuracy
Caduceus (probed)AUROC0.512 unitlessChromatin QTLs in African LCLs (DART-Eval split)Caduceus (probed) on DART-Eval VS-AFRICAN-AUROC: Variant scoring on Chromatin QTLs in African LCLs, AUROC
Caduceus (probed)Pearson-0.004 unitlessChromatin QTLs in African LCLs (DART-Eval split)Caduceus (probed) on DART-Eval VS-AFRICAN-PEARSON_R: Variant scoring on Chromatin QTLs in African LCLs, Pearson r
Caduceus (probed)AUROC0.490 unitlessDNase QTLs in Yoruban LCLs (DART-Eval split)Caduceus (probed) on DART-Eval VS-YORUBAN-AUROC: Variant scoring on DNase QTLs in Yoruban LCLs, AUROC
Caduceus (probed)Pearson0.017 unitlessDNase QTLs in Yoruban LCLs (DART-Eval split)Caduceus (probed) on DART-Eval VS-YORUBAN-PEARSON_R: Variant scoring on DNase QTLs in Yoruban LCLs, Pearson r
Caduceus (zero-shot embedding)AUROC0.519 unitlessChromatin QTLs in African LCLs (DART-Eval split)Caduceus (zero-shot embedding) on DART-Eval VS-AFRICAN-AUROC: Variant scoring on Chromatin QTLs in African LCLs, AUROC
Caduceus (zero-shot embedding)AUROC0.508 unitlessDNase QTLs in Yoruban LCLs (DART-Eval split)Caduceus (zero-shot embedding) on DART-Eval VS-YORUBAN-AUROC: Variant scoring on DNase QTLs in Yoruban LCLs, AUROC
Caduceus (zero-shot likelihood)AUROC0.525 unitlessChromatin QTLs in African LCLs (DART-Eval split)Caduceus (zero-shot likelihood) on DART-Eval VS-AFRICAN-AUROC: Variant scoring on Chromatin QTLs in African LCLs, AUROC
Caduceus (zero-shot likelihood)AUROC0.443 unitlessDNase QTLs in Yoruban LCLs (DART-Eval split)Caduceus (zero-shot likelihood) on DART-Eval VS-YORUBAN-AUROC: Variant scoring on DNase QTLs in Yoruban LCLs, AUROC
Caduceus (zero-shot)Accuracy0.971 fractionENCODE cCREs against dinucleotide-shuffled backgrounds (DART-Eval split)Caduceus (zero-shot) on DART-Eval REI-ACC: Regulatory element identification, zero-shot accuracy
ChromBPNet (ab initio)AUROC0.940 unitlessENCODE chromatin accessibility peaks in five cell lines (DART-Eval split)ChromBPNet (ab initio) on DART-Eval CA-AUROC-GM12878: Chromatin activity prediction, GM12878, positives against negatives

Claims

Statements this source supports, each with where in the source it was checked.

Models, benchmarks and other records

Methods (3)

Configurations (27)

Benchmarks (1)

Tasks (24)

Dataset subsets (4)

Evaluations (316)

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

15 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Artifact SHA-256
4194b137ba55c9a2c269d119a9afec6ae1bb0feaf17d91433ae483c41221a56b
Source metadata
DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA

Original source ↗

No field-specific location recorded

Version: 2412.05430v1
Retrieved: 2026-09-17T07:56:09.182117+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_sha256

Source artifact SHA-256: 4194b137ba55c9a2c269d119a9afec6ae1bb0feaf17d91433ae483c41221a56b

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Artifact url
https://arxiv.org/html/2412.05430v1
Source metadata
DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA

Original source ↗

No field-specific location recorded

Version: 2412.05430v1
Retrieved: 2026-09-17T07:56:09.182117+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_url

Source artifact SHA-256: 4194b137ba55c9a2c269d119a9afec6ae1bb0feaf17d91433ae483c41221a56b

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Hash scope
Exact retrieved primary paper artifact bytes.
Source metadata
DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA

Original source ↗

No field-specific location recorded

Version: 2412.05430v1
Retrieved: 2026-09-17T07:56:09.182117+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.hash_scope

Source artifact SHA-256: 4194b137ba55c9a2c269d119a9afec6ae1bb0feaf17d91433ae483c41221a56b

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Retrieved at
2026-09-17T07:56:09.182117+00:00
Source metadata
DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA

Original source ↗

No field-specific location recorded

Version: 2412.05430v1
Retrieved: 2026-09-17T07:56:09.182117+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.retrieved_at

Source artifact SHA-256: 4194b137ba55c9a2c269d119a9afec6ae1bb0feaf17d91433ae483c41221a56b

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Review method
1 values
  • automated-source-review
Source metadata
DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA

Original source ↗

No field-specific location recorded

Version: 2412.05430v1
Retrieved: 2026-09-17T07:56:09.182117+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.review.method

Source artifact SHA-256: 4194b137ba55c9a2c269d119a9afec6ae1bb0feaf17d91433ae483c41221a56b

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Review: scope
Source identification and table transcription; no independent experimental reproduction.
Source metadata
DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA

Original source ↗

No field-specific location recorded

Version: 2412.05430v1
Retrieved: 2026-09-17T07:56:09.182117+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.review.scope

Source artifact SHA-256: 4194b137ba55c9a2c269d119a9afec6ae1bb0feaf17d91433ae483c41221a56b

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Url
https://arxiv.org/html/2412.05430v1
Source metadata
DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA

Original source ↗

No field-specific location recorded

Version: 2412.05430v1
Retrieved: 2026-09-17T07:56:09.182117+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.url

Source artifact SHA-256: 4194b137ba55c9a2c269d119a9afec6ae1bb0feaf17d91433ae483c41221a56b

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Version
2412.05430v1
Source metadata
DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA

Original source ↗

No field-specific location recorded

Version: 2412.05430v1
Retrieved: 2026-09-17T07:56:09.182117+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.version

Source artifact SHA-256: 4194b137ba55c9a2c269d119a9afec6ae1bb0feaf17d91433ae483c41221a56b

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Description
Primary reference; inspect retrieval status and review scope.
Source metadata
DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA

Original source ↗

No field-specific location recorded

Version: 2412.05430v1
Retrieved: 2026-09-17T07:56:09.182117+00:00

catalogued

No individual claim review recorded

Audit details

Field: description

Source artifact SHA-256: 4194b137ba55c9a2c269d119a9afec6ae1bb0feaf17d91433ae483c41221a56b

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Search facets
None recorded
Source metadata
DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA

Original source ↗

No field-specific location recorded

Version: 2412.05430v1
Retrieved: 2026-09-17T07:56:09.182117+00:00

catalogued

No individual claim review recorded

Audit details

Field: facets

Source artifact SHA-256: 4194b137ba55c9a2c269d119a9afec6ae1bb0feaf17d91433ae483c41221a56b

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

Primary reference; inspect retrieval status and review scope.

Release history

No supporting source is linked yet.

Read original source

Download this release (gzip)
Technical metadata and extraction receipts

Stable ID: evidence-expansion-p2-evidence-discovery-final-dart-4194b137ba55

url
https://arxiv.org/html/2412.05430v1
version
2412.05430v1
retrieved at
2026-09-17T07:56:09.182117+00:00
artifact sha256
4194b137ba55c9a2c269d119a9afec6ae1bb0feaf17d91433ae483c41221a56b
artifact url
https://arxiv.org/html/2412.05430v1
hash scope
Exact retrieved primary paper artifact bytes.
review
scope: Source identification and table transcription; no independent experimental reproduction.; method: automated-source-review
Related records

    Suggest a correction