DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA
2412.05430v1
What this source contributed
Records in this release that cite this source. A record can cite several sources.
Results
Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.
Claims
Statements this source supports, each with where in the source it was checked.
- DART-Eval CA-AUROC-GM12878: part of discovery-benchmark-dart-eval: Part of DART-Eval (Table 5, column(AUROC GM12878))
- DART-Eval CA-AUROC-H1ESC: part of discovery-benchmark-dart-eval: Part of DART-Eval (Table 5, column(AUROC H1ESC))
- DART-Eval CA-AUROC-HEPG2: part of discovery-benchmark-dart-eval: Part of DART-Eval (Table 5, column(AUROC HEPG2))
- DART-Eval CA-AUROC-IMR90: part of discovery-benchmark-dart-eval: Part of DART-Eval (Table 5, column(AUROC IMR90))
- DART-Eval CA-AUROC-K562: part of discovery-benchmark-dart-eval: Part of DART-Eval (Table 5, column(AUROC K562))
- DART-Eval CA-SPEARMAN-GM12878: part of discovery-benchmark-dart-eval: Part of DART-Eval (Table 5, column(Spearman r GM12878))
- DART-Eval CA-SPEARMAN-H1ESC: part of discovery-benchmark-dart-eval: Part of DART-Eval (Table 5, column(Spearman r H1ESC))
- DART-Eval CA-SPEARMAN-HEPG2: part of discovery-benchmark-dart-eval: Part of DART-Eval (Table 5, column(Spearman r HEPG2))
- DART-Eval CA-SPEARMAN-IMR90: part of discovery-benchmark-dart-eval: Part of DART-Eval (Table 5, column(Spearman r IMR90))
- DART-Eval CA-SPEARMAN-K562: part of discovery-benchmark-dart-eval: Part of DART-Eval (Table 5, column(Spearman r K562))
- DART-Eval CTS-ACC: part of discovery-benchmark-dart-eval: Part of DART-Eval (Table 4, column(Overall Accuracy))
- DART-Eval CTS-GM12878: part of discovery-benchmark-dart-eval: Part of DART-Eval (Table 4, column(GM12878 AUROC))
- DART-Eval CTS-H1ESC: part of discovery-benchmark-dart-eval: Part of DART-Eval (Table 4, column(H1ESC AUROC))
- DART-Eval CTS-HEPG2: part of discovery-benchmark-dart-eval: Part of DART-Eval (Table 4, column(HEPG2 AUROC))
- DART-Eval CTS-IMR90: part of discovery-benchmark-dart-eval: Part of DART-Eval (Table 4, column(IMR90 AUROC))
- DART-Eval CTS-K562: part of discovery-benchmark-dart-eval: Part of DART-Eval (Table 4, column(K562 AUROC))
- DART-Eval REI-ABS: part of discovery-benchmark-dart-eval: Part of DART-Eval (Table 3, column(Absolute accuracy))
- DART-Eval REI-ACC: part of discovery-benchmark-dart-eval: Part of DART-Eval (Table 3, column(Zero-Shot Accuracy))
- DART-Eval REI-PAIR: part of discovery-benchmark-dart-eval: Part of DART-Eval (Table 3, column(Paired accuracy))
- DART-Eval VS-AFRICAN-AUROC: part of discovery-benchmark-dart-eval: Part of DART-Eval (Table 6, row group(AFRICAN), column(AUROC))
- DART-Eval VS-AFRICAN-PEARSON_R: part of discovery-benchmark-dart-eval: Part of DART-Eval (Table 6, row group(AFRICAN), column(Pearson r))
- DART-Eval VS-YORUBAN-AUROC: part of discovery-benchmark-dart-eval: Part of DART-Eval (Table 6, row group(YORUBAN), column(AUROC))
- DART-Eval VS-YORUBAN-PEARSON_R: part of discovery-benchmark-dart-eval: Part of DART-Eval (Table 6, row group(YORUBAN), column(Pearson r))
- DNABERT-2 (fine-tuned): family DNABERT-2: Family DNABERT-2 (DART-Eval Table 1 (DNABERT-2, 117M) and adaptation-specific result tables; source-labelled configuration DNABERT-2 (fine-tuned) | Existing reviewed locator: Table 1, row(DNABERT-2))
- DNABERT-2 (probed): family DNABERT-2: Family DNABERT-2 (DART-Eval Table 1 (DNABERT-2, 117M) and adaptation-specific result tables; source-labelled configuration DNABERT-2 (probed) | Existing reviewed locator: Table 1, row(DNABERT-2))
Models, benchmarks and other records
Methods (3)
Configurations (27)
- Caduceus (fine-tuned)
- Caduceus (probed)
- Caduceus (zero-shot embedding)
- Caduceus (zero-shot likelihood)
- Caduceus (zero-shot)
- DNABERT-2 (fine-tuned)
- DNABERT-2 (probed)
- DNABERT-2 (zero-shot embedding)
- DNABERT-2 (zero-shot)
- GENA-LM (fine-tuned)
- GENA-LM (probed)
- GENA-LM (zero-shot embedding)
- GENA-LM (zero-shot)
- HyenaDNA (fine-tuned)
- HyenaDNA (probed)
- HyenaDNA (zero-shot embedding)
- HyenaDNA (zero-shot likelihood)
- HyenaDNA (zero-shot)
- Mistral-DNA (fine-tuned)
- Mistral-DNA (probed)
- Mistral-DNA (zero-shot embedding)
- Mistral-DNA (zero-shot)
- Nucleotide Transformer (fine-tuned)
- Nucleotide Transformer (probed)
- Nucleotide Transformer (zero-shot embedding)
Benchmarks (1)
Tasks (24)
- DART-Eval CA-AUROC-GM12878: Chromatin activity prediction, GM12878, positives against negatives
- DART-Eval CA-AUROC-H1ESC: Chromatin activity prediction, H1ESC, positives against negatives
- DART-Eval CA-AUROC-HEPG2: Chromatin activity prediction, HEPG2, positives against negatives
- DART-Eval CA-AUROC-IMR90: Chromatin activity prediction, IMR90, positives against negatives
- DART-Eval CA-AUROC-K562: Chromatin activity prediction, K562, positives against negatives
- DART-Eval CA-SPEARMAN-GM12878: Chromatin activity prediction, GM12878, positives only
- DART-Eval CA-SPEARMAN-H1ESC: Chromatin activity prediction, H1ESC, positives only
- DART-Eval CA-SPEARMAN-HEPG2: Chromatin activity prediction, HEPG2, positives only
- DART-Eval CA-SPEARMAN-IMR90: Chromatin activity prediction, IMR90, positives only
- DART-Eval CA-SPEARMAN-K562: Chromatin activity prediction, K562, positives only
- DART-Eval CTS-ACC: Cell-type-specific element classification, overall accuracy
- DART-Eval CTS-GM12878: Cell-type-specific element classification, GM12878
- DART-Eval CTS-H1ESC: Cell-type-specific element classification, H1ESC
- DART-Eval CTS-HEPG2: Cell-type-specific element classification, HEPG2
- DART-Eval CTS-IMR90: Cell-type-specific element classification, IMR90
- DART-Eval CTS-K562: Cell-type-specific element classification, K562
- DART-Eval REI-ABS: Regulatory element identification, absolute accuracy
- DART-Eval REI-ACC: Regulatory element identification, zero-shot accuracy
- DART-Eval REI-PAIR: Regulatory element identification, paired accuracy
- DART-Eval VS-AFRICAN-AUROC: Variant scoring on Chromatin QTLs in African LCLs, AUROC
- DART-Eval VS-AFRICAN-PEARSON_R: Variant scoring on Chromatin QTLs in African LCLs, Pearson r
- DART-Eval VS-YORUBAN-AUROC: Variant scoring on DNase QTLs in Yoruban LCLs, AUROC
- DART-Eval VS-YORUBAN-PEARSON_R: Variant scoring on DNase QTLs in Yoruban LCLs, Pearson r
- Enhancer / MPRA effects
Dataset subsets (4)
Evaluations (316)
- Caduceus (fine-tuned) on DART-Eval CA-AUROC-GM12878: Chromatin activity prediction, GM12878, positives against negatives
- Caduceus (fine-tuned) on DART-Eval CA-AUROC-H1ESC: Chromatin activity prediction, H1ESC, positives against negatives
- Caduceus (fine-tuned) on DART-Eval CA-AUROC-HEPG2: Chromatin activity prediction, HEPG2, positives against negatives
- Caduceus (fine-tuned) on DART-Eval CA-AUROC-IMR90: Chromatin activity prediction, IMR90, positives against negatives
- Caduceus (fine-tuned) on DART-Eval CA-AUROC-K562: Chromatin activity prediction, K562, positives against negatives
- Caduceus (fine-tuned) on DART-Eval CA-SPEARMAN-GM12878: Chromatin activity prediction, GM12878, positives only
- Caduceus (fine-tuned) on DART-Eval CA-SPEARMAN-H1ESC: Chromatin activity prediction, H1ESC, positives only
- Caduceus (fine-tuned) on DART-Eval CA-SPEARMAN-HEPG2: Chromatin activity prediction, HEPG2, positives only
- Caduceus (fine-tuned) on DART-Eval CA-SPEARMAN-IMR90: Chromatin activity prediction, IMR90, positives only
- Caduceus (fine-tuned) on DART-Eval CA-SPEARMAN-K562: Chromatin activity prediction, K562, positives only
- Caduceus (fine-tuned) on DART-Eval CTS-ACC: Cell-type-specific element classification, overall accuracy
- Caduceus (fine-tuned) on DART-Eval CTS-GM12878: Cell-type-specific element classification, GM12878
- Caduceus (fine-tuned) on DART-Eval CTS-H1ESC: Cell-type-specific element classification, H1ESC
- Caduceus (fine-tuned) on DART-Eval CTS-HEPG2: Cell-type-specific element classification, HEPG2
- Caduceus (fine-tuned) on DART-Eval CTS-IMR90: Cell-type-specific element classification, IMR90
- Caduceus (fine-tuned) on DART-Eval CTS-K562: Cell-type-specific element classification, K562
- Caduceus (fine-tuned) on DART-Eval REI-ABS: Regulatory element identification, absolute accuracy
- Caduceus (fine-tuned) on DART-Eval REI-PAIR: Regulatory element identification, paired accuracy
- Caduceus (fine-tuned) on DART-Eval VS-AFRICAN-AUROC: Variant scoring on Chromatin QTLs in African LCLs, AUROC
- Caduceus (fine-tuned) on DART-Eval VS-AFRICAN-PEARSON_R: Variant scoring on Chromatin QTLs in African LCLs, Pearson r
- Caduceus (fine-tuned) on DART-Eval VS-YORUBAN-AUROC: Variant scoring on DNase QTLs in Yoruban LCLs, AUROC
- Caduceus (fine-tuned) on DART-Eval VS-YORUBAN-PEARSON_R: Variant scoring on DNase QTLs in Yoruban LCLs, Pearson r
- Caduceus (probed) on DART-Eval CA-AUROC-GM12878: Chromatin activity prediction, GM12878, positives against negatives
- Caduceus (probed) on DART-Eval CA-AUROC-H1ESC: Chromatin activity prediction, H1ESC, positives against negatives
- Caduceus (probed) on DART-Eval CA-AUROC-HEPG2: Chromatin activity prediction, HEPG2, positives against negatives
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
15 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| Artifact SHA-256 4194b137ba55c9a2c269d119a9afec6ae1bb0feaf17d91433ae483c41221a56b Source metadata | DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA No field-specific location recorded Version: 2412.05430v1 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| Artifact url https://arxiv.org/html/2412.05430v1 Source metadata | DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA No field-specific location recorded Version: 2412.05430v1 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| Hash scope Exact retrieved primary paper artifact bytes. Source metadata | DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA No field-specific location recorded Version: 2412.05430v1 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| Retrieved at 2026-09-17T07:56:09.182117+00:00 Source metadata | DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA No field-specific location recorded Version: 2412.05430v1 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
Review method1 values
| DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA No field-specific location recorded Version: 2412.05430v1 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| Review: scope Source identification and table transcription; no independent experimental reproduction. Source metadata | DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA No field-specific location recorded Version: 2412.05430v1 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| Url https://arxiv.org/html/2412.05430v1 Source metadata | DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA No field-specific location recorded Version: 2412.05430v1 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| Version 2412.05430v1 Source metadata | DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA No field-specific location recorded Version: 2412.05430v1 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| Description Primary reference; inspect retrieval status and review scope. Source metadata | DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA No field-specific location recorded Version: 2412.05430v1 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| Search facets None recorded Source metadata | DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA No field-specific location recorded Version: 2412.05430v1 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
Sources and history
Release 2026-11-21-c8bea25e5abb · Record review: source checked
Primary reference; inspect retrieval status and review scope.
Technical metadata and extraction receipts
Stable ID: evidence-expansion-p2-evidence-discovery-final-dart-4194b137ba55
- url
- https://arxiv.org/html/2412.05430v1
- version
- 2412.05430v1
- retrieved at
- 2026-09-17T07:56:09.182117+00:00
- artifact sha256
- 4194b137ba55c9a2c269d119a9afec6ae1bb0feaf17d91433ae483c41221a56b
- artifact url
- https://arxiv.org/html/2412.05430v1
- hash scope
- Exact retrieved primary paper artifact bytes.
- review
- scope: Source identification and table transcription; no independent experimental reproduction.; method: automated-source-review