| Configuration: AUGUSTUS | Task: BEND GENE-FINDING: Gene finding Dataset subset: GENCODE (BEND split) | 0.8 mcc correlation · higher Uncertainty: Not reported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceAUGUSTUS on BEND GENE-FINDING: Gene finding A downstream head trained on frozen embeddings, except for the expert methods and the fully supervised baselines, which are trained end to end. Metric and splits are from Table 1. Aggregation: Not reported BEND: Benchmarking DNA Language Models on Biologically Meaningful Tasks · Table 3, row(Expert method), column(Gene finding) |
|---|
| Method: AWD-LSTM | Task: BEND GENE-FINDING: Gene finding Dataset subset: GENCODE (BEND split) | 0.05 mcc correlation · higher Uncertainty: Not reported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceAWD-LSTM on BEND GENE-FINDING: Gene finding A downstream head trained on frozen embeddings, except for the expert methods and the fully supervised baselines, which are trained end to end. Metric and splits are from Table 1. Aggregation: Not reported BEND: Benchmarking DNA Language Models on Biologically Meaningful Tasks · Table 3, row(AWD-LSTM), column(Gene finding) |
|---|
| Method: CNN | Task: BEND GENE-FINDING: Gene finding Dataset subset: GENCODE (BEND split) | 0 mcc correlation · higher Uncertainty: Not reported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceCNN on BEND GENE-FINDING: Gene finding A downstream head trained on frozen embeddings, except for the expert methods and the fully supervised baselines, which are trained end to end. Metric and splits are from Table 1. Aggregation: Not reported BEND: Benchmarking DNA Language Models on Biologically Meaningful Tasks · Table 3, row(CNN), column(Gene finding) |
|---|
| Configuration: DNABERT-2 | Task: BEND GENE-FINDING: Gene finding Dataset subset: GENCODE (BEND split) | 0.43 mcc correlation · higher Uncertainty: Not reported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceDNABERT-2 on BEND GENE-FINDING: Gene finding A downstream head trained on frozen embeddings, except for the expert methods and the fully supervised baselines, which are trained end to end. Metric and splits are from Table 1. Aggregation: Not reported BEND: Benchmarking DNA Language Models on Biologically Meaningful Tasks · Table 3, row(DNABERT-2), column(Gene finding) |
|---|
| Configuration: DNABERT | Task: BEND GENE-FINDING: Gene finding Dataset subset: GENCODE (BEND split) | 0.2 mcc correlation · higher Uncertainty: Not reported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceDNABERT on BEND GENE-FINDING: Gene finding A downstream head trained on frozen embeddings, except for the expert methods and the fully supervised baselines, which are trained end to end. Metric and splits are from Table 1. Aggregation: Not reported BEND: Benchmarking DNA Language Models on Biologically Meaningful Tasks · Table 3, row(DNABERT), column(Gene finding) |
|---|
| Configuration: GENA-LM BERT | Task: BEND GENE-FINDING: Gene finding Dataset subset: GENCODE (BEND split) | 0.52 mcc correlation · higher Uncertainty: Not reported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceGENA-LM BERT on BEND GENE-FINDING: Gene finding A downstream head trained on frozen embeddings, except for the expert methods and the fully supervised baselines, which are trained end to end. Metric and splits are from Table 1. Aggregation: Not reported BEND: Benchmarking DNA Language Models on Biologically Meaningful Tasks · Table 3, row(GENA-LM BERT), column(Gene finding) |
|---|
| Configuration: GENA-LM BigBird | Task: BEND GENE-FINDING: Gene finding Dataset subset: GENCODE (BEND split) | 0.39 mcc correlation · higher Uncertainty: Not reported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceGENA-LM BigBird on BEND GENE-FINDING: Gene finding A downstream head trained on frozen embeddings, except for the expert methods and the fully supervised baselines, which are trained end to end. Metric and splits are from Table 1. Aggregation: Not reported BEND: Benchmarking DNA Language Models on Biologically Meaningful Tasks · Table 3, row(GENA-LM BigBird), column(Gene finding) |
|---|
| Configuration: GROVER | Task: BEND GENE-FINDING: Gene finding Dataset subset: GENCODE (BEND split) | 0.28 mcc correlation · higher Uncertainty: Not reported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceGROVER on BEND GENE-FINDING: Gene finding A downstream head trained on frozen embeddings, except for the expert methods and the fully supervised baselines, which are trained end to end. Metric and splits are from Table 1. Aggregation: Not reported BEND: Benchmarking DNA Language Models on Biologically Meaningful Tasks · Table 3, row(GROVER), column(Gene finding) |
|---|
| Configuration: HyenaDNA large | Task: BEND GENE-FINDING: Gene finding Dataset subset: GENCODE (BEND split) | 0.35 mcc correlation · higher Uncertainty: Not reported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceHyenaDNA large on BEND GENE-FINDING: Gene finding A downstream head trained on frozen embeddings, except for the expert methods and the fully supervised baselines, which are trained end to end. Metric and splits are from Table 1. Aggregation: Not reported BEND: Benchmarking DNA Language Models on Biologically Meaningful Tasks · Table 3, row(HyenaDNA large), column(Gene finding) |
|---|
| Configuration: HyenaDNA tiny | Task: BEND GENE-FINDING: Gene finding Dataset subset: GENCODE (BEND split) | 0.1 mcc correlation · higher Uncertainty: Not reported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceHyenaDNA tiny on BEND GENE-FINDING: Gene finding A downstream head trained on frozen embeddings, except for the expert methods and the fully supervised baselines, which are trained end to end. Metric and splits are from Table 1. Aggregation: Not reported BEND: Benchmarking DNA Language Models on Biologically Meaningful Tasks · Table 3, row(HyenaDNA tiny), column(Gene finding) |
|---|
| Configuration: NT-1000G | Task: BEND GENE-FINDING: Gene finding Dataset subset: GENCODE (BEND split) | 0.49 mcc correlation · higher Uncertainty: Not reported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceNT-1000G on BEND GENE-FINDING: Gene finding A downstream head trained on frozen embeddings, except for the expert methods and the fully supervised baselines, which are trained end to end. Metric and splits are from Table 1. Aggregation: Not reported BEND: Benchmarking DNA Language Models on Biologically Meaningful Tasks · Table 3, row(NT-1000G), column(Gene finding) |
|---|
| Method: NT-H | Task: BEND GENE-FINDING: Gene finding Dataset subset: GENCODE (BEND split) | 0.41 mcc correlation · higher Uncertainty: Not reported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceNT-H on BEND GENE-FINDING: Gene finding A downstream head trained on frozen embeddings, except for the expert methods and the fully supervised baselines, which are trained end to end. Metric and splits are from Table 1. Aggregation: Not reported BEND: Benchmarking DNA Language Models on Biologically Meaningful Tasks · Table 3, row(NT-H), column(Gene finding) |
|---|
| Method: NT-MS | Task: BEND GENE-FINDING: Gene finding Dataset subset: GENCODE (BEND split) | 0.68 mcc correlation · higher Uncertainty: Not reported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceNT-MS on BEND GENE-FINDING: Gene finding A downstream head trained on frozen embeddings, except for the expert methods and the fully supervised baselines, which are trained end to end. Metric and splits are from Table 1. Aggregation: Not reported BEND: Benchmarking DNA Language Models on Biologically Meaningful Tasks · Table 3, row(NT-MS), column(Gene finding) |
|---|
| Configuration: NT-V2 | Task: BEND GENE-FINDING: Gene finding Dataset subset: GENCODE (BEND split) | 0.64 mcc correlation · higher Uncertainty: Not reported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceNT-V2 on BEND GENE-FINDING: Gene finding A downstream head trained on frozen embeddings, except for the expert methods and the fully supervised baselines, which are trained end to end. Metric and splits are from Table 1. Aggregation: Not reported BEND: Benchmarking DNA Language Models on Biologically Meaningful Tasks · Table 3, row(NT-V2), column(Gene finding) |
|---|
| Configuration: ResNet | Task: BEND GENE-FINDING: Gene finding Dataset subset: GENCODE (BEND split) | 0.46 mcc correlation · higher Uncertainty: Not reported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceResNet on BEND GENE-FINDING: Gene finding A downstream head trained on frozen embeddings, except for the expert methods and the fully supervised baselines, which are trained end to end. Metric and splits are from Table 1. Aggregation: Not reported BEND: Benchmarking DNA Language Models on Biologically Meaningful Tasks · Table 3, row(ResNet), column(Gene finding) |
|---|
| Method: ResNet-LM | Task: BEND GENE-FINDING: Gene finding Dataset subset: GENCODE (BEND split) | 0.36 mcc correlation · higher Uncertainty: Not reported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceResNet-LM on BEND GENE-FINDING: Gene finding A downstream head trained on frozen embeddings, except for the expert methods and the fully supervised baselines, which are trained end to end. Metric and splits are from Table 1. Aggregation: Not reported BEND: Benchmarking DNA Language Models on Biologically Meaningful Tasks · Table 3, row(ResNet-LM), column(Gene finding) |
|---|