DNABERT and RNA-MSM: Benchmarking pre-trained genomic language models for RNA sequence-related predictive applications and Zero-shot benchmarking of RNA language models in structural, functional, and evolutionary learning disagree
- Low severity
- Not yet reviewed
- Two-study conflict
- unknown
Benchmarking pre-trained genomic language models for RNA sequence-related predictive applications ranks DNABERT above RNA-MSM in 4 of 4 comparisons; Zero-shot benchmarking of RNA language models in structural, functional, and evolutionary learning ranks RNA-MSM above DNABERT in 8 of 8 comparisons. No other study gives a verdict, so neither is the outlier.
An automatic lead, not a finding of error. The results below are shown as published, everywhere on the site, until a reviewer decides otherwise.
Which studies agree
2 papers rank DNABERT above RNA-MSM in 4 of their 20 comparisons and RNA-MSM higher in 8; 8 are ties. Of those papers, Zero-shot benchmarking of RNA language… ranks RNA-MSM higher on its own (8 of 8).
- Rank DNABERT higher (1): Benchmarking pre-trained genomic…
- Rank RNA-MSM higher (1): Zero-shot benchmarking of RNA language…
- Mixed (0): none
Each paper sits where at least two thirds of its comparisons point; Mixed means neither model reaches two thirds. The larger, outlined dot is the paper that disagrees.
| Paper | Role | Ranks DNABERT higher | Ranks RNA-MSM higher | Ties |
|---|---|---|---|---|
| Benchmarking pre-trained genomic language models for RNA sequence-related predictive applications and 1 more record · DOI | Agrees | 4 | 0 | 8 |
| Zero-shot benchmarking of RNA language models in structural, functional, and evolutionary learning and 1 more record · DOI | Agrees | 0 | 8 | 0 |
Comparisons in Benchmarking pre-trained genomic… (12)
Comparisons in Zero-shot benchmarking of RNA language… (8)
What disagrees
- studies
- 2
Follow-up
Current state: Not yet reviewed.
No one has reviewed this finding yet.
How to help resolve this
If you know why these studies disagree, for example a different population, metric or preprocessing step, or you have a corrected value, tell us through the contribution form. A reviewer checks every submission against its source before anything changes, and the step is added to the follow-up above.
Finding discrepancy-1be866f365446e7a · All contested results · How findings are made and followed up