Zero-shot benchmarking of RNA language models: Supplementary Information
bbag098_supplymentary_information_20260209.docx from the Europe PMC supplementary files archive for PMC12963973 · Peer-reviewed
What this source contributed
Records in this release that cite this source. A record can cite several sources.
Results
Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.
Models, benchmarks and other records
Models (14)
Configurations (40)
- 3UTRBERT (K3) (zero-shot, Wang et al. 2026)
- 3UTRBERT (K4) (zero-shot, Wang et al. 2026)
- 3UTRBERT (K5) (zero-shot, Wang et al. 2026)
- 3UTRBERT (K6) (zero-shot, Wang et al. 2026)
- AIDO.RNA (1.6B) (zero-shot, Wang et al. 2026)
- AIDO.RNA (650M) (zero-shot, Wang et al. 2026)
- BiRNA-BERT (BPE) (zero-shot, Wang et al. 2026)
- BiRNA-BERT (NUC) (zero-shot, Wang et al. 2026)
- DGRNA (zero-shot, Wang et al. 2026)
- DNABERT (k=3) (zero-shot, Wang et al. 2026)
- DNABERT (k=6) (zero-shot, Wang et al. 2026)
- DNABERT-2 (zero-shot, Wang et al. 2026)
- ERNIE-RNA (zero-shot, Wang et al. 2026)
- EVO1 (8k_base) (zero-shot, Wang et al. 2026)
- EVO1.5 (8k_base) (zero-shot, Wang et al. 2026)
- GenerRNA (zero-shot, Wang et al. 2026)
- LAMAR (2k) (zero-shot, Wang et al. 2026)
- LAMAR (4k) (zero-shot, Wang et al. 2026)
- LucaOne (D17.6M) (zero-shot, Wang et al. 2026)
- LucaOne (D36.0M) (zero-shot, Wang et al. 2026)
- LucaOne (G36.8M) (zero-shot, Wang et al. 2026)
- MP-RNA (zero-shot, Wang et al. 2026)
- NT (zero-shot, Wang et al. 2026)
- PlantRNA-FM (zero-shot, Wang et al. 2026)
- ProtRNA (zero-shot, Wang et al. 2026)
Benchmarks (1)
Protocols (36)
- Wang et al. 2026 zero-shot family classification, RfamSample (561 Rfam families), CLS embedding, 1 − OR (mean over repeated random samplings of sequence pairs)
- Wang et al. 2026 zero-shot family classification, RfamSample (561 Rfam families), CLS embedding, AUC (mean over repeated random samplings of sequence pairs)
- Wang et al. 2026 zero-shot family classification, RfamSample (561 Rfam families), CLS embedding, F1 (mean over repeated random samplings of sequence pairs)
- Wang et al. 2026 zero-shot family classification, RfamSample (561 Rfam families), CLS embedding, MCC (mean over repeated random samplings of sequence pairs)
- Wang et al. 2026 zero-shot family classification, RfamSample (561 Rfam families), FFT embedding, 1 − OR (mean over repeated random samplings of sequence pairs)
- Wang et al. 2026 zero-shot family classification, RfamSample (561 Rfam families), FFT embedding, AUC (mean over repeated random samplings of sequence pairs)
- Wang et al. 2026 zero-shot family classification, RfamSample (561 Rfam families), FFT embedding, F1 (mean over repeated random samplings of sequence pairs)
- Wang et al. 2026 zero-shot family classification, RfamSample (561 Rfam families), FFT embedding, MCC (mean over repeated random samplings of sequence pairs)
- Wang et al. 2026 zero-shot fitness, RNAGym ncRNA DMS assays (31 assays), PLL-D, AUC (mean over assays)
- Wang et al. 2026 zero-shot fitness, RNAGym ncRNA DMS assays (31 assays), PLL-D, AUC (median over assays)
- Wang et al. 2026 zero-shot fitness, RNAGym ncRNA DMS assays (31 assays), PLL-D, MCC (mean over assays)
- Wang et al. 2026 zero-shot fitness, RNAGym ncRNA DMS assays (31 assays), PLL-D, MCC (median over assays)
- Wang et al. 2026 zero-shot fitness, RNAGym ncRNA DMS assays (31 assays), PLL-D, SR (mean over assays)
- Wang et al. 2026 zero-shot fitness, RNAGym ncRNA DMS assays (31 assays), PLL-D, SR (median over assays)
- Wang et al. 2026 zero-shot fitness, RNAGym ncRNA DMS assays (31 assays), WT-LLR, AUC (mean over assays)
- Wang et al. 2026 zero-shot fitness, RNAGym ncRNA DMS assays (31 assays), WT-LLR, AUC (median over assays)
- Wang et al. 2026 zero-shot fitness, RNAGym ncRNA DMS assays (31 assays), WT-LLR, MCC (mean over assays)
- Wang et al. 2026 zero-shot fitness, RNAGym ncRNA DMS assays (31 assays), WT-LLR, MCC (median over assays)
- Wang et al. 2026 zero-shot fitness, RNAGym ncRNA DMS assays (31 assays), WT-LLR, SR (mean over assays)
- Wang et al. 2026 zero-shot fitness, RNAGym ncRNA DMS assays (31 assays), WT-LLR, SR (median over assays)
- Wang et al. 2026 zero-shot RNA type classification, ArchiveII-Nr (1273 RNAs), CLS embedding, 1 − OR (mean over repeated random samplings of sequence pairs)
- Wang et al. 2026 zero-shot RNA type classification, ArchiveII-Nr (1273 RNAs), CLS embedding, AUC (mean over repeated random samplings of sequence pairs)
- Wang et al. 2026 zero-shot RNA type classification, ArchiveII-Nr (1273 RNAs), CLS embedding, F1 (mean over repeated random samplings of sequence pairs)
- Wang et al. 2026 zero-shot RNA type classification, ArchiveII-Nr (1273 RNAs), CLS embedding, MCC (mean over repeated random samplings of sequence pairs)
- Wang et al. 2026 zero-shot RNA type classification, ArchiveII-Nr (1273 RNAs), FFT embedding, 1 − OR (mean over repeated random samplings of sequence pairs)
Evaluations (1,190)
- 3UTRBERT (K3) zero-shot family classification on RfamSample (561 Rfam families) (CLS embedding, 1 − OR, sampled-mean)
- 3UTRBERT (K3) zero-shot family classification on RfamSample (561 Rfam families) (CLS embedding, AUC, sampled-mean)
- 3UTRBERT (K3) zero-shot family classification on RfamSample (561 Rfam families) (CLS embedding, F1, sampled-mean)
- 3UTRBERT (K3) zero-shot family classification on RfamSample (561 Rfam families) (CLS embedding, MCC, sampled-mean)
- 3UTRBERT (K3) zero-shot family classification on RfamSample (561 Rfam families) (FFT embedding, 1 − OR, sampled-mean)
- 3UTRBERT (K3) zero-shot family classification on RfamSample (561 Rfam families) (FFT embedding, AUC, sampled-mean)
- 3UTRBERT (K3) zero-shot family classification on RfamSample (561 Rfam families) (FFT embedding, F1, sampled-mean)
- 3UTRBERT (K3) zero-shot family classification on RfamSample (561 Rfam families) (FFT embedding, MCC, sampled-mean)
- 3UTRBERT (K3) zero-shot fitness on RNAGym ncRNA DMS assays (31 assays) (PLL-D, AUC, mean)
- 3UTRBERT (K3) zero-shot fitness on RNAGym ncRNA DMS assays (31 assays) (PLL-D, AUC, median)
- 3UTRBERT (K3) zero-shot fitness on RNAGym ncRNA DMS assays (31 assays) (PLL-D, MCC, mean)
- 3UTRBERT (K3) zero-shot fitness on RNAGym ncRNA DMS assays (31 assays) (PLL-D, MCC, median)
- 3UTRBERT (K3) zero-shot fitness on RNAGym ncRNA DMS assays (31 assays) (PLL-D, SR, mean)
- 3UTRBERT (K3) zero-shot fitness on RNAGym ncRNA DMS assays (31 assays) (PLL-D, SR, median)
- 3UTRBERT (K3) zero-shot RNA type classification on ArchiveII-Nr (1273 RNAs) (CLS embedding, 1 − OR, sampled-mean)
- 3UTRBERT (K3) zero-shot RNA type classification on ArchiveII-Nr (1273 RNAs) (CLS embedding, AUC, sampled-mean)
- 3UTRBERT (K3) zero-shot RNA type classification on ArchiveII-Nr (1273 RNAs) (CLS embedding, F1, sampled-mean)
- 3UTRBERT (K3) zero-shot RNA type classification on ArchiveII-Nr (1273 RNAs) (CLS embedding, MCC, sampled-mean)
- 3UTRBERT (K3) zero-shot RNA type classification on ArchiveII-Nr (1273 RNAs) (FFT embedding, 1 − OR, sampled-mean)
- 3UTRBERT (K3) zero-shot RNA type classification on ArchiveII-Nr (1273 RNAs) (FFT embedding, AUC, sampled-mean)
- 3UTRBERT (K3) zero-shot RNA type classification on ArchiveII-Nr (1273 RNAs) (FFT embedding, F1, sampled-mean)
- 3UTRBERT (K3) zero-shot RNA type classification on ArchiveII-Nr (1273 RNAs) (FFT embedding, MCC, sampled-mean)
- 3UTRBERT (K3) zero-shot secondary structure on TS test set (70 PDB structures) (attention, F1 score, mean)
- 3UTRBERT (K3) zero-shot secondary structure on TS test set (70 PDB structures) (attention, F1 score, median)
- 3UTRBERT (K3) zero-shot secondary structure on TS test set (70 PDB structures) (attention, MCC, mean)
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
18 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| attributes.artifact_sha256 c8fc78c3d8538c9431fc0448a4068a7643dfb7d74558877fd40b36feba71e214 Source metadata | Zero-shot benchmarking of RNA language models: Supplementary Information No field-specific location recorded Version: bbag098_supplymentary_information_20260209.docx from the Europe PMC supplementary files archive for PMC12963973 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Artifact url https://www.ebi.ac.uk/europepmc/webservices/rest/PMC12963973/supplementaryFiles Source metadata | Zero-shot benchmarking of RNA language models: Supplementary Information No field-specific location recorded Version: bbag098_supplymentary_information_20260209.docx from the Europe PMC supplementary files archive for PMC12963973 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Doi 10.1093/bib/bbag098 Source metadata | Zero-shot benchmarking of RNA language models: Supplementary Information No field-specific location recorded Version: bbag098_supplymentary_information_20260209.docx from the Europe PMC supplementary files archive for PMC12963973 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Licence CC-BY-4.0 Source metadata | Zero-shot benchmarking of RNA language models: Supplementary Information No field-specific location recorded Version: bbag098_supplymentary_information_20260209.docx from the Europe PMC supplementary files archive for PMC12963973 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Limitations2 values
| Zero-shot benchmarking of RNA language models: Supplementary Information No field-specific location recorded Version: bbag098_supplymentary_information_20260209.docx from the Europe PMC supplementary files archive for PMC12963973 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Media type application/vnd.openxmlformats-officedocument.wordprocessingml.document Source metadata | Zero-shot benchmarking of RNA language models: Supplementary Information No field-specific location recorded Version: bbag098_supplymentary_information_20260209.docx from the Europe PMC supplementary files archive for PMC12963973 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Publication status peer_reviewed Source metadata | Zero-shot benchmarking of RNA language models: Supplementary Information No field-specific location recorded Version: bbag098_supplymentary_information_20260209.docx from the Europe PMC supplementary files archive for PMC12963973 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Retrieved at 2026-10-11T21:27:04Z Source metadata | Zero-shot benchmarking of RNA language models: Supplementary Information No field-specific location recorded Version: bbag098_supplymentary_information_20260209.docx from the Europe PMC supplementary files archive for PMC12963973 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Url https://doi.org/10.1093/bib/bbag098 Source metadata | Zero-shot benchmarking of RNA language models: Supplementary Information No field-specific location recorded Version: bbag098_supplymentary_information_20260209.docx from the Europe PMC supplementary files archive for PMC12963973 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Version bbag098_supplymentary_information_20260209.docx from the Europe PMC supplementary files archive for PMC12963973 Source metadata | Zero-shot benchmarking of RNA language models: Supplementary Information No field-specific location recorded Version: bbag098_supplymentary_information_20260209.docx from the Europe PMC supplementary files archive for PMC12963973 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Sources and history
Release 2026-10-22-1b7cf027e4f6 · Record review: source checked
Primary source retrieved and hashed for the 2026-10-11 RNA and other-omics literature pass.
Technical metadata and extraction receipts
Stable ID: lit-rna-20261011-rnalm-zeroshot-source-wang2026-supplement
- areas
- rna-transcriptomes
- contexts
- research
- url
- https://doi.org/10.1093/bib/bbag098
- artifact url
- https://www.ebi.ac.uk/europepmc/webservices/rest/PMC12963973/supplementaryFiles
- version
- bbag098_supplymentary_information_20260209.docx from the Europe PMC supplementary files archive for PMC12963973
- retrieved at
- 2026-10-11T21:27:04Z
- artifact sha256
- c8fc78c3d8538c9431fc0448a4068a7643dfb7d74558877fd40b36feba71e214
- doi
- 10.1093/bib/bbag098
- publication status
- peer_reviewed
- licence
- CC-BY-4.0
- media type
- application/vnd.openxmlformats-officedocument.wordprocessingml.document
- limitations
- The upward arrows in the column headers are in a symbol font and are lost in the text runs; directions are taken from the Methods.; Bold marks (best per model class) are not recorded.