rewirebio.iobenchmarks
Configuration

UTRBERT-6mer

Published RNA language model backbone, fine-tuned per task by the BEACON authors under their protocol.

13 evaluations · 13 results

Overview

An explanatory profile has not yet been reviewed for this record.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Evaluations and results

13 evaluations · 13 results. Different protocols are not a single leaderboard.

Sorted by R² (higher is better). The best value in each column is highlighted. Decimals are rounded for display; each value links to the printed value and its source.

Tested configurationProtocol and datasetR²SpearmanAccuracyAUROCF1 (base pairs; binary F1 over all position pairs pooled across the test set; threshold 0.5)Mean columnwise RMSEPrecision at lSplice top k accuracy
UTRBERT-6merEvaluationBEACON MRL: Mean ribosome loading prediction, Optimus (BEACON split)83.60(0.39) (best in column)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
UTRBERT-6merEvaluationBEACON APA: Alternative polyadenylation isoform prediction, APARENT (BEACON split)71.17(2.30)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
UTRBERT-6merEvaluationBEACON PRS: Programmable RNA switch prediction, Angenent-Mari's switch set (BEACON split)57.14(0.12)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
UTRBERT-6merEvaluationBEACON DMP: Distance map prediction, RNAcontact (BEACON split)50.02(1.05)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
UTRBERT-6merEvaluationBEACON SSI: Structure score imputation, StructureImpute (BEACON split)29.93(0.17)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
UTRBERT-6merEvaluationBEACON CMP: Contact map prediction, RNAcontact (BEACON split)Not reportedNot reportedNot reportedNot reportedNot reportedNot reported51.56(20.30)%Not reported
UTRBERT-6merEvaluationBEACON CRI-Off: CRISPR off-target effect prediction, DeepCRISPR (BEACON split)Not reported4.90(0.57)Not reportedNot reportedNot reportedNot reportedNot reportedNot reported
UTRBERT-6merEvaluationBEACON CRI-On: CRISPR on-target efficiency prediction, DeepCRISPR (BEACON split)Not reported28.60(1.55) (best in column)Not reportedNot reportedNot reportedNot reportedNot reportedNot reported
UTRBERT-6merEvaluationBEACON Modif: RNA modification site prediction, MultiRM (BEACON split)Not reportedNot reportedNot reported95.08(0.17)Not reportedNot reportedNot reportedNot reported
UTRBERT-6merEvaluationBEACON ncRNA: Non-coding RNA family classification, Noorul's ncRNA set (BEACON split)Not reportedNot reported93.12(0.168)%Not reportedNot reportedNot reportedNot reportedNot reported
UTRBERT-6merEvaluationBEACON SPL: Splice site prediction, SpliceAI (BEACON split)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported38.58(2.72)%
UTRBERT-6merEvaluationBEACON SSP: Secondary structure prediction, bpRNA-1m (BEACON split)Not reportedNot reportedNot reportedNot reported38.56(28.76)%Not reportedNot reportedNot reported
UTRBERT-6merEvaluationBEACON VDP: Vaccine degradation prediction, OpenVaccine (BEACON split)Not reportedNot reportedNot reportedNot reportedNot reported0.340(0.001)Not reportedNot reported
All 13 result rows with coverage, uncertainty and sources
Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: UTRBERT-6merTask: BEACON APA: Alternative polyadenylation isoform prediction
Dataset subset: APARENT (BEACON split)
71.17(2.30) R²
unitless · higher

Uncertainty: SD 2.30

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

UTRBERT-6mer on BEACON APA: Alternative polyadenylation isoform prediction

BEACON harness, fixed downstream head per task. Train/validation/test 145,463/33,170/49,755; dataset APARENT.

Aggregation: Not reported

BEACON: Benchmark for Comprehensive RNA Tasks and Language Models (arXiv:2406.10391v2) · Table3,p.8,row(UTRBERT-6mer),column(APA)
Configuration: UTRBERT-6merTask: BEACON CMP: Contact map prediction
Dataset subset: RNAcontact (BEACON split)
51.56(20.30)% Precision at l
percent · higher

Uncertainty: SD 20.30

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

UTRBERT-6mer on BEACON CMP: Contact map prediction

BEACON harness, fixed downstream head per task. Train/validation/test 188/23/80; dataset RNAcontact.

Aggregation: Not reported

BEACON: Benchmark for Comprehensive RNA Tasks and Language Models (arXiv:2406.10391v2) · Table3,p.8,row(UTRBERT-6mer),column(CMP)
Configuration: UTRBERT-6merTask: BEACON CRI-Off: CRISPR off-target effect prediction
Dataset subset: DeepCRISPR (BEACON split)
4.90(0.57) Spearman
unitless · higher

Uncertainty: SD 0.57

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

UTRBERT-6mer on BEACON CRI-Off: CRISPR off-target effect prediction

BEACON harness, fixed downstream head per task. Train/validation/test 14,223/2,032/4,064; dataset DeepCRISPR.

Aggregation: Not reported

BEACON: Benchmark for Comprehensive RNA Tasks and Language Models (arXiv:2406.10391v2) · Table3,p.8,row(UTRBERT-6mer),column(CRI-Off)
Configuration: UTRBERT-6merTask: BEACON CRI-On: CRISPR on-target efficiency prediction
Dataset subset: DeepCRISPR (BEACON split)
28.60(1.55) Spearman
unitless · higher

Uncertainty: SD 1.55

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

UTRBERT-6mer on BEACON CRI-On: CRISPR on-target efficiency prediction

BEACON harness, fixed downstream head per task. Train/validation/test 1,453/207/416; dataset DeepCRISPR.

Aggregation: Not reported

BEACON: Benchmark for Comprehensive RNA Tasks and Language Models (arXiv:2406.10391v2) · Table3,p.8,row(UTRBERT-6mer),column(CRI-On)
Configuration: UTRBERT-6merTask: BEACON DMP: Distance map prediction
Dataset subset: RNAcontact (BEACON split)
50.02(1.05) R²
unitless · higher

Uncertainty: SD 1.05

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

UTRBERT-6mer on BEACON DMP: Distance map prediction

BEACON harness, fixed downstream head per task. Train/validation/test 188/23/80; dataset RNAcontact.

Aggregation: Not reported

BEACON: Benchmark for Comprehensive RNA Tasks and Language Models (arXiv:2406.10391v2) · Table3,p.8,row(UTRBERT-6mer),column(DMP)
Configuration: UTRBERT-6merTask: BEACON Modif: RNA modification site prediction
Dataset subset: MultiRM (BEACON split)
95.08(0.17) AUROC
unitless · higher

Uncertainty: SD 0.17

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

UTRBERT-6mer on BEACON Modif: RNA modification site prediction

BEACON harness, fixed downstream head per task. Train/validation/test 304,661/3,599/1,200; dataset MultiRM.

Aggregation: Not reported

BEACON: Benchmark for Comprehensive RNA Tasks and Language Models (arXiv:2406.10391v2) · Table3,p.8,row(UTRBERT-6mer),column(Modif)
Configuration: UTRBERT-6merTask: BEACON MRL: Mean ribosome loading prediction
Dataset subset: Optimus (BEACON split)
83.60(0.39) R²
unitless · higher

Uncertainty: SD 0.39

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

UTRBERT-6mer on BEACON MRL: Mean ribosome loading prediction

BEACON harness, fixed downstream head per task. Train/validation/test 76,319/7,600/7,600; dataset Optimus.

Aggregation: Not reported

BEACON: Benchmark for Comprehensive RNA Tasks and Language Models (arXiv:2406.10391v2) · Table3,p.8,row(UTRBERT-6mer),column(MRL)
Configuration: UTRBERT-6merTask: BEACON ncRNA: Non-coding RNA family classification
Dataset subset: Noorul's ncRNA set (BEACON split)
93.12(0.168)% Accuracy
percent · higher

Uncertainty: SD 0.168

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

UTRBERT-6mer on BEACON ncRNA: Non-coding RNA family classification

BEACON harness, fixed downstream head per task. Train/validation/test 5,679/650/2,400; dataset Noorul's ncRNA set.

Aggregation: Not reported

BEACON: Benchmark for Comprehensive RNA Tasks and Language Models (arXiv:2406.10391v2) · Table3,p.8,row(UTRBERT-6mer),column(ncRNA)
Configuration: UTRBERT-6merTask: BEACON PRS: Programmable RNA switch prediction
Dataset subset: Angenent-Mari's switch set (BEACON split)
57.14(0.12) R²
unitless · higher

Uncertainty: SD 0.12

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

UTRBERT-6mer on BEACON PRS: Programmable RNA switch prediction

BEACON harness, fixed downstream head per task. Train/validation/test 73,227/9,153/9,154; dataset Angenent-Mari's switch set.

Aggregation: Not reported

BEACON: Benchmark for Comprehensive RNA Tasks and Language Models (arXiv:2406.10391v2) · Table3,p.8,row(UTRBERT-6mer),column(PRS)
Configuration: UTRBERT-6merTask: BEACON SPL: Splice site prediction
Dataset subset: SpliceAI (BEACON split)
38.58(2.72)% Splice top k accuracy
percent · higher

Uncertainty: SD 2.72

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

UTRBERT-6mer on BEACON SPL: Splice site prediction

BEACON harness, fixed downstream head per task. Train/validation/test 144,628/18,078/16,505; dataset SpliceAI.

Aggregation: Not reported

BEACON: Benchmark for Comprehensive RNA Tasks and Language Models (arXiv:2406.10391v2) · Table3,p.8,row(UTRBERT-6mer),column(SPL)
Configuration: UTRBERT-6merTask: BEACON SSI: Structure score imputation
Dataset subset: StructureImpute (BEACON split)
29.93(0.17) R²
unitless · higher

Uncertainty: SD 0.17

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

UTRBERT-6mer on BEACON SSI: Structure score imputation

BEACON harness, fixed downstream head per task. Train/validation/test 14,049/1,756/3,095; dataset StructureImpute.

Aggregation: Not reported

BEACON: Benchmark for Comprehensive RNA Tasks and Language Models (arXiv:2406.10391v2) · Table3,p.8,row(UTRBERT-6mer),column(SSI)
Configuration: UTRBERT-6merTask: BEACON SSP: Secondary structure prediction
Dataset subset: bpRNA-1m (BEACON split)
38.56(28.76)% F1 (base pairs; binary F1 over all position pairs pooled across the test set; threshold 0.5)
percent · higher

Uncertainty: SD 28.76

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

UTRBERT-6mer on BEACON SSP: Secondary structure prediction

BEACON harness, fixed downstream head per task. Train/validation/test 10,814/1,300/1,305; dataset bpRNA-1m.

Aggregation: Not reported

BEACON: Benchmark for Comprehensive RNA Tasks and Language Models (arXiv:2406.10391v2) · Table3,p.8,row(UTRBERT-6mer),column(SSP)
Configuration: UTRBERT-6merTask: BEACON VDP: Vaccine degradation prediction
Dataset subset: OpenVaccine (BEACON split)
0.340(0.001) Mean columnwise RMSE
unit-unreported · lower

Uncertainty: SD 0.001

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

UTRBERT-6mer on BEACON VDP: Vaccine degradation prediction

BEACON harness, fixed downstream head per task. Train/validation/test 2,155/245/629; dataset OpenVaccine.

Aggregation: Not reported

BEACON: Benchmark for Comprehensive RNA Tasks and Language Models (arXiv:2406.10391v2) · Table3,p.8,row(UTRBERT-6mer),column(VDP)

Source checking is not independent reproduction. Release 2026-11-02-a7f03c9e55a5.

Use this configuration

How it works, versions and access

Additional methodological details, versions and access terms have not yet been extracted into a structured profile for this configuration. Consult the linked sources and evaluation records below.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-02-a7f03c9e55a5
Property and statementOriginal source and locationReview and provenance

No evidence rows match these filters. Choose another scope or clear the search.

Sources and history

Release 2026-11-02-a7f03c9e55a5 · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: beacon-model-utrbert-6mer

areas
rna-transcriptomes
source locator
Table3,p.8,row(UTRBERT-6mer)
missing metadata
checkpoint revision: reason: unreported; parameters: reason: unextracted
family label
pretrained
Related records

Suggest a correction